Sep 18 21:03:57.411777 ip-10-0-141-26 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 18 21:03:57.411789 ip-10-0-141-26 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 18 21:03:57.411799 ip-10-0-141-26 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 18 21:03:57.412142 ip-10-0-141-26 systemd[1]: Failed to start Kubernetes Kubelet. Sep 18 21:04:07.633996 ip-10-0-141-26 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 18 21:04:07.634011 ip-10-0-141-26 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot e010ff3f384a4b9a98bc22fc4d393d7c -- Sep 18 21:06:00.666434 ip-10-0-141-26 systemd[1]: Starting Kubernetes Kubelet... Sep 18 21:06:01.078059 ip-10-0-141-26 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 21:06:01.078059 ip-10-0-141-26 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 18 21:06:01.078059 ip-10-0-141-26 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 21:06:01.078059 ip-10-0-141-26 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 18 21:06:01.078059 ip-10-0-141-26 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 21:06:01.078770 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.078122 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 18 21:06:01.083536 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083516 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 21:06:01.083536 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083535 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 21:06:01.083607 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083539 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 21:06:01.083607 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083543 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 21:06:01.083607 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083547 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 21:06:01.083607 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083550 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 21:06:01.083607 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083553 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 21:06:01.083607 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083555 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 21:06:01.083607 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083558 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 21:06:01.083607 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083568 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 21:06:01.083607 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083571 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 21:06:01.083607 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083574 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 21:06:01.083607 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083577 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 21:06:01.083607 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083579 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 21:06:01.083607 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083582 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 21:06:01.083607 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083584 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 21:06:01.083607 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083588 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 21:06:01.083607 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083592 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 21:06:01.083607 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083595 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 21:06:01.083607 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083598 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 21:06:01.083607 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083601 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 21:06:01.084130 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083604 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 21:06:01.084130 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083607 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 21:06:01.084130 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083611 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 21:06:01.084130 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083614 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 21:06:01.084130 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083618 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 21:06:01.084130 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083621 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 21:06:01.084130 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083624 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 21:06:01.084130 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083626 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 21:06:01.084130 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083629 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 21:06:01.084130 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083632 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 21:06:01.084130 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083634 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 21:06:01.084130 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083637 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 21:06:01.084130 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083639 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 21:06:01.084130 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083641 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 21:06:01.084130 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083645 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 21:06:01.084130 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083648 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 21:06:01.084130 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083652 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 21:06:01.084130 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083655 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 21:06:01.084130 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083657 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 21:06:01.084852 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083660 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 21:06:01.084852 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083662 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 21:06:01.084852 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083665 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 21:06:01.084852 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083669 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 21:06:01.084852 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083671 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 21:06:01.084852 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083673 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 21:06:01.084852 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083676 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 21:06:01.084852 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083678 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 21:06:01.084852 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083680 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 21:06:01.084852 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083683 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 21:06:01.084852 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083685 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 21:06:01.084852 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083687 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 21:06:01.084852 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083690 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 21:06:01.084852 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083693 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 21:06:01.084852 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083697 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 21:06:01.084852 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083699 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 21:06:01.084852 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083703 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 21:06:01.084852 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083705 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 21:06:01.084852 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083707 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 21:06:01.084852 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083710 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 21:06:01.085360 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083712 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 21:06:01.085360 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083715 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 21:06:01.085360 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083718 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 21:06:01.085360 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083720 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 21:06:01.085360 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083723 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 21:06:01.085360 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083725 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 21:06:01.085360 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083728 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 18 21:06:01.085360 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083730 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 21:06:01.085360 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083733 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 21:06:01.085360 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083735 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 21:06:01.085360 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083738 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 21:06:01.085360 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083742 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 21:06:01.085360 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083745 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 21:06:01.085360 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083747 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 21:06:01.085360 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083749 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 21:06:01.085360 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083752 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 21:06:01.085360 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083755 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 21:06:01.085360 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083757 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 21:06:01.085360 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083759 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 21:06:01.085360 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083762 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 21:06:01.085840 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083765 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 21:06:01.085840 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083767 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 21:06:01.085840 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083770 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 21:06:01.085840 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083772 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 21:06:01.085840 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083774 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 21:06:01.085840 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083778 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 21:06:01.085840 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083781 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 21:06:01.085840 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083784 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 21:06:01.085840 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083786 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 21:06:01.085840 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083789 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 21:06:01.085840 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083791 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 21:06:01.085840 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083793 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 21:06:01.085840 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083796 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 21:06:01.085840 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083799 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 21:06:01.085840 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083801 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 21:06:01.085840 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083804 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 21:06:01.085840 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083806 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 21:06:01.085840 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083809 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 21:06:01.085840 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.083811 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 21:06:01.086325 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086226 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 21:06:01.086325 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086239 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 21:06:01.086325 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086242 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 21:06:01.086325 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086245 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 21:06:01.086325 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086248 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 21:06:01.086325 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086251 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 21:06:01.086325 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086254 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 21:06:01.086325 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086257 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 21:06:01.086325 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086260 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 21:06:01.086325 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086263 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 21:06:01.086325 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086265 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 21:06:01.086325 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086268 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 21:06:01.086325 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086271 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 21:06:01.086325 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086274 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 21:06:01.086325 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086276 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 21:06:01.086325 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086279 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 21:06:01.086325 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086282 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 21:06:01.086325 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086284 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 21:06:01.086325 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086287 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 21:06:01.086325 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086290 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 21:06:01.086962 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086292 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 21:06:01.086962 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086294 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 21:06:01.086962 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086297 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 21:06:01.086962 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086300 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 21:06:01.086962 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086302 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 21:06:01.086962 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086305 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 21:06:01.086962 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086307 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 21:06:01.086962 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086311 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 21:06:01.086962 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086314 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 21:06:01.086962 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086316 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 21:06:01.086962 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086320 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 21:06:01.086962 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086325 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 21:06:01.086962 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086328 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 21:06:01.086962 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086332 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 21:06:01.086962 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086335 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 21:06:01.086962 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086338 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 21:06:01.086962 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086340 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 21:06:01.086962 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086343 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 21:06:01.086962 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086346 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 21:06:01.087452 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086349 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 21:06:01.087452 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086351 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 21:06:01.087452 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086353 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 21:06:01.087452 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086356 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 21:06:01.087452 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086359 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 21:06:01.087452 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086361 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 21:06:01.087452 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086364 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 21:06:01.087452 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086366 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 21:06:01.087452 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086369 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 21:06:01.087452 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086371 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 21:06:01.087452 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086373 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 21:06:01.087452 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086377 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 21:06:01.087452 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086380 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 21:06:01.087452 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086382 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 21:06:01.087452 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086385 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 21:06:01.087452 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086388 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 21:06:01.087452 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086391 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 21:06:01.087452 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086394 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 21:06:01.087452 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086396 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 21:06:01.087452 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086399 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 21:06:01.087966 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086401 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 21:06:01.087966 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086404 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 21:06:01.087966 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086406 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 21:06:01.087966 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086409 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 21:06:01.087966 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086411 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 21:06:01.087966 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086414 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 21:06:01.087966 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086416 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 21:06:01.087966 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086419 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 21:06:01.087966 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086422 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 21:06:01.087966 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086425 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 21:06:01.087966 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086427 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 21:06:01.087966 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086430 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 21:06:01.087966 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086434 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 21:06:01.087966 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086437 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 21:06:01.087966 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086440 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 21:06:01.087966 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086443 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 21:06:01.087966 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086446 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 21:06:01.087966 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086448 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 18 21:06:01.087966 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086451 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 21:06:01.087966 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086453 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 21:06:01.088481 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086459 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 21:06:01.088481 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086463 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 21:06:01.088481 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086465 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 21:06:01.088481 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086468 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 21:06:01.088481 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086471 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 21:06:01.088481 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086474 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 21:06:01.088481 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086480 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 21:06:01.088481 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086483 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 21:06:01.088481 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086486 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 21:06:01.088481 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086489 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 21:06:01.088481 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086492 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 21:06:01.088481 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086494 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 21:06:01.088481 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086497 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 21:06:01.088481 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086499 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 21:06:01.088481 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086502 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 21:06:01.088481 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086505 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 21:06:01.088481 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086507 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 21:06:01.088481 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086510 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 21:06:01.088481 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086513 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 21:06:01.088953 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086515 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 21:06:01.088953 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086925 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 21:06:01.088953 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086930 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 21:06:01.088953 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086934 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 21:06:01.088953 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086937 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 21:06:01.088953 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086940 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 21:06:01.088953 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086944 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 21:06:01.088953 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086948 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 21:06:01.088953 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086951 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 21:06:01.088953 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086954 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 21:06:01.088953 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086957 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 21:06:01.088953 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086960 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 21:06:01.088953 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086963 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 21:06:01.088953 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086966 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 21:06:01.088953 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086968 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 21:06:01.088953 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086971 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 21:06:01.088953 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086974 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 21:06:01.088953 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086977 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 21:06:01.088953 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086980 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 21:06:01.089450 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086985 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 21:06:01.089450 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086988 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 21:06:01.089450 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086990 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 21:06:01.089450 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086993 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 21:06:01.089450 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086996 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 21:06:01.089450 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.086998 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 21:06:01.089450 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087001 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 21:06:01.089450 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087003 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 21:06:01.089450 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087005 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 21:06:01.089450 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087008 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 21:06:01.089450 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087010 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 21:06:01.089450 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087014 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 21:06:01.089450 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087017 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 21:06:01.089450 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087020 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 21:06:01.089450 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087023 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 21:06:01.089450 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087025 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 21:06:01.089450 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087029 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 21:06:01.089450 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087031 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 21:06:01.089450 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087034 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 21:06:01.089450 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087037 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 21:06:01.089946 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087040 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 21:06:01.089946 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087042 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 21:06:01.089946 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087045 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 21:06:01.089946 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087048 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 21:06:01.089946 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087051 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 18 21:06:01.089946 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087053 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 21:06:01.089946 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087056 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 21:06:01.089946 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087058 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 21:06:01.089946 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087060 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 21:06:01.089946 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087063 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 21:06:01.089946 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087065 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 21:06:01.089946 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087068 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 21:06:01.089946 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087072 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 21:06:01.089946 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087075 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 21:06:01.089946 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087077 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 21:06:01.089946 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087079 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 21:06:01.089946 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087082 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 21:06:01.089946 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087085 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 21:06:01.089946 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087087 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 21:06:01.089946 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087090 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 21:06:01.090460 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087092 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 21:06:01.090460 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087094 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 21:06:01.090460 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087097 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 21:06:01.090460 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087100 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 21:06:01.090460 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087103 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 21:06:01.090460 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087107 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 21:06:01.090460 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087110 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 21:06:01.090460 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087112 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 21:06:01.090460 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087115 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 21:06:01.090460 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087117 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 21:06:01.090460 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087121 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 21:06:01.090460 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087123 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 21:06:01.090460 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087127 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 21:06:01.090460 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087129 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 21:06:01.090460 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087132 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 21:06:01.090460 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087134 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 21:06:01.090460 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087137 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 21:06:01.090460 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087139 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 21:06:01.090460 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087141 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 21:06:01.090923 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087144 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 21:06:01.090923 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087146 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 21:06:01.090923 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087164 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 21:06:01.090923 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087166 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 21:06:01.090923 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087169 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 21:06:01.090923 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087175 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 21:06:01.090923 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087178 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 21:06:01.090923 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087181 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 21:06:01.090923 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087183 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 21:06:01.090923 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087185 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 21:06:01.090923 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087188 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 21:06:01.090923 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087190 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 21:06:01.090923 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087193 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 21:06:01.090923 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087195 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 21:06:01.090923 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087198 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 21:06:01.090923 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087200 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 21:06:01.090923 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087203 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 21:06:01.090923 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087205 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 21:06:01.090923 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087208 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 21:06:01.090923 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087210 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 21:06:01.091418 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087213 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 21:06:01.091418 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087215 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 21:06:01.091418 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087285 2581 flags.go:64] FLAG: --address="0.0.0.0" Sep 18 21:06:01.091418 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087331 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 18 21:06:01.091418 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087339 2581 flags.go:64] FLAG: --anonymous-auth="true" Sep 18 21:06:01.091418 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087343 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 18 21:06:01.091418 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087347 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 18 21:06:01.091418 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087351 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 18 21:06:01.091418 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087354 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 18 21:06:01.091418 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087359 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 18 21:06:01.091418 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087362 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 18 21:06:01.091418 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087365 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 18 21:06:01.091418 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087368 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 18 21:06:01.091418 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087371 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 18 21:06:01.091418 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087374 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 18 21:06:01.091418 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087377 2581 flags.go:64] FLAG: --cgroup-root="" Sep 18 21:06:01.091418 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087380 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 18 21:06:01.091418 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087384 2581 flags.go:64] FLAG: --client-ca-file="" Sep 18 21:06:01.091418 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087388 2581 flags.go:64] FLAG: --cloud-provider="external" Sep 18 21:06:01.091418 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087391 2581 flags.go:64] FLAG: --cluster-dns="[]" Sep 18 21:06:01.091418 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087396 2581 flags.go:64] FLAG: --cluster-domain="" Sep 18 21:06:01.091418 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087399 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 18 21:06:01.091418 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087402 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 18 21:06:01.091418 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087405 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 18 21:06:01.091983 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087408 2581 flags.go:64] FLAG: --container-log-max-files="5" Sep 18 21:06:01.091983 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087412 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 18 21:06:01.091983 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087415 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 18 21:06:01.091983 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087417 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 18 21:06:01.091983 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087421 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 18 21:06:01.091983 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087424 2581 flags.go:64] FLAG: --contention-profiling="false" Sep 18 21:06:01.091983 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087427 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 18 21:06:01.091983 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087430 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 18 21:06:01.091983 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087433 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 18 21:06:01.091983 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087436 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 18 21:06:01.091983 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087440 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 18 21:06:01.091983 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087442 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 18 21:06:01.091983 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087445 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 18 21:06:01.091983 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087448 2581 flags.go:64] FLAG: --enable-load-reader="false" Sep 18 21:06:01.091983 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087451 2581 flags.go:64] FLAG: --enable-server="true" Sep 18 21:06:01.091983 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087454 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 18 21:06:01.091983 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087459 2581 flags.go:64] FLAG: --event-burst="100" Sep 18 21:06:01.091983 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087462 2581 flags.go:64] FLAG: --event-qps="50" Sep 18 21:06:01.091983 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087465 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 18 21:06:01.091983 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087468 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 18 21:06:01.091983 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087471 2581 flags.go:64] FLAG: --eviction-hard="" Sep 18 21:06:01.091983 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087475 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 18 21:06:01.091983 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087486 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 18 21:06:01.091983 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087489 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 18 21:06:01.091983 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087492 2581 flags.go:64] FLAG: --eviction-soft="" Sep 18 21:06:01.092618 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087495 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 18 21:06:01.092618 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087498 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 18 21:06:01.092618 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087502 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 18 21:06:01.092618 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087505 2581 flags.go:64] FLAG: --experimental-mounter-path="" Sep 18 21:06:01.092618 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087508 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 18 21:06:01.092618 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087511 2581 flags.go:64] FLAG: --fail-swap-on="true" Sep 18 21:06:01.092618 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087513 2581 flags.go:64] FLAG: --feature-gates="" Sep 18 21:06:01.092618 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087517 2581 flags.go:64] FLAG: --file-check-frequency="20s" Sep 18 21:06:01.092618 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087520 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 18 21:06:01.092618 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087523 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 18 21:06:01.092618 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087525 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 18 21:06:01.092618 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087528 2581 flags.go:64] FLAG: --healthz-port="10248" Sep 18 21:06:01.092618 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087531 2581 flags.go:64] FLAG: --help="false" Sep 18 21:06:01.092618 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087534 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-141-26.ec2.internal" Sep 18 21:06:01.092618 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087537 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 18 21:06:01.092618 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087540 2581 flags.go:64] FLAG: --http-check-frequency="20s" Sep 18 21:06:01.092618 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087543 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 18 21:06:01.092618 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087546 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 18 21:06:01.092618 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087549 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 18 21:06:01.092618 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087552 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 18 21:06:01.092618 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087554 2581 flags.go:64] FLAG: --image-service-endpoint="" Sep 18 21:06:01.092618 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087557 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 18 21:06:01.092618 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087559 2581 flags.go:64] FLAG: --kube-api-burst="100" Sep 18 21:06:01.093236 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087562 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 18 21:06:01.093236 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087565 2581 flags.go:64] FLAG: --kube-api-qps="50" Sep 18 21:06:01.093236 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087568 2581 flags.go:64] FLAG: --kube-reserved="" Sep 18 21:06:01.093236 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087571 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 18 21:06:01.093236 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087573 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 18 21:06:01.093236 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087581 2581 flags.go:64] FLAG: --kubelet-cgroups="" Sep 18 21:06:01.093236 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087583 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 18 21:06:01.093236 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087586 2581 flags.go:64] FLAG: --lock-file="" Sep 18 21:06:01.093236 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087589 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 18 21:06:01.093236 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087592 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 18 21:06:01.093236 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087595 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 18 21:06:01.093236 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087600 2581 flags.go:64] FLAG: --log-json-split-stream="false" Sep 18 21:06:01.093236 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087604 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 18 21:06:01.093236 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087607 2581 flags.go:64] FLAG: --log-text-split-stream="false" Sep 18 21:06:01.093236 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087610 2581 flags.go:64] FLAG: --logging-format="text" Sep 18 21:06:01.093236 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087613 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 18 21:06:01.093236 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087617 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 18 21:06:01.093236 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087619 2581 flags.go:64] FLAG: --manifest-url="" Sep 18 21:06:01.093236 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087622 2581 flags.go:64] FLAG: --manifest-url-header="" Sep 18 21:06:01.093236 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087627 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 18 21:06:01.093236 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087630 2581 flags.go:64] FLAG: --max-open-files="1000000" Sep 18 21:06:01.093236 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087633 2581 flags.go:64] FLAG: --max-pods="110" Sep 18 21:06:01.093236 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087637 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 18 21:06:01.093236 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087639 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 18 21:06:01.093236 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087642 2581 flags.go:64] FLAG: --memory-manager-policy="None" Sep 18 21:06:01.093843 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087645 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 18 21:06:01.093843 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087648 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 18 21:06:01.093843 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087651 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 18 21:06:01.093843 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087655 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 18 21:06:01.093843 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087663 2581 flags.go:64] FLAG: --node-status-max-images="50" Sep 18 21:06:01.093843 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087666 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 18 21:06:01.093843 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087669 2581 flags.go:64] FLAG: --oom-score-adj="-999" Sep 18 21:06:01.093843 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087672 2581 flags.go:64] FLAG: --pod-cidr="" Sep 18 21:06:01.093843 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087675 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 18 21:06:01.093843 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087680 2581 flags.go:64] FLAG: --pod-manifest-path="" Sep 18 21:06:01.093843 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087683 2581 flags.go:64] FLAG: --pod-max-pids="-1" Sep 18 21:06:01.093843 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087686 2581 flags.go:64] FLAG: --pods-per-core="0" Sep 18 21:06:01.093843 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087689 2581 flags.go:64] FLAG: --port="10250" Sep 18 21:06:01.093843 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087693 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 18 21:06:01.093843 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087695 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00e8f1c3fb57c0852" Sep 18 21:06:01.093843 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087699 2581 flags.go:64] FLAG: --qos-reserved="" Sep 18 21:06:01.093843 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087702 2581 flags.go:64] FLAG: --read-only-port="10255" Sep 18 21:06:01.093843 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087705 2581 flags.go:64] FLAG: --register-node="true" Sep 18 21:06:01.093843 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087707 2581 flags.go:64] FLAG: --register-with-taints="" Sep 18 21:06:01.093843 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087711 2581 flags.go:64] FLAG: --registry-burst="10" Sep 18 21:06:01.093843 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087715 2581 flags.go:64] FLAG: --registry-qps="5" Sep 18 21:06:01.093843 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087717 2581 flags.go:64] FLAG: --reserved-cpus="" Sep 18 21:06:01.093843 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087720 2581 flags.go:64] FLAG: --reserved-memory="" Sep 18 21:06:01.093843 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087724 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 18 21:06:01.093843 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087727 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 18 21:06:01.094489 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087730 2581 flags.go:64] FLAG: --rotate-certificates="false" Sep 18 21:06:01.094489 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087732 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 18 21:06:01.094489 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087735 2581 flags.go:64] FLAG: --runonce="false" Sep 18 21:06:01.094489 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087738 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 18 21:06:01.094489 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087740 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 18 21:06:01.094489 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087743 2581 flags.go:64] FLAG: --seccomp-default="false" Sep 18 21:06:01.094489 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087746 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 18 21:06:01.094489 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087749 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 18 21:06:01.094489 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087752 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 18 21:06:01.094489 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087754 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 18 21:06:01.094489 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087759 2581 flags.go:64] FLAG: --storage-driver-password="root" Sep 18 21:06:01.094489 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087761 2581 flags.go:64] FLAG: --storage-driver-secure="false" Sep 18 21:06:01.094489 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087764 2581 flags.go:64] FLAG: --storage-driver-table="stats" Sep 18 21:06:01.094489 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087767 2581 flags.go:64] FLAG: --storage-driver-user="root" Sep 18 21:06:01.094489 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087770 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 18 21:06:01.094489 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087773 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 18 21:06:01.094489 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087775 2581 flags.go:64] FLAG: --system-cgroups="" Sep 18 21:06:01.094489 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087778 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 18 21:06:01.094489 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087783 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 18 21:06:01.094489 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087786 2581 flags.go:64] FLAG: --tls-cert-file="" Sep 18 21:06:01.094489 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087789 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 18 21:06:01.094489 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087793 2581 flags.go:64] FLAG: --tls-min-version="" Sep 18 21:06:01.094489 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087796 2581 flags.go:64] FLAG: --tls-private-key-file="" Sep 18 21:06:01.094489 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087799 2581 flags.go:64] FLAG: --topology-manager-policy="none" Sep 18 21:06:01.094489 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087802 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 18 21:06:01.095097 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087805 2581 flags.go:64] FLAG: --topology-manager-scope="container" Sep 18 21:06:01.095097 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087808 2581 flags.go:64] FLAG: --v="2" Sep 18 21:06:01.095097 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087812 2581 flags.go:64] FLAG: --version="false" Sep 18 21:06:01.095097 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087816 2581 flags.go:64] FLAG: --vmodule="" Sep 18 21:06:01.095097 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087820 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 18 21:06:01.095097 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.087824 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 18 21:06:01.095097 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087948 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 21:06:01.095097 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087951 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 21:06:01.095097 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087955 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 21:06:01.095097 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087958 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 21:06:01.095097 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087960 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 21:06:01.095097 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087963 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 21:06:01.095097 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087966 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 21:06:01.095097 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087969 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 21:06:01.095097 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087972 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 21:06:01.095097 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087974 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 21:06:01.095097 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087977 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 21:06:01.095097 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087981 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 21:06:01.095097 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087984 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 21:06:01.095097 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087987 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 21:06:01.095097 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087990 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 21:06:01.095631 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087992 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 21:06:01.095631 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087995 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 21:06:01.095631 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.087997 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 21:06:01.095631 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088000 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 21:06:01.095631 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088002 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 21:06:01.095631 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088005 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 21:06:01.095631 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088007 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 21:06:01.095631 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088010 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 21:06:01.095631 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088012 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 18 21:06:01.095631 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088015 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 21:06:01.095631 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088021 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 21:06:01.095631 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088025 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 21:06:01.095631 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088028 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 21:06:01.095631 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088031 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 21:06:01.095631 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088034 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 21:06:01.095631 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088037 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 21:06:01.095631 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088040 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 21:06:01.095631 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088042 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 21:06:01.095631 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088045 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 21:06:01.095631 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088048 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 21:06:01.096160 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088050 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 21:06:01.096160 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088053 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 21:06:01.096160 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088055 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 21:06:01.096160 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088058 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 21:06:01.096160 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088061 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 21:06:01.096160 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088063 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 21:06:01.096160 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088066 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 21:06:01.096160 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088069 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 21:06:01.096160 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088073 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 21:06:01.096160 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088075 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 21:06:01.096160 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088078 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 21:06:01.096160 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088080 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 21:06:01.096160 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088083 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 21:06:01.096160 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088086 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 21:06:01.096160 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088088 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 21:06:01.096160 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088091 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 21:06:01.096160 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088094 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 21:06:01.096160 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088096 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 21:06:01.096160 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088099 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 21:06:01.096647 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088101 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 21:06:01.096647 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088104 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 21:06:01.096647 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088106 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 21:06:01.096647 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088110 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 21:06:01.096647 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088113 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 21:06:01.096647 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088115 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 21:06:01.096647 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088118 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 21:06:01.096647 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088120 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 21:06:01.096647 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088124 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 21:06:01.096647 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088129 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 21:06:01.096647 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088132 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 21:06:01.096647 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088135 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 21:06:01.096647 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088138 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 21:06:01.096647 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088141 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 21:06:01.096647 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088144 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 21:06:01.096647 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088146 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 21:06:01.096647 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088166 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 21:06:01.096647 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088170 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 21:06:01.096647 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088174 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 21:06:01.097107 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088178 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 21:06:01.097107 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088182 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 21:06:01.097107 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088186 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 21:06:01.097107 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088188 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 21:06:01.097107 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088191 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 21:06:01.097107 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088194 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 21:06:01.097107 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088196 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 21:06:01.097107 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088199 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 21:06:01.097107 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088201 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 21:06:01.097107 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088204 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 21:06:01.097107 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088206 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 21:06:01.097107 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088209 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 21:06:01.097107 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088211 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 21:06:01.097107 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088214 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 21:06:01.097107 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088217 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 21:06:01.097107 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088220 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 21:06:01.097107 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088223 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 21:06:01.097107 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088226 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 21:06:01.097107 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088229 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 21:06:01.097107 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088234 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 21:06:01.097681 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088236 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 21:06:01.097681 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088240 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 21:06:01.097681 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088242 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 21:06:01.097681 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088246 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 21:06:01.097681 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088248 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 21:06:01.097681 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.088251 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 21:06:01.097681 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.088736 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 21:06:01.097681 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.095927 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 18 21:06:01.097681 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.095945 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 18 21:06:01.097681 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.095958 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 18 21:06:01.097681 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.095963 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 18 21:06:01.097681 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096021 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 21:06:01.097681 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096025 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 21:06:01.097681 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096029 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 21:06:01.098030 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096032 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 21:06:01.098030 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096035 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 21:06:01.098030 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096037 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 21:06:01.098030 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096040 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 21:06:01.098030 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096042 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 21:06:01.098030 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096045 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 21:06:01.098030 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096048 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 21:06:01.098030 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096051 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 21:06:01.098030 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096053 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 21:06:01.098030 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096056 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 21:06:01.098030 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096058 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 21:06:01.098030 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096063 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 21:06:01.098030 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096066 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 21:06:01.098030 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096070 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 21:06:01.098030 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096072 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 21:06:01.098030 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096075 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 21:06:01.098030 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096078 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 21:06:01.098030 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096081 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 21:06:01.098030 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096084 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 21:06:01.098502 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096087 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 21:06:01.098502 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096090 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 21:06:01.098502 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096093 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 21:06:01.098502 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096096 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 21:06:01.098502 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096100 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 21:06:01.098502 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096103 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 21:06:01.098502 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096106 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 21:06:01.098502 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096110 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 21:06:01.098502 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096113 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 21:06:01.098502 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096116 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 21:06:01.098502 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096119 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 21:06:01.098502 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096122 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 21:06:01.098502 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096125 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 21:06:01.098502 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096129 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 21:06:01.098502 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096132 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 21:06:01.098502 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096135 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 21:06:01.098502 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096138 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 21:06:01.098502 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096140 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 21:06:01.098502 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096143 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 21:06:01.098961 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096145 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 21:06:01.098961 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096148 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 21:06:01.098961 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096164 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 21:06:01.098961 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096166 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 21:06:01.098961 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096169 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 21:06:01.098961 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096172 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 21:06:01.098961 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096175 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 21:06:01.098961 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096178 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 21:06:01.098961 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096180 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 21:06:01.098961 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096182 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 21:06:01.098961 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096185 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 21:06:01.098961 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096188 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 21:06:01.098961 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096190 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 21:06:01.098961 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096193 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 21:06:01.098961 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096195 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 21:06:01.098961 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096198 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 21:06:01.098961 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096201 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 21:06:01.098961 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096204 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 21:06:01.098961 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096207 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 21:06:01.098961 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096209 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 21:06:01.099509 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096213 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 21:06:01.099509 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096215 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 21:06:01.099509 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096218 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 21:06:01.099509 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096221 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 21:06:01.099509 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096224 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 21:06:01.099509 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096226 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 21:06:01.099509 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096229 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 21:06:01.099509 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096231 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 21:06:01.099509 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096234 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 18 21:06:01.099509 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096236 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 21:06:01.099509 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096239 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 21:06:01.099509 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096241 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 21:06:01.099509 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096244 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 21:06:01.099509 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096246 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 21:06:01.099509 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096249 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 21:06:01.099509 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096251 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 21:06:01.099509 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096254 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 21:06:01.099509 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096256 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 21:06:01.099509 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096259 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 21:06:01.099509 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096261 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 21:06:01.100004 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096264 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 21:06:01.100004 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096267 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 21:06:01.100004 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096269 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 21:06:01.100004 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096272 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 21:06:01.100004 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096274 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 21:06:01.100004 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096277 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 21:06:01.100004 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096279 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 21:06:01.100004 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096282 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 21:06:01.100004 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096284 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 21:06:01.100004 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096288 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 21:06:01.100004 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096290 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 21:06:01.100004 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096293 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 21:06:01.100004 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096296 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 21:06:01.100004 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096299 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 21:06:01.100004 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096302 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 21:06:01.100004 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096304 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 21:06:01.100004 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096307 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 21:06:01.100004 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096309 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 21:06:01.100457 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.096314 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 21:06:01.100457 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096431 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 21:06:01.100457 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096435 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 21:06:01.100457 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096438 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 21:06:01.100457 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096441 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 21:06:01.100457 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096445 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 21:06:01.100457 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096448 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 21:06:01.100457 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096451 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 21:06:01.100457 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096454 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 21:06:01.100457 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096457 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 21:06:01.100457 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096460 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 21:06:01.100457 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096463 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 21:06:01.100457 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096466 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 21:06:01.100457 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096468 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 21:06:01.100457 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096471 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 21:06:01.100825 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096474 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 21:06:01.100825 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096477 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 21:06:01.100825 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096480 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 21:06:01.100825 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096482 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 21:06:01.100825 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096485 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 21:06:01.100825 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096487 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 21:06:01.100825 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096490 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 21:06:01.100825 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096492 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 18 21:06:01.100825 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096495 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 21:06:01.100825 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096498 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 21:06:01.100825 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096500 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 21:06:01.100825 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096503 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 21:06:01.100825 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096506 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 21:06:01.100825 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096508 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 21:06:01.100825 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096511 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 21:06:01.100825 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096513 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 21:06:01.100825 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096516 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 21:06:01.100825 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096518 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 21:06:01.100825 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096521 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 21:06:01.100825 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096523 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 21:06:01.101387 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096526 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 21:06:01.101387 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096528 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 21:06:01.101387 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096531 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 21:06:01.101387 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096533 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 21:06:01.101387 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096535 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 21:06:01.101387 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096538 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 21:06:01.101387 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096540 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 21:06:01.101387 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096543 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 21:06:01.101387 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096547 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 21:06:01.101387 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096550 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 21:06:01.101387 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096553 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 21:06:01.101387 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096556 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 21:06:01.101387 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096559 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 21:06:01.101387 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096562 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 21:06:01.101387 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096565 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 21:06:01.101387 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096567 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 21:06:01.101387 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096570 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 21:06:01.101387 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096573 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 21:06:01.101387 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096575 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 21:06:01.101387 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096578 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 21:06:01.101862 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096581 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 21:06:01.101862 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096583 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 21:06:01.101862 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096586 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 21:06:01.101862 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096589 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 21:06:01.101862 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096591 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 21:06:01.101862 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096594 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 21:06:01.101862 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096596 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 21:06:01.101862 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096599 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 21:06:01.101862 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096602 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 21:06:01.101862 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096604 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 21:06:01.101862 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096607 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 21:06:01.101862 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096609 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 21:06:01.101862 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096611 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 21:06:01.101862 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096614 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 21:06:01.101862 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096616 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 21:06:01.101862 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096619 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 21:06:01.101862 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096621 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 21:06:01.101862 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096624 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 21:06:01.101862 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096626 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 21:06:01.102342 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096629 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 21:06:01.102342 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096632 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 21:06:01.102342 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096634 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 21:06:01.102342 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096637 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 21:06:01.102342 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096639 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 21:06:01.102342 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096642 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 21:06:01.102342 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096645 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 21:06:01.102342 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096647 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 21:06:01.102342 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096650 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 21:06:01.102342 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096653 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 21:06:01.102342 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096656 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 21:06:01.102342 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096659 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 21:06:01.102342 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096662 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 21:06:01.102342 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096664 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 21:06:01.102342 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096667 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 21:06:01.102342 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096670 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 21:06:01.102342 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096673 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 21:06:01.102342 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096675 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 21:06:01.102342 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096678 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 21:06:01.102342 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096680 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 21:06:01.102829 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096683 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 21:06:01.102829 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096686 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 21:06:01.102829 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096688 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 21:06:01.102829 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096691 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 21:06:01.102829 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096693 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 21:06:01.102829 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:01.096696 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 21:06:01.102829 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.096700 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 21:06:01.102829 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.096810 2581 server.go:962] "Client rotation is on, will bootstrap in background" Sep 18 21:06:01.102829 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.100222 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 18 21:06:01.102829 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.101182 2581 server.go:1019] "Starting client certificate rotation" Sep 18 21:06:01.102829 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.101288 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 21:06:01.102829 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.101320 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 21:06:01.103802 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.103788 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 21:06:01.105552 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.105532 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 21:06:01.114753 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.114732 2581 log.go:25] "Validated CRI v1 runtime API" Sep 18 21:06:01.116362 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.116348 2581 log.go:25] "Validated CRI v1 image API" Sep 18 21:06:01.117184 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.117164 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 18 21:06:01.122187 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.122168 2581 fs.go:135] Filesystem UUIDs: map[078b165d-781f-4e21-a254-bede3aa16908:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b7dfda23-d464-4693-a269-e9da8a7f1435:/dev/nvme0n1p3] Sep 18 21:06:01.122260 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.122186 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 18 21:06:01.127411 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.127182 2581 manager.go:216] Machine: {Timestamp:2026-09-18 21:06:01.125875978 +0000 UTC m=+0.345988357 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100975 MemoryCapacity:32812150784 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec247f317d06aa90b69d07077fb24892 SystemUUID:ec247f31-7d06-aa90-b69d-07077fb24892 BootID:e010ff3f-384a-4b9a-98bc-22fc4d393d7c Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406073344 Type:vfs Inodes:4005389 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:cd:e5:df:f3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:cd:e5:df:f3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:df:ae:d0:4d:0b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812150784 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 18 21:06:01.127411 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.127410 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 18 21:06:01.127536 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.127499 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 18 21:06:01.129232 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.129209 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 18 21:06:01.129386 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.129236 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-26.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 18 21:06:01.130904 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.130893 2581 topology_manager.go:138] "Creating topology manager with none policy" Sep 18 21:06:01.130949 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.130907 2581 container_manager_linux.go:309] "Creating device plugin manager" Sep 18 21:06:01.130949 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.130915 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 21:06:01.131997 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.131986 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 21:06:01.133144 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.133135 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 18 21:06:01.137972 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.137960 2581 state_mem.go:36] "Initialized new in-memory state store" Sep 18 21:06:01.138099 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.138090 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 18 21:06:01.138137 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.138133 2581 kubelet.go:486] "Attempting to sync node with API server" Sep 18 21:06:01.138185 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.138175 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 18 21:06:01.138214 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.138198 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 18 21:06:01.138214 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.138211 2581 kubelet.go:398] "Adding apiserver pod source" Sep 18 21:06:01.138263 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.138222 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 18 21:06:01.138547 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.138536 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 21:06:01.138597 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.138553 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 21:06:01.141440 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.141419 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 18 21:06:01.143271 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.143252 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 21:06:01.144034 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.144019 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 18 21:06:01.144120 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.144051 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 18 21:06:01.145083 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.145072 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 18 21:06:01.145133 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.145088 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 18 21:06:01.145133 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.145095 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 18 21:06:01.145133 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.145101 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 18 21:06:01.145133 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.145110 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 18 21:06:01.145133 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.145115 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 18 21:06:01.145133 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.145127 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 18 21:06:01.145133 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.145133 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 18 21:06:01.145335 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.145140 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 18 21:06:01.145335 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.145145 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 18 21:06:01.145335 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.145169 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 18 21:06:01.145335 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.145176 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 18 21:06:01.146025 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.146015 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 18 21:06:01.146025 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.146025 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 18 21:06:01.149792 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.149774 2581 server.go:1268] "Started kubelet" Sep 18 21:06:01.149911 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.149853 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 18 21:06:01.149974 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.149937 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 18 21:06:01.149974 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.149893 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 18 21:06:01.150453 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.150434 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-26.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 18 21:06:01.150728 ip-10-0-141-26 systemd[1]: Started Kubernetes Kubelet. Sep 18 21:06:01.153774 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:01.153651 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-26.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 18 21:06:01.153996 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.153971 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 18 21:06:01.154364 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:01.154336 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 18 21:06:01.154998 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:01.154974 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 18 21:06:01.155773 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.155756 2581 server.go:310] "Adding debug handlers to kubelet server" Sep 18 21:06:01.162811 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.162792 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 18 21:06:01.162874 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.162807 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 18 21:06:01.163261 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:01.163228 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-26.ec2.internal\" not found" Sep 18 21:06:01.163416 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.163400 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 18 21:06:01.163416 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.163402 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 18 21:06:01.163578 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.163423 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 18 21:06:01.163578 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.163543 2581 reconstruct.go:97] "Volume reconstruction finished" Sep 18 21:06:01.163578 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.163550 2581 reconciler.go:29] "Reconciler: start to sync state" Sep 18 21:06:01.164266 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.164252 2581 factory.go:55] Registering systemd factory Sep 18 21:06:01.164266 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.164271 2581 factory.go:223] Registration of the systemd container factory successfully Sep 18 21:06:01.164525 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.164509 2581 factory.go:153] Registering CRI-O factory Sep 18 21:06:01.164577 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.164529 2581 factory.go:223] Registration of the crio container factory successfully Sep 18 21:06:01.164630 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.164586 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 18 21:06:01.164630 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.164604 2581 factory.go:103] Registering Raw factory Sep 18 21:06:01.164630 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.164618 2581 manager.go:1196] Started watching for new ooms in manager Sep 18 21:06:01.165002 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.164989 2581 manager.go:349] Starting recovery of all containers Sep 18 21:06:01.167467 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:01.167434 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 18 21:06:01.167590 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:01.167546 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-26.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 18 21:06:01.168442 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:01.167319 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-26.ec2.internal.18d6864b978eedaf default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-26.ec2.internal,UID:ip-10-0-141-26.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-26.ec2.internal,},FirstTimestamp:2026-09-18 21:06:01.149746607 +0000 UTC m=+0.369858986,LastTimestamp:2026-09-18 21:06:01.149746607 +0000 UTC m=+0.369858986,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-26.ec2.internal,}" Sep 18 21:06:01.176844 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.176828 2581 manager.go:354] Recovery completed Sep 18 21:06:01.181058 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.181045 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 21:06:01.182945 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.182924 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-26.ec2.internal" event="NodeHasSufficientMemory" Sep 18 21:06:01.183030 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.182962 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-26.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 21:06:01.183030 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.182977 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-26.ec2.internal" event="NodeHasSufficientPID" Sep 18 21:06:01.183698 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.183683 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 18 21:06:01.183698 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.183697 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 18 21:06:01.183830 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.183716 2581 state_mem.go:36] "Initialized new in-memory state store" Sep 18 21:06:01.183830 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.183686 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 21:06:01.184591 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.184573 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-26.ec2.internal" event="NodeHasSufficientMemory" Sep 18 21:06:01.184689 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.184601 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-26.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 21:06:01.184689 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.184614 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-26.ec2.internal" event="NodeHasSufficientPID" Sep 18 21:06:01.185203 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.185189 2581 policy_none.go:49] "None policy: Start" Sep 18 21:06:01.185269 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.185209 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 18 21:06:01.185269 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.185223 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 18 21:06:01.185399 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:01.185335 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-26.ec2.internal.18d6864b99898431 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-26.ec2.internal,UID:ip-10-0-141-26.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-26.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-26.ec2.internal,},FirstTimestamp:2026-09-18 21:06:01.182946353 +0000 UTC m=+0.403058735,LastTimestamp:2026-09-18 21:06:01.182946353 +0000 UTC m=+0.403058735,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-26.ec2.internal,}" Sep 18 21:06:01.186394 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.186381 2581 policy_none.go:47] "Start" Sep 18 21:06:01.195652 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:01.195588 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-26.ec2.internal.18d6864b9989df31 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-26.ec2.internal,UID:ip-10-0-141-26.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-26.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-26.ec2.internal,},FirstTimestamp:2026-09-18 21:06:01.182969649 +0000 UTC m=+0.403082032,LastTimestamp:2026-09-18 21:06:01.182969649 +0000 UTC m=+0.403082032,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-26.ec2.internal,}" Sep 18 21:06:01.197785 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.197767 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wk4dl" Sep 18 21:06:01.209365 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:01.209298 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-26.ec2.internal.18d6864b998a1092 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-26.ec2.internal,UID:ip-10-0-141-26.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-26.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-26.ec2.internal,},FirstTimestamp:2026-09-18 21:06:01.18298229 +0000 UTC m=+0.403094670,LastTimestamp:2026-09-18 21:06:01.18298229 +0000 UTC m=+0.403094670,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-26.ec2.internal,}" Sep 18 21:06:01.230133 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.214914 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wk4dl" Sep 18 21:06:01.231535 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.231517 2581 manager.go:337] "Starting Device Plugin manager" Sep 18 21:06:01.231623 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:01.231565 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 18 21:06:01.231623 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.231580 2581 server.go:87] "Starting device plugin registration server" Sep 18 21:06:01.231853 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.231840 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 18 21:06:01.231917 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.231854 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 18 21:06:01.231965 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.231954 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 18 21:06:01.232037 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.232023 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 18 21:06:01.232037 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.232038 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 18 21:06:01.232716 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:01.232693 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 18 21:06:01.232792 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:01.232751 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-26.ec2.internal\" not found" Sep 18 21:06:01.261748 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.261714 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 18 21:06:01.262954 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.262937 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 18 21:06:01.263060 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.262992 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 18 21:06:01.263060 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.263018 2581 kubelet.go:2448] "Starting kubelet main sync loop" Sep 18 21:06:01.263175 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:01.263062 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 18 21:06:01.265820 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.265798 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 21:06:01.332958 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.332854 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 21:06:01.333925 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.333910 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-26.ec2.internal" event="NodeHasSufficientMemory" Sep 18 21:06:01.333984 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.333941 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-26.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 21:06:01.333984 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.333955 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-26.ec2.internal" event="NodeHasSufficientPID" Sep 18 21:06:01.333984 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.333978 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-26.ec2.internal" Sep 18 21:06:01.345045 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.345022 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-26.ec2.internal" Sep 18 21:06:01.345144 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:01.345049 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-26.ec2.internal\": node \"ip-10-0-141-26.ec2.internal\" not found" Sep 18 21:06:01.363537 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.363515 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-26.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-26.ec2.internal"] Sep 18 21:06:01.363628 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.363592 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 21:06:01.364980 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.364965 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-26.ec2.internal" event="NodeHasSufficientMemory" Sep 18 21:06:01.365055 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.364991 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-26.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 21:06:01.365055 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.365001 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-26.ec2.internal" event="NodeHasSufficientPID" Sep 18 21:06:01.366221 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.366209 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 21:06:01.366362 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.366336 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-26.ec2.internal" Sep 18 21:06:01.366419 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.366375 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 21:06:01.366976 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.366960 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-26.ec2.internal" event="NodeHasSufficientMemory" Sep 18 21:06:01.367076 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.366985 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-26.ec2.internal" event="NodeHasSufficientMemory" Sep 18 21:06:01.367076 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.367010 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-26.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 21:06:01.367076 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.367019 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-26.ec2.internal" event="NodeHasSufficientPID" Sep 18 21:06:01.367076 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.366988 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-26.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 21:06:01.367076 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.367070 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-26.ec2.internal" event="NodeHasSufficientPID" Sep 18 21:06:01.368297 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.368283 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-26.ec2.internal" Sep 18 21:06:01.368347 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.368313 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 21:06:01.369371 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.369355 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-26.ec2.internal" event="NodeHasSufficientMemory" Sep 18 21:06:01.369458 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.369385 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-26.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 21:06:01.369458 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.369394 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-26.ec2.internal" event="NodeHasSufficientPID" Sep 18 21:06:01.388210 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:01.388182 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-26.ec2.internal\" not found" Sep 18 21:06:01.388895 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:01.388880 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-26.ec2.internal\" not found" node="ip-10-0-141-26.ec2.internal" Sep 18 21:06:01.393201 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:01.393185 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-26.ec2.internal\" not found" node="ip-10-0-141-26.ec2.internal" Sep 18 21:06:01.488334 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:01.488299 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-26.ec2.internal\" not found" Sep 18 21:06:01.564982 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.564948 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5deca0065e79f962c53d6bd5963d6479-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-26.ec2.internal\" (UID: \"5deca0065e79f962c53d6bd5963d6479\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-26.ec2.internal" Sep 18 21:06:01.564982 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.564976 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6087d6c1490414fda05efa5f1a508a01-config\") pod \"kube-apiserver-proxy-ip-10-0-141-26.ec2.internal\" (UID: \"6087d6c1490414fda05efa5f1a508a01\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-26.ec2.internal" Sep 18 21:06:01.565214 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.564995 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5deca0065e79f962c53d6bd5963d6479-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-26.ec2.internal\" (UID: \"5deca0065e79f962c53d6bd5963d6479\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-26.ec2.internal" Sep 18 21:06:01.588469 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:01.588411 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-26.ec2.internal\" not found" Sep 18 21:06:01.665913 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.665878 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6087d6c1490414fda05efa5f1a508a01-config\") pod \"kube-apiserver-proxy-ip-10-0-141-26.ec2.internal\" (UID: \"6087d6c1490414fda05efa5f1a508a01\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-26.ec2.internal" Sep 18 21:06:01.666021 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.665939 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5deca0065e79f962c53d6bd5963d6479-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-26.ec2.internal\" (UID: \"5deca0065e79f962c53d6bd5963d6479\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-26.ec2.internal" Sep 18 21:06:01.666021 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.665964 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5deca0065e79f962c53d6bd5963d6479-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-26.ec2.internal\" (UID: \"5deca0065e79f962c53d6bd5963d6479\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-26.ec2.internal" Sep 18 21:06:01.666021 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.665982 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6087d6c1490414fda05efa5f1a508a01-config\") pod \"kube-apiserver-proxy-ip-10-0-141-26.ec2.internal\" (UID: \"6087d6c1490414fda05efa5f1a508a01\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-26.ec2.internal" Sep 18 21:06:01.666132 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.666020 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5deca0065e79f962c53d6bd5963d6479-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-26.ec2.internal\" (UID: \"5deca0065e79f962c53d6bd5963d6479\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-26.ec2.internal" Sep 18 21:06:01.666132 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.666042 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5deca0065e79f962c53d6bd5963d6479-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-26.ec2.internal\" (UID: \"5deca0065e79f962c53d6bd5963d6479\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-26.ec2.internal" Sep 18 21:06:01.689045 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:01.688986 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-26.ec2.internal\" not found" Sep 18 21:06:01.692179 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.692142 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-26.ec2.internal" Sep 18 21:06:01.696836 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:01.696323 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-26.ec2.internal" Sep 18 21:06:01.789546 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:01.789497 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-26.ec2.internal\" not found" Sep 18 21:06:01.890041 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:01.889966 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-26.ec2.internal\" not found" Sep 18 21:06:01.990494 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:01.990470 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-26.ec2.internal\" not found" Sep 18 21:06:02.022508 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:02.022485 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 21:06:02.091226 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:02.091197 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-26.ec2.internal\" not found" Sep 18 21:06:02.101499 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:02.101479 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 18 21:06:02.101616 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:02.101599 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 21:06:02.101662 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:02.101642 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 21:06:02.161662 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:02.161598 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 21:06:02.191804 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:02.191777 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-26.ec2.internal\" not found" Sep 18 21:06:02.219957 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:02.219918 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 21:01:01 +0000 UTC" deadline="2028-06-09 02:57:20.145404444 +0000 UTC" Sep 18 21:06:02.219957 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:02.219950 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15101h51m17.925457146s" Sep 18 21:06:02.225066 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:02.225051 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 21:06:02.227847 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:02.227827 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-26.ec2.internal" event="NodeHasSufficientMemory" Sep 18 21:06:02.227950 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:02.227859 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-26.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 21:06:02.227950 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:02.227869 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-26.ec2.internal" event="NodeHasSufficientPID" Sep 18 21:06:02.287016 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:02.286805 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5deca0065e79f962c53d6bd5963d6479.slice/crio-8cc6fe5b7a3cb356e90aa0c20d6a6125be025fdcdf22db7823ea39b8594f853d WatchSource:0}: Error finding container 8cc6fe5b7a3cb356e90aa0c20d6a6125be025fdcdf22db7823ea39b8594f853d: Status 404 returned error can't find the container with id 8cc6fe5b7a3cb356e90aa0c20d6a6125be025fdcdf22db7823ea39b8594f853d Sep 18 21:06:02.287616 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:02.287591 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6087d6c1490414fda05efa5f1a508a01.slice/crio-e5f5d298c593e724fe5843ebfabcf1c59a82d01026032dd2fb9c27bbe135af3c WatchSource:0}: Error finding container e5f5d298c593e724fe5843ebfabcf1c59a82d01026032dd2fb9c27bbe135af3c: Status 404 returned error can't find the container with id e5f5d298c593e724fe5843ebfabcf1c59a82d01026032dd2fb9c27bbe135af3c Sep 18 21:06:02.292193 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:02.292174 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-26.ec2.internal\" not found" Sep 18 21:06:02.292276 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:02.292260 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 21:06:02.393033 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:02.392983 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-26.ec2.internal\" not found" Sep 18 21:06:02.493497 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:02.493432 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-26.ec2.internal\" not found" Sep 18 21:06:02.593950 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:02.593915 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-26.ec2.internal\" not found" Sep 18 21:06:02.694785 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:02.694752 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-26.ec2.internal\" not found" Sep 18 21:06:02.795340 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:02.795266 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-26.ec2.internal\" not found" Sep 18 21:06:02.895848 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:02.895813 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-26.ec2.internal\" not found" Sep 18 21:06:02.996715 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:02.996679 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-26.ec2.internal\" not found" Sep 18 21:06:03.013024 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.012994 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 21:06:03.097525 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:03.097435 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-26.ec2.internal\" not found" Sep 18 21:06:03.106865 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.106840 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 21:06:03.139729 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.139697 2581 apiserver.go:52] "Watching apiserver" Sep 18 21:06:03.152567 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.152533 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 18 21:06:03.154440 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.154407 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-4mmzf","openshift-multus/network-metrics-daemon-hxmc5","openshift-network-diagnostics/network-check-target-krpsb","openshift-network-operator/iptables-alerter-9npgd","openshift-ovn-kubernetes/ovnkube-node-5hgdh","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhchd","openshift-cluster-node-tuning-operator/tuned-rnpn2","openshift-dns/node-resolver-x968q","openshift-image-registry/node-ca-4z79x","openshift-multus/multus-65jch","kube-system/global-pull-secret-syncer-5mdk8","kube-system/konnectivity-agent-wdmzv"] Sep 18 21:06:03.156127 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.156102 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4mmzf" Sep 18 21:06:03.157573 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.157548 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxmc5" Sep 18 21:06:03.157698 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:03.157625 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hxmc5" podUID="1b7697c4-d541-409e-8863-71a4142610e7" Sep 18 21:06:03.158824 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.158799 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krpsb" Sep 18 21:06:03.158934 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:03.158875 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krpsb" podUID="65dced9b-bd34-4d5b-a945-7d1a09980e77" Sep 18 21:06:03.160153 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.160130 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9npgd" Sep 18 21:06:03.161690 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.161509 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 18 21:06:03.161690 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.161626 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.162321 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.162296 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 18 21:06:03.162430 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.162336 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 18 21:06:03.162430 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.162422 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6np4m\"" Sep 18 21:06:03.162622 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.162602 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 18 21:06:03.163259 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.163237 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-26.ec2.internal" Sep 18 21:06:03.163367 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.163242 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 18 21:06:03.163734 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.163687 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 18 21:06:03.163841 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.163775 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 18 21:06:03.163908 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.163892 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 18 21:06:03.164006 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.163695 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhchd" Sep 18 21:06:03.164110 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.164085 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-q2qz7\"" Sep 18 21:06:03.164247 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.164155 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 18 21:06:03.165607 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.165582 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.167430 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.166969 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x968q" Sep 18 21:06:03.168340 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.168319 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4z79x" Sep 18 21:06:03.170153 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.170129 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-65jch" Sep 18 21:06:03.171367 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.171334 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mdk8" Sep 18 21:06:03.171481 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:03.171414 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mdk8" podUID="1fc73b59-e444-4f69-b4cc-1950297674cc" Sep 18 21:06:03.172790 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.172771 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wdmzv" Sep 18 21:06:03.176000 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.175974 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc8g4\" (UniqueName: \"kubernetes.io/projected/43ea9d10-49c4-48c3-837a-e475e2dc87b5-kube-api-access-nc8g4\") pod \"multus-additional-cni-plugins-4mmzf\" (UID: \"43ea9d10-49c4-48c3-837a-e475e2dc87b5\") " pod="openshift-multus/multus-additional-cni-plugins-4mmzf" Sep 18 21:06:03.176112 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.176016 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rh42\" (UniqueName: \"kubernetes.io/projected/102cab22-2d19-48dc-8b25-20906d94cf62-kube-api-access-7rh42\") pod \"iptables-alerter-9npgd\" (UID: \"102cab22-2d19-48dc-8b25-20906d94cf62\") " pod="openshift-network-operator/iptables-alerter-9npgd" Sep 18 21:06:03.176112 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.176047 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-host-slash\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.176112 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.176070 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/43ea9d10-49c4-48c3-837a-e475e2dc87b5-cni-binary-copy\") pod \"multus-additional-cni-plugins-4mmzf\" (UID: \"43ea9d10-49c4-48c3-837a-e475e2dc87b5\") " pod="openshift-multus/multus-additional-cni-plugins-4mmzf" Sep 18 21:06:03.176112 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.176092 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-host-run-ovn-kubernetes\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.176332 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.176210 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-host-cni-netd\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.176332 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.176236 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-node-log\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.176332 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.176261 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-log-socket\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.176332 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.176285 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/43ea9d10-49c4-48c3-837a-e475e2dc87b5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4mmzf\" (UID: \"43ea9d10-49c4-48c3-837a-e475e2dc87b5\") " pod="openshift-multus/multus-additional-cni-plugins-4mmzf" Sep 18 21:06:03.176332 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.176309 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/43ea9d10-49c4-48c3-837a-e475e2dc87b5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4mmzf\" (UID: \"43ea9d10-49c4-48c3-837a-e475e2dc87b5\") " pod="openshift-multus/multus-additional-cni-plugins-4mmzf" Sep 18 21:06:03.176332 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.176325 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwsg5\" (UniqueName: \"kubernetes.io/projected/1b7697c4-d541-409e-8863-71a4142610e7-kube-api-access-mwsg5\") pod \"network-metrics-daemon-hxmc5\" (UID: \"1b7697c4-d541-409e-8863-71a4142610e7\") " pod="openshift-multus/network-metrics-daemon-hxmc5" Sep 18 21:06:03.176593 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.176346 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/102cab22-2d19-48dc-8b25-20906d94cf62-host-slash\") pod \"iptables-alerter-9npgd\" (UID: \"102cab22-2d19-48dc-8b25-20906d94cf62\") " pod="openshift-network-operator/iptables-alerter-9npgd" Sep 18 21:06:03.176593 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.176368 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-run-systemd\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.176593 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.176415 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-var-lib-openvswitch\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.176593 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.176431 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b9e21649-b986-4d70-aa68-0a935127bd42-env-overrides\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.176593 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.176453 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b9e21649-b986-4d70-aa68-0a935127bd42-ovn-node-metrics-cert\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.176593 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.176475 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fb17064e-3205-42e7-b27b-ca0ae7e1a699-device-dir\") pod \"aws-ebs-csi-driver-node-xhchd\" (UID: \"fb17064e-3205-42e7-b27b-ca0ae7e1a699\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhchd" Sep 18 21:06:03.176593 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.176499 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/43ea9d10-49c4-48c3-837a-e475e2dc87b5-system-cni-dir\") pod \"multus-additional-cni-plugins-4mmzf\" (UID: \"43ea9d10-49c4-48c3-837a-e475e2dc87b5\") " pod="openshift-multus/multus-additional-cni-plugins-4mmzf" Sep 18 21:06:03.176593 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.176514 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-host-run-netns\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.176593 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.176533 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-run-ovn\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.176593 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.176582 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-host-cni-bin\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.177085 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.176622 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.177085 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.176653 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fb17064e-3205-42e7-b27b-ca0ae7e1a699-registration-dir\") pod \"aws-ebs-csi-driver-node-xhchd\" (UID: \"fb17064e-3205-42e7-b27b-ca0ae7e1a699\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhchd" Sep 18 21:06:03.177085 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.176681 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/43ea9d10-49c4-48c3-837a-e475e2dc87b5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4mmzf\" (UID: \"43ea9d10-49c4-48c3-837a-e475e2dc87b5\") " pod="openshift-multus/multus-additional-cni-plugins-4mmzf" Sep 18 21:06:03.177085 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.176706 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-systemd-units\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.177085 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.176740 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6rqm\" (UniqueName: \"kubernetes.io/projected/b9e21649-b986-4d70-aa68-0a935127bd42-kube-api-access-j6rqm\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.177085 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.176771 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fb17064e-3205-42e7-b27b-ca0ae7e1a699-socket-dir\") pod \"aws-ebs-csi-driver-node-xhchd\" (UID: \"fb17064e-3205-42e7-b27b-ca0ae7e1a699\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhchd" Sep 18 21:06:03.177085 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.176801 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fb17064e-3205-42e7-b27b-ca0ae7e1a699-etc-selinux\") pod \"aws-ebs-csi-driver-node-xhchd\" (UID: \"fb17064e-3205-42e7-b27b-ca0ae7e1a699\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhchd" Sep 18 21:06:03.177085 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.176837 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fb17064e-3205-42e7-b27b-ca0ae7e1a699-sys-fs\") pod \"aws-ebs-csi-driver-node-xhchd\" (UID: \"fb17064e-3205-42e7-b27b-ca0ae7e1a699\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhchd" Sep 18 21:06:03.177085 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.176874 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-etc-openvswitch\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.177085 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.176900 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-run-openvswitch\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.177085 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.176928 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/102cab22-2d19-48dc-8b25-20906d94cf62-iptables-alerter-script\") pod \"iptables-alerter-9npgd\" (UID: \"102cab22-2d19-48dc-8b25-20906d94cf62\") " pod="openshift-network-operator/iptables-alerter-9npgd" Sep 18 21:06:03.177085 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.176954 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq7pr\" (UniqueName: \"kubernetes.io/projected/65dced9b-bd34-4d5b-a945-7d1a09980e77-kube-api-access-nq7pr\") pod \"network-check-target-krpsb\" (UID: \"65dced9b-bd34-4d5b-a945-7d1a09980e77\") " pod="openshift-network-diagnostics/network-check-target-krpsb" Sep 18 21:06:03.177085 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.176981 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/43ea9d10-49c4-48c3-837a-e475e2dc87b5-cnibin\") pod \"multus-additional-cni-plugins-4mmzf\" (UID: \"43ea9d10-49c4-48c3-837a-e475e2dc87b5\") " pod="openshift-multus/multus-additional-cni-plugins-4mmzf" Sep 18 21:06:03.177085 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.177009 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b7697c4-d541-409e-8863-71a4142610e7-metrics-certs\") pod \"network-metrics-daemon-hxmc5\" (UID: \"1b7697c4-d541-409e-8863-71a4142610e7\") " pod="openshift-multus/network-metrics-daemon-hxmc5" Sep 18 21:06:03.177085 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.177068 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-host-kubelet\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.177665 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.177095 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b9e21649-b986-4d70-aa68-0a935127bd42-ovnkube-config\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.177665 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.177137 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b9e21649-b986-4d70-aa68-0a935127bd42-ovnkube-script-lib\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.177665 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.177188 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fb17064e-3205-42e7-b27b-ca0ae7e1a699-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xhchd\" (UID: \"fb17064e-3205-42e7-b27b-ca0ae7e1a699\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhchd" Sep 18 21:06:03.177665 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.177230 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8ws2\" (UniqueName: \"kubernetes.io/projected/fb17064e-3205-42e7-b27b-ca0ae7e1a699-kube-api-access-t8ws2\") pod \"aws-ebs-csi-driver-node-xhchd\" (UID: \"fb17064e-3205-42e7-b27b-ca0ae7e1a699\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhchd" Sep 18 21:06:03.177865 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.177757 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 18 21:06:03.177865 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.177823 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 18 21:06:03.177966 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.177873 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 18 21:06:03.177966 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.177828 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-j95k4\"" Sep 18 21:06:03.178263 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.178242 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 18 21:06:03.178352 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.178262 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 18 21:06:03.178415 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.178401 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 18 21:06:03.178813 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.178794 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 18 21:06:03.178813 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.178811 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 18 21:06:03.179029 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.179012 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 18 21:06:03.179287 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.179272 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 18 21:06:03.179456 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.179437 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 18 21:06:03.179546 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.179278 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 18 21:06:03.179606 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.179370 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 18 21:06:03.179763 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.179739 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 18 21:06:03.179839 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.179817 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 18 21:06:03.180115 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.180099 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 18 21:06:03.180231 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.180156 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 18 21:06:03.180764 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.180742 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-49jnd\"" Sep 18 21:06:03.180904 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.180885 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xcwwc\"" Sep 18 21:06:03.181003 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.180982 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 18 21:06:03.181374 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.181359 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zw2hx\"" Sep 18 21:06:03.181728 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.181693 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 18 21:06:03.181851 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.181829 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fmzx5\"" Sep 18 21:06:03.182538 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.182520 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-trvjb\"" Sep 18 21:06:03.184644 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.182839 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mkgxx\"" Sep 18 21:06:03.203073 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.203049 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 21:06:03.205978 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.205957 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-26.ec2.internal"] Sep 18 21:06:03.206748 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.206718 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 21:06:03.206849 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.206834 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-26.ec2.internal" Sep 18 21:06:03.221420 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.221396 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-26.ec2.internal"] Sep 18 21:06:03.222370 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.222347 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 21:06:03.229219 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.229199 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4l8r7" Sep 18 21:06:03.241367 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.240961 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4l8r7" Sep 18 21:06:03.264308 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.264272 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 18 21:06:03.269262 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.269214 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-26.ec2.internal" event={"ID":"5deca0065e79f962c53d6bd5963d6479","Type":"ContainerStarted","Data":"8cc6fe5b7a3cb356e90aa0c20d6a6125be025fdcdf22db7823ea39b8594f853d"} Sep 18 21:06:03.270854 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.270824 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-26.ec2.internal" event={"ID":"6087d6c1490414fda05efa5f1a508a01","Type":"ContainerStarted","Data":"e5f5d298c593e724fe5843ebfabcf1c59a82d01026032dd2fb9c27bbe135af3c"} Sep 18 21:06:03.278246 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278216 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.278400 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278256 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fb17064e-3205-42e7-b27b-ca0ae7e1a699-registration-dir\") pod \"aws-ebs-csi-driver-node-xhchd\" (UID: \"fb17064e-3205-42e7-b27b-ca0ae7e1a699\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhchd" Sep 18 21:06:03.278400 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278280 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f656f6e8-a587-471a-87c6-43939a689aca-serviceca\") pod \"node-ca-4z79x\" (UID: \"f656f6e8-a587-471a-87c6-43939a689aca\") " pod="openshift-image-registry/node-ca-4z79x" Sep 18 21:06:03.278400 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278297 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5cfef91b-197c-451c-bb28-5c8b7dd3c991-cni-binary-copy\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.278400 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278312 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-etc-kubernetes\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.278400 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278328 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/43ea9d10-49c4-48c3-837a-e475e2dc87b5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4mmzf\" (UID: \"43ea9d10-49c4-48c3-837a-e475e2dc87b5\") " pod="openshift-multus/multus-additional-cni-plugins-4mmzf" Sep 18 21:06:03.278400 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278344 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6rqm\" (UniqueName: \"kubernetes.io/projected/b9e21649-b986-4d70-aa68-0a935127bd42-kube-api-access-j6rqm\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.278400 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278369 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fb17064e-3205-42e7-b27b-ca0ae7e1a699-socket-dir\") pod \"aws-ebs-csi-driver-node-xhchd\" (UID: \"fb17064e-3205-42e7-b27b-ca0ae7e1a699\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhchd" Sep 18 21:06:03.278400 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278387 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fb17064e-3205-42e7-b27b-ca0ae7e1a699-etc-selinux\") pod \"aws-ebs-csi-driver-node-xhchd\" (UID: \"fb17064e-3205-42e7-b27b-ca0ae7e1a699\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhchd" Sep 18 21:06:03.278400 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278402 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-host-run-multus-certs\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.278771 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278421 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/35647875-14b5-4611-b210-ff84c9eaa6f4-etc-sysctl-d\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.278771 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278436 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1cc5c883-f3d7-4313-8174-fed3d65dcf2d-hosts-file\") pod \"node-resolver-x968q\" (UID: \"1cc5c883-f3d7-4313-8174-fed3d65dcf2d\") " pod="openshift-dns/node-resolver-x968q" Sep 18 21:06:03.278771 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278453 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1fc73b59-e444-4f69-b4cc-1950297674cc-kubelet-config\") pod \"global-pull-secret-syncer-5mdk8\" (UID: \"1fc73b59-e444-4f69-b4cc-1950297674cc\") " pod="kube-system/global-pull-secret-syncer-5mdk8" Sep 18 21:06:03.278771 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278468 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-etc-openvswitch\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.278771 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278483 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-run-openvswitch\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.278771 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278502 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/102cab22-2d19-48dc-8b25-20906d94cf62-iptables-alerter-script\") pod \"iptables-alerter-9npgd\" (UID: \"102cab22-2d19-48dc-8b25-20906d94cf62\") " pod="openshift-network-operator/iptables-alerter-9npgd" Sep 18 21:06:03.278771 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278518 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq7pr\" (UniqueName: \"kubernetes.io/projected/65dced9b-bd34-4d5b-a945-7d1a09980e77-kube-api-access-nq7pr\") pod \"network-check-target-krpsb\" (UID: \"65dced9b-bd34-4d5b-a945-7d1a09980e77\") " pod="openshift-network-diagnostics/network-check-target-krpsb" Sep 18 21:06:03.278771 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278535 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/43ea9d10-49c4-48c3-837a-e475e2dc87b5-cnibin\") pod \"multus-additional-cni-plugins-4mmzf\" (UID: \"43ea9d10-49c4-48c3-837a-e475e2dc87b5\") " pod="openshift-multus/multus-additional-cni-plugins-4mmzf" Sep 18 21:06:03.278771 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278549 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fb17064e-3205-42e7-b27b-ca0ae7e1a699-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xhchd\" (UID: \"fb17064e-3205-42e7-b27b-ca0ae7e1a699\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhchd" Sep 18 21:06:03.278771 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278564 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8ws2\" (UniqueName: \"kubernetes.io/projected/fb17064e-3205-42e7-b27b-ca0ae7e1a699-kube-api-access-t8ws2\") pod \"aws-ebs-csi-driver-node-xhchd\" (UID: \"fb17064e-3205-42e7-b27b-ca0ae7e1a699\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhchd" Sep 18 21:06:03.278771 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278580 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-host-run-k8s-cni-cncf-io\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.278771 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278594 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2846cc57-5ea3-48e0-a5ea-67f3407e5da0-konnectivity-ca\") pod \"konnectivity-agent-wdmzv\" (UID: \"2846cc57-5ea3-48e0-a5ea-67f3407e5da0\") " pod="kube-system/konnectivity-agent-wdmzv" Sep 18 21:06:03.278771 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278608 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/35647875-14b5-4611-b210-ff84c9eaa6f4-host\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.278771 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278623 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/35647875-14b5-4611-b210-ff84c9eaa6f4-tmp\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.278771 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278644 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc8g4\" (UniqueName: \"kubernetes.io/projected/43ea9d10-49c4-48c3-837a-e475e2dc87b5-kube-api-access-nc8g4\") pod \"multus-additional-cni-plugins-4mmzf\" (UID: \"43ea9d10-49c4-48c3-837a-e475e2dc87b5\") " pod="openshift-multus/multus-additional-cni-plugins-4mmzf" Sep 18 21:06:03.278771 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278659 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rh42\" (UniqueName: \"kubernetes.io/projected/102cab22-2d19-48dc-8b25-20906d94cf62-kube-api-access-7rh42\") pod \"iptables-alerter-9npgd\" (UID: \"102cab22-2d19-48dc-8b25-20906d94cf62\") " pod="openshift-network-operator/iptables-alerter-9npgd" Sep 18 21:06:03.278771 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278684 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-host-cni-netd\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.279517 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278710 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-host-var-lib-kubelet\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.279517 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278725 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/35647875-14b5-4611-b210-ff84c9eaa6f4-sys\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.279517 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278741 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-node-log\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.279517 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278756 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-log-socket\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.279517 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278774 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/43ea9d10-49c4-48c3-837a-e475e2dc87b5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4mmzf\" (UID: \"43ea9d10-49c4-48c3-837a-e475e2dc87b5\") " pod="openshift-multus/multus-additional-cni-plugins-4mmzf" Sep 18 21:06:03.279517 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278791 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/43ea9d10-49c4-48c3-837a-e475e2dc87b5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4mmzf\" (UID: \"43ea9d10-49c4-48c3-837a-e475e2dc87b5\") " pod="openshift-multus/multus-additional-cni-plugins-4mmzf" Sep 18 21:06:03.279517 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278814 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b9e21649-b986-4d70-aa68-0a935127bd42-ovn-node-metrics-cert\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.279517 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278847 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-system-cni-dir\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.279517 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278866 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/35647875-14b5-4611-b210-ff84c9eaa6f4-etc-modprobe-d\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.279517 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278882 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b9e21649-b986-4d70-aa68-0a935127bd42-env-overrides\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.279517 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278903 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f656f6e8-a587-471a-87c6-43939a689aca-host\") pod \"node-ca-4z79x\" (UID: \"f656f6e8-a587-471a-87c6-43939a689aca\") " pod="openshift-image-registry/node-ca-4z79x" Sep 18 21:06:03.279517 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278921 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-hostroot\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.279517 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278935 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cc5c883-f3d7-4313-8174-fed3d65dcf2d-tmp-dir\") pod \"node-resolver-x968q\" (UID: \"1cc5c883-f3d7-4313-8174-fed3d65dcf2d\") " pod="openshift-dns/node-resolver-x968q" Sep 18 21:06:03.279517 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278950 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/43ea9d10-49c4-48c3-837a-e475e2dc87b5-system-cni-dir\") pod \"multus-additional-cni-plugins-4mmzf\" (UID: \"43ea9d10-49c4-48c3-837a-e475e2dc87b5\") " pod="openshift-multus/multus-additional-cni-plugins-4mmzf" Sep 18 21:06:03.279517 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278966 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-run-ovn\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.279517 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278984 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-host-cni-bin\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.279517 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.278999 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5cfef91b-197c-451c-bb28-5c8b7dd3c991-multus-daemon-config\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.280227 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279015 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fc73b59-e444-4f69-b4cc-1950297674cc-original-pull-secret\") pod \"global-pull-secret-syncer-5mdk8\" (UID: \"1fc73b59-e444-4f69-b4cc-1950297674cc\") " pod="kube-system/global-pull-secret-syncer-5mdk8" Sep 18 21:06:03.280227 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279030 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-systemd-units\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.280227 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279053 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fb17064e-3205-42e7-b27b-ca0ae7e1a699-sys-fs\") pod \"aws-ebs-csi-driver-node-xhchd\" (UID: \"fb17064e-3205-42e7-b27b-ca0ae7e1a699\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhchd" Sep 18 21:06:03.280227 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279068 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-multus-cni-dir\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.280227 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279084 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-host-var-lib-cni-multus\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.280227 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279100 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2846cc57-5ea3-48e0-a5ea-67f3407e5da0-agent-certs\") pod \"konnectivity-agent-wdmzv\" (UID: \"2846cc57-5ea3-48e0-a5ea-67f3407e5da0\") " pod="kube-system/konnectivity-agent-wdmzv" Sep 18 21:06:03.280227 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279118 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/35647875-14b5-4611-b210-ff84c9eaa6f4-etc-sysctl-conf\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.280227 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279132 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/35647875-14b5-4611-b210-ff84c9eaa6f4-lib-modules\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.280227 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279151 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/35647875-14b5-4611-b210-ff84c9eaa6f4-etc-tuned\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.280227 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279166 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24tcq\" (UniqueName: \"kubernetes.io/projected/35647875-14b5-4611-b210-ff84c9eaa6f4-kube-api-access-24tcq\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.280227 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279188 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b7697c4-d541-409e-8863-71a4142610e7-metrics-certs\") pod \"network-metrics-daemon-hxmc5\" (UID: \"1b7697c4-d541-409e-8863-71a4142610e7\") " pod="openshift-multus/network-metrics-daemon-hxmc5" Sep 18 21:06:03.280227 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279210 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-host-kubelet\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.280227 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279249 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b9e21649-b986-4d70-aa68-0a935127bd42-ovnkube-config\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.280227 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279281 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b9e21649-b986-4d70-aa68-0a935127bd42-ovnkube-script-lib\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.280227 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279309 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35647875-14b5-4611-b210-ff84c9eaa6f4-etc-kubernetes\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.280227 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279334 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/35647875-14b5-4611-b210-ff84c9eaa6f4-run\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.280227 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279360 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-host-slash\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.281004 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279386 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-cnibin\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.281004 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279410 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1fc73b59-e444-4f69-b4cc-1950297674cc-dbus\") pod \"global-pull-secret-syncer-5mdk8\" (UID: \"1fc73b59-e444-4f69-b4cc-1950297674cc\") " pod="kube-system/global-pull-secret-syncer-5mdk8" Sep 18 21:06:03.281004 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279441 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/43ea9d10-49c4-48c3-837a-e475e2dc87b5-cni-binary-copy\") pod \"multus-additional-cni-plugins-4mmzf\" (UID: \"43ea9d10-49c4-48c3-837a-e475e2dc87b5\") " pod="openshift-multus/multus-additional-cni-plugins-4mmzf" Sep 18 21:06:03.281004 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279469 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-host-run-ovn-kubernetes\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.281004 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279497 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-multus-conf-dir\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.281004 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279525 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35647875-14b5-4611-b210-ff84c9eaa6f4-var-lib-kubelet\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.281004 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279562 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwsg5\" (UniqueName: \"kubernetes.io/projected/1b7697c4-d541-409e-8863-71a4142610e7-kube-api-access-mwsg5\") pod \"network-metrics-daemon-hxmc5\" (UID: \"1b7697c4-d541-409e-8863-71a4142610e7\") " pod="openshift-multus/network-metrics-daemon-hxmc5" Sep 18 21:06:03.281004 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279595 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/102cab22-2d19-48dc-8b25-20906d94cf62-host-slash\") pod \"iptables-alerter-9npgd\" (UID: \"102cab22-2d19-48dc-8b25-20906d94cf62\") " pod="openshift-network-operator/iptables-alerter-9npgd" Sep 18 21:06:03.281004 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279622 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-run-systemd\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.281004 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279649 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fb17064e-3205-42e7-b27b-ca0ae7e1a699-device-dir\") pod \"aws-ebs-csi-driver-node-xhchd\" (UID: \"fb17064e-3205-42e7-b27b-ca0ae7e1a699\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhchd" Sep 18 21:06:03.281004 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279677 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnbrz\" (UniqueName: \"kubernetes.io/projected/f656f6e8-a587-471a-87c6-43939a689aca-kube-api-access-hnbrz\") pod \"node-ca-4z79x\" (UID: \"f656f6e8-a587-471a-87c6-43939a689aca\") " pod="openshift-image-registry/node-ca-4z79x" Sep 18 21:06:03.281004 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279705 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-host-run-netns\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.281004 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279725 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxx4h\" (UniqueName: \"kubernetes.io/projected/1cc5c883-f3d7-4313-8174-fed3d65dcf2d-kube-api-access-qxx4h\") pod \"node-resolver-x968q\" (UID: \"1cc5c883-f3d7-4313-8174-fed3d65dcf2d\") " pod="openshift-dns/node-resolver-x968q" Sep 18 21:06:03.281004 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279744 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-var-lib-openvswitch\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.281004 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279760 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-host-var-lib-cni-bin\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.281004 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279775 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mts8v\" (UniqueName: \"kubernetes.io/projected/5cfef91b-197c-451c-bb28-5c8b7dd3c991-kube-api-access-mts8v\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.281004 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279790 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/35647875-14b5-4611-b210-ff84c9eaa6f4-etc-sysconfig\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.281675 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279817 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/35647875-14b5-4611-b210-ff84c9eaa6f4-etc-systemd\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.281675 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279833 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-multus-socket-dir-parent\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.281675 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279852 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-host-run-netns\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.281675 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279916 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-host-run-netns\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.281675 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.279971 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.281675 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.280027 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fb17064e-3205-42e7-b27b-ca0ae7e1a699-registration-dir\") pod \"aws-ebs-csi-driver-node-xhchd\" (UID: \"fb17064e-3205-42e7-b27b-ca0ae7e1a699\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhchd" Sep 18 21:06:03.281675 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.280246 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/43ea9d10-49c4-48c3-837a-e475e2dc87b5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4mmzf\" (UID: \"43ea9d10-49c4-48c3-837a-e475e2dc87b5\") " pod="openshift-multus/multus-additional-cni-plugins-4mmzf" Sep 18 21:06:03.281675 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.280656 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fb17064e-3205-42e7-b27b-ca0ae7e1a699-socket-dir\") pod \"aws-ebs-csi-driver-node-xhchd\" (UID: \"fb17064e-3205-42e7-b27b-ca0ae7e1a699\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhchd" Sep 18 21:06:03.281675 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.280774 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fb17064e-3205-42e7-b27b-ca0ae7e1a699-etc-selinux\") pod \"aws-ebs-csi-driver-node-xhchd\" (UID: \"fb17064e-3205-42e7-b27b-ca0ae7e1a699\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhchd" Sep 18 21:06:03.281675 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.280851 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-etc-openvswitch\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.281675 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.280897 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-run-openvswitch\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.281675 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.281464 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/102cab22-2d19-48dc-8b25-20906d94cf62-iptables-alerter-script\") pod \"iptables-alerter-9npgd\" (UID: \"102cab22-2d19-48dc-8b25-20906d94cf62\") " pod="openshift-network-operator/iptables-alerter-9npgd" Sep 18 21:06:03.282148 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.281715 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/43ea9d10-49c4-48c3-837a-e475e2dc87b5-cnibin\") pod \"multus-additional-cni-plugins-4mmzf\" (UID: \"43ea9d10-49c4-48c3-837a-e475e2dc87b5\") " pod="openshift-multus/multus-additional-cni-plugins-4mmzf" Sep 18 21:06:03.282148 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.281765 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fb17064e-3205-42e7-b27b-ca0ae7e1a699-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xhchd\" (UID: \"fb17064e-3205-42e7-b27b-ca0ae7e1a699\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhchd" Sep 18 21:06:03.284055 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.282289 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-host-cni-netd\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.284055 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.282332 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/43ea9d10-49c4-48c3-837a-e475e2dc87b5-system-cni-dir\") pod \"multus-additional-cni-plugins-4mmzf\" (UID: \"43ea9d10-49c4-48c3-837a-e475e2dc87b5\") " pod="openshift-multus/multus-additional-cni-plugins-4mmzf" Sep 18 21:06:03.284261 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.282354 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-host-cni-bin\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.284261 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.282389 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-run-ovn\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.284261 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.282446 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-node-log\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.284261 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.282445 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-systemd-units\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.284261 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.282477 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-host-kubelet\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.284261 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.282511 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fb17064e-3205-42e7-b27b-ca0ae7e1a699-sys-fs\") pod \"aws-ebs-csi-driver-node-xhchd\" (UID: \"fb17064e-3205-42e7-b27b-ca0ae7e1a699\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhchd" Sep 18 21:06:03.284261 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.282544 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-log-socket\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.284261 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.282703 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-host-slash\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.284261 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.283055 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/43ea9d10-49c4-48c3-837a-e475e2dc87b5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4mmzf\" (UID: \"43ea9d10-49c4-48c3-837a-e475e2dc87b5\") " pod="openshift-multus/multus-additional-cni-plugins-4mmzf" Sep 18 21:06:03.284261 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.283102 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fb17064e-3205-42e7-b27b-ca0ae7e1a699-device-dir\") pod \"aws-ebs-csi-driver-node-xhchd\" (UID: \"fb17064e-3205-42e7-b27b-ca0ae7e1a699\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhchd" Sep 18 21:06:03.284261 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.283151 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-host-run-ovn-kubernetes\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.284261 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.283176 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/43ea9d10-49c4-48c3-837a-e475e2dc87b5-cni-binary-copy\") pod \"multus-additional-cni-plugins-4mmzf\" (UID: \"43ea9d10-49c4-48c3-837a-e475e2dc87b5\") " pod="openshift-multus/multus-additional-cni-plugins-4mmzf" Sep 18 21:06:03.284261 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:03.283259 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:06:03.284824 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:03.284288 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b7697c4-d541-409e-8863-71a4142610e7-metrics-certs podName:1b7697c4-d541-409e-8863-71a4142610e7 nodeName:}" failed. No retries permitted until 2026-09-18 21:06:03.784263083 +0000 UTC m=+3.004375451 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b7697c4-d541-409e-8863-71a4142610e7-metrics-certs") pod "network-metrics-daemon-hxmc5" (UID: "1b7697c4-d541-409e-8863-71a4142610e7") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:06:03.284824 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.283489 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-run-systemd\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.284824 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.283521 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b9e21649-b986-4d70-aa68-0a935127bd42-var-lib-openvswitch\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.284824 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.283459 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/102cab22-2d19-48dc-8b25-20906d94cf62-host-slash\") pod \"iptables-alerter-9npgd\" (UID: \"102cab22-2d19-48dc-8b25-20906d94cf62\") " pod="openshift-network-operator/iptables-alerter-9npgd" Sep 18 21:06:03.284824 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.283854 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b9e21649-b986-4d70-aa68-0a935127bd42-env-overrides\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.284824 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.283962 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 18 21:06:03.284824 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.283791 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b9e21649-b986-4d70-aa68-0a935127bd42-ovnkube-config\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.284824 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.284402 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b9e21649-b986-4d70-aa68-0a935127bd42-ovnkube-script-lib\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.284824 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.284705 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/43ea9d10-49c4-48c3-837a-e475e2dc87b5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4mmzf\" (UID: \"43ea9d10-49c4-48c3-837a-e475e2dc87b5\") " pod="openshift-multus/multus-additional-cni-plugins-4mmzf" Sep 18 21:06:03.289446 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.289405 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b9e21649-b986-4d70-aa68-0a935127bd42-ovn-node-metrics-cert\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.300437 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:03.299960 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 21:06:03.300437 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:03.299990 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 21:06:03.300437 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:03.300019 2581 projected.go:196] Error preparing data for projected volume kube-api-access-nq7pr for pod openshift-network-diagnostics/network-check-target-krpsb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:06:03.300437 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:03.300172 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65dced9b-bd34-4d5b-a945-7d1a09980e77-kube-api-access-nq7pr podName:65dced9b-bd34-4d5b-a945-7d1a09980e77 nodeName:}" failed. No retries permitted until 2026-09-18 21:06:03.800150837 +0000 UTC m=+3.020263224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nq7pr" (UniqueName: "kubernetes.io/projected/65dced9b-bd34-4d5b-a945-7d1a09980e77-kube-api-access-nq7pr") pod "network-check-target-krpsb" (UID: "65dced9b-bd34-4d5b-a945-7d1a09980e77") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:06:03.302776 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.302748 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rh42\" (UniqueName: \"kubernetes.io/projected/102cab22-2d19-48dc-8b25-20906d94cf62-kube-api-access-7rh42\") pod \"iptables-alerter-9npgd\" (UID: \"102cab22-2d19-48dc-8b25-20906d94cf62\") " pod="openshift-network-operator/iptables-alerter-9npgd" Sep 18 21:06:03.306785 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.306755 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc8g4\" (UniqueName: \"kubernetes.io/projected/43ea9d10-49c4-48c3-837a-e475e2dc87b5-kube-api-access-nc8g4\") pod \"multus-additional-cni-plugins-4mmzf\" (UID: \"43ea9d10-49c4-48c3-837a-e475e2dc87b5\") " pod="openshift-multus/multus-additional-cni-plugins-4mmzf" Sep 18 21:06:03.306972 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.306932 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6rqm\" (UniqueName: \"kubernetes.io/projected/b9e21649-b986-4d70-aa68-0a935127bd42-kube-api-access-j6rqm\") pod \"ovnkube-node-5hgdh\" (UID: \"b9e21649-b986-4d70-aa68-0a935127bd42\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.307043 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.307023 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwsg5\" (UniqueName: \"kubernetes.io/projected/1b7697c4-d541-409e-8863-71a4142610e7-kube-api-access-mwsg5\") pod \"network-metrics-daemon-hxmc5\" (UID: \"1b7697c4-d541-409e-8863-71a4142610e7\") " pod="openshift-multus/network-metrics-daemon-hxmc5" Sep 18 21:06:03.310479 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.310451 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8ws2\" (UniqueName: \"kubernetes.io/projected/fb17064e-3205-42e7-b27b-ca0ae7e1a699-kube-api-access-t8ws2\") pod \"aws-ebs-csi-driver-node-xhchd\" (UID: \"fb17064e-3205-42e7-b27b-ca0ae7e1a699\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhchd" Sep 18 21:06:03.380388 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.380294 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/35647875-14b5-4611-b210-ff84c9eaa6f4-sys\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.380388 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.380347 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-system-cni-dir\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.380388 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.380372 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/35647875-14b5-4611-b210-ff84c9eaa6f4-etc-modprobe-d\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.380641 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.380393 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f656f6e8-a587-471a-87c6-43939a689aca-host\") pod \"node-ca-4z79x\" (UID: \"f656f6e8-a587-471a-87c6-43939a689aca\") " pod="openshift-image-registry/node-ca-4z79x" Sep 18 21:06:03.380641 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.380417 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-hostroot\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.380641 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.380442 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cc5c883-f3d7-4313-8174-fed3d65dcf2d-tmp-dir\") pod \"node-resolver-x968q\" (UID: \"1cc5c883-f3d7-4313-8174-fed3d65dcf2d\") " pod="openshift-dns/node-resolver-x968q" Sep 18 21:06:03.380641 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.380458 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/35647875-14b5-4611-b210-ff84c9eaa6f4-sys\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.380641 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.380606 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-system-cni-dir\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.380849 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.380684 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/35647875-14b5-4611-b210-ff84c9eaa6f4-etc-modprobe-d\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.380849 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.380721 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f656f6e8-a587-471a-87c6-43939a689aca-host\") pod \"node-ca-4z79x\" (UID: \"f656f6e8-a587-471a-87c6-43939a689aca\") " pod="openshift-image-registry/node-ca-4z79x" Sep 18 21:06:03.380849 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.380759 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-hostroot\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.381001 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.380471 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5cfef91b-197c-451c-bb28-5c8b7dd3c991-multus-daemon-config\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.381058 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.380993 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fc73b59-e444-4f69-b4cc-1950297674cc-original-pull-secret\") pod \"global-pull-secret-syncer-5mdk8\" (UID: \"1fc73b59-e444-4f69-b4cc-1950297674cc\") " pod="kube-system/global-pull-secret-syncer-5mdk8" Sep 18 21:06:03.381058 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381030 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-multus-cni-dir\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.381058 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381043 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cc5c883-f3d7-4313-8174-fed3d65dcf2d-tmp-dir\") pod \"node-resolver-x968q\" (UID: \"1cc5c883-f3d7-4313-8174-fed3d65dcf2d\") " pod="openshift-dns/node-resolver-x968q" Sep 18 21:06:03.381058 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381051 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-host-var-lib-cni-multus\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.381287 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381080 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2846cc57-5ea3-48e0-a5ea-67f3407e5da0-agent-certs\") pod \"konnectivity-agent-wdmzv\" (UID: \"2846cc57-5ea3-48e0-a5ea-67f3407e5da0\") " pod="kube-system/konnectivity-agent-wdmzv" Sep 18 21:06:03.381287 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381082 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5cfef91b-197c-451c-bb28-5c8b7dd3c991-multus-daemon-config\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.381287 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381104 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/35647875-14b5-4611-b210-ff84c9eaa6f4-etc-sysctl-conf\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.381287 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381141 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/35647875-14b5-4611-b210-ff84c9eaa6f4-lib-modules\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.381287 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381170 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/35647875-14b5-4611-b210-ff84c9eaa6f4-etc-tuned\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.381287 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381196 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24tcq\" (UniqueName: \"kubernetes.io/projected/35647875-14b5-4611-b210-ff84c9eaa6f4-kube-api-access-24tcq\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.381287 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381220 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/35647875-14b5-4611-b210-ff84c9eaa6f4-etc-sysctl-conf\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.381287 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381269 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35647875-14b5-4611-b210-ff84c9eaa6f4-etc-kubernetes\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.381287 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381279 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-host-var-lib-cni-multus\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.381734 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381271 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-multus-cni-dir\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.381734 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381349 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/35647875-14b5-4611-b210-ff84c9eaa6f4-run\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.381734 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381392 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/35647875-14b5-4611-b210-ff84c9eaa6f4-lib-modules\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.381734 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381296 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/35647875-14b5-4611-b210-ff84c9eaa6f4-run\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.381734 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:03.381412 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 21:06:03.381734 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381422 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-cnibin\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.381734 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381437 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1fc73b59-e444-4f69-b4cc-1950297674cc-dbus\") pod \"global-pull-secret-syncer-5mdk8\" (UID: \"1fc73b59-e444-4f69-b4cc-1950297674cc\") " pod="kube-system/global-pull-secret-syncer-5mdk8" Sep 18 21:06:03.381734 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381456 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-multus-conf-dir\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.381734 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:03.381474 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fc73b59-e444-4f69-b4cc-1950297674cc-original-pull-secret podName:1fc73b59-e444-4f69-b4cc-1950297674cc nodeName:}" failed. No retries permitted until 2026-09-18 21:06:03.881452706 +0000 UTC m=+3.101565088 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1fc73b59-e444-4f69-b4cc-1950297674cc-original-pull-secret") pod "global-pull-secret-syncer-5mdk8" (UID: "1fc73b59-e444-4f69-b4cc-1950297674cc") : object "kube-system"/"original-pull-secret" not registered Sep 18 21:06:03.381734 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381491 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-multus-conf-dir\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.381734 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381506 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35647875-14b5-4611-b210-ff84c9eaa6f4-var-lib-kubelet\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.381734 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381523 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-cnibin\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.381734 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381541 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnbrz\" (UniqueName: \"kubernetes.io/projected/f656f6e8-a587-471a-87c6-43939a689aca-kube-api-access-hnbrz\") pod \"node-ca-4z79x\" (UID: \"f656f6e8-a587-471a-87c6-43939a689aca\") " pod="openshift-image-registry/node-ca-4z79x" Sep 18 21:06:03.381734 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381571 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-host-run-netns\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.381734 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381582 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1fc73b59-e444-4f69-b4cc-1950297674cc-dbus\") pod \"global-pull-secret-syncer-5mdk8\" (UID: \"1fc73b59-e444-4f69-b4cc-1950297674cc\") " pod="kube-system/global-pull-secret-syncer-5mdk8" Sep 18 21:06:03.381734 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381597 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxx4h\" (UniqueName: \"kubernetes.io/projected/1cc5c883-f3d7-4313-8174-fed3d65dcf2d-kube-api-access-qxx4h\") pod \"node-resolver-x968q\" (UID: \"1cc5c883-f3d7-4313-8174-fed3d65dcf2d\") " pod="openshift-dns/node-resolver-x968q" Sep 18 21:06:03.381734 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381626 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-host-var-lib-cni-bin\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.381734 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381651 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mts8v\" (UniqueName: \"kubernetes.io/projected/5cfef91b-197c-451c-bb28-5c8b7dd3c991-kube-api-access-mts8v\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.382711 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381677 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/35647875-14b5-4611-b210-ff84c9eaa6f4-etc-sysconfig\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.382711 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381703 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/35647875-14b5-4611-b210-ff84c9eaa6f4-etc-systemd\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.382711 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381728 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-multus-socket-dir-parent\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.382711 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381731 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-host-run-netns\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.382711 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381757 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f656f6e8-a587-471a-87c6-43939a689aca-serviceca\") pod \"node-ca-4z79x\" (UID: \"f656f6e8-a587-471a-87c6-43939a689aca\") " pod="openshift-image-registry/node-ca-4z79x" Sep 18 21:06:03.382711 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381786 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5cfef91b-197c-451c-bb28-5c8b7dd3c991-cni-binary-copy\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.382711 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381808 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/35647875-14b5-4611-b210-ff84c9eaa6f4-etc-sysconfig\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.382711 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381840 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35647875-14b5-4611-b210-ff84c9eaa6f4-etc-kubernetes\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.382711 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381852 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35647875-14b5-4611-b210-ff84c9eaa6f4-var-lib-kubelet\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.382711 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381884 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-etc-kubernetes\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.382711 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381919 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-host-run-multus-certs\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.382711 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381923 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-host-var-lib-cni-bin\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.382711 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381944 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/35647875-14b5-4611-b210-ff84c9eaa6f4-etc-sysctl-d\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.382711 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.381993 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/35647875-14b5-4611-b210-ff84c9eaa6f4-etc-systemd\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.382711 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.382018 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1cc5c883-f3d7-4313-8174-fed3d65dcf2d-hosts-file\") pod \"node-resolver-x968q\" (UID: \"1cc5c883-f3d7-4313-8174-fed3d65dcf2d\") " pod="openshift-dns/node-resolver-x968q" Sep 18 21:06:03.382711 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.382114 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-multus-socket-dir-parent\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.382711 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.382132 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1fc73b59-e444-4f69-b4cc-1950297674cc-kubelet-config\") pod \"global-pull-secret-syncer-5mdk8\" (UID: \"1fc73b59-e444-4f69-b4cc-1950297674cc\") " pod="kube-system/global-pull-secret-syncer-5mdk8" Sep 18 21:06:03.382711 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.382196 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-host-run-multus-certs\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.383558 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.382268 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-etc-kubernetes\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.383558 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.382271 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5cfef91b-197c-451c-bb28-5c8b7dd3c991-cni-binary-copy\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.383558 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.382320 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1cc5c883-f3d7-4313-8174-fed3d65dcf2d-hosts-file\") pod \"node-resolver-x968q\" (UID: \"1cc5c883-f3d7-4313-8174-fed3d65dcf2d\") " pod="openshift-dns/node-resolver-x968q" Sep 18 21:06:03.383558 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.382374 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1fc73b59-e444-4f69-b4cc-1950297674cc-kubelet-config\") pod \"global-pull-secret-syncer-5mdk8\" (UID: \"1fc73b59-e444-4f69-b4cc-1950297674cc\") " pod="kube-system/global-pull-secret-syncer-5mdk8" Sep 18 21:06:03.383558 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.382416 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-host-run-k8s-cni-cncf-io\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.383558 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.382448 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2846cc57-5ea3-48e0-a5ea-67f3407e5da0-konnectivity-ca\") pod \"konnectivity-agent-wdmzv\" (UID: \"2846cc57-5ea3-48e0-a5ea-67f3407e5da0\") " pod="kube-system/konnectivity-agent-wdmzv" Sep 18 21:06:03.383558 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.382472 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/35647875-14b5-4611-b210-ff84c9eaa6f4-host\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.383558 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.382483 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/35647875-14b5-4611-b210-ff84c9eaa6f4-etc-sysctl-d\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.383558 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.382500 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/35647875-14b5-4611-b210-ff84c9eaa6f4-tmp\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.383558 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.382531 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-host-var-lib-kubelet\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.383558 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.382555 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/35647875-14b5-4611-b210-ff84c9eaa6f4-host\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.383558 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.382604 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-host-run-k8s-cni-cncf-io\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.383558 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.382604 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5cfef91b-197c-451c-bb28-5c8b7dd3c991-host-var-lib-kubelet\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.383558 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.382778 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f656f6e8-a587-471a-87c6-43939a689aca-serviceca\") pod \"node-ca-4z79x\" (UID: \"f656f6e8-a587-471a-87c6-43939a689aca\") " pod="openshift-image-registry/node-ca-4z79x" Sep 18 21:06:03.383558 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.383025 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2846cc57-5ea3-48e0-a5ea-67f3407e5da0-konnectivity-ca\") pod \"konnectivity-agent-wdmzv\" (UID: \"2846cc57-5ea3-48e0-a5ea-67f3407e5da0\") " pod="kube-system/konnectivity-agent-wdmzv" Sep 18 21:06:03.384491 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.384466 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/35647875-14b5-4611-b210-ff84c9eaa6f4-etc-tuned\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.384701 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.384684 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2846cc57-5ea3-48e0-a5ea-67f3407e5da0-agent-certs\") pod \"konnectivity-agent-wdmzv\" (UID: \"2846cc57-5ea3-48e0-a5ea-67f3407e5da0\") " pod="kube-system/konnectivity-agent-wdmzv" Sep 18 21:06:03.386213 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.386194 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/35647875-14b5-4611-b210-ff84c9eaa6f4-tmp\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.401690 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.401660 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxx4h\" (UniqueName: \"kubernetes.io/projected/1cc5c883-f3d7-4313-8174-fed3d65dcf2d-kube-api-access-qxx4h\") pod \"node-resolver-x968q\" (UID: \"1cc5c883-f3d7-4313-8174-fed3d65dcf2d\") " pod="openshift-dns/node-resolver-x968q" Sep 18 21:06:03.405851 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.405826 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnbrz\" (UniqueName: \"kubernetes.io/projected/f656f6e8-a587-471a-87c6-43939a689aca-kube-api-access-hnbrz\") pod \"node-ca-4z79x\" (UID: \"f656f6e8-a587-471a-87c6-43939a689aca\") " pod="openshift-image-registry/node-ca-4z79x" Sep 18 21:06:03.406980 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.406958 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mts8v\" (UniqueName: \"kubernetes.io/projected/5cfef91b-197c-451c-bb28-5c8b7dd3c991-kube-api-access-mts8v\") pod \"multus-65jch\" (UID: \"5cfef91b-197c-451c-bb28-5c8b7dd3c991\") " pod="openshift-multus/multus-65jch" Sep 18 21:06:03.425046 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.425020 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24tcq\" (UniqueName: \"kubernetes.io/projected/35647875-14b5-4611-b210-ff84c9eaa6f4-kube-api-access-24tcq\") pod \"tuned-rnpn2\" (UID: \"35647875-14b5-4611-b210-ff84c9eaa6f4\") " pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.472295 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.472264 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4mmzf" Sep 18 21:06:03.479156 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.479125 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9npgd" Sep 18 21:06:03.493512 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.493489 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:03.499467 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.499444 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhchd" Sep 18 21:06:03.504386 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.504362 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x968q" Sep 18 21:06:03.514271 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.514245 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" Sep 18 21:06:03.521166 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.521139 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4z79x" Sep 18 21:06:03.530164 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.530114 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-65jch" Sep 18 21:06:03.536310 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.536281 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wdmzv" Sep 18 21:06:03.785793 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.785697 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b7697c4-d541-409e-8863-71a4142610e7-metrics-certs\") pod \"network-metrics-daemon-hxmc5\" (UID: \"1b7697c4-d541-409e-8863-71a4142610e7\") " pod="openshift-multus/network-metrics-daemon-hxmc5" Sep 18 21:06:03.785975 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:03.785898 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:06:03.786104 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:03.785982 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b7697c4-d541-409e-8863-71a4142610e7-metrics-certs podName:1b7697c4-d541-409e-8863-71a4142610e7 nodeName:}" failed. No retries permitted until 2026-09-18 21:06:04.785962094 +0000 UTC m=+4.006074477 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b7697c4-d541-409e-8863-71a4142610e7-metrics-certs") pod "network-metrics-daemon-hxmc5" (UID: "1b7697c4-d541-409e-8863-71a4142610e7") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:06:03.870873 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.870829 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 21:06:03.886851 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.886821 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq7pr\" (UniqueName: \"kubernetes.io/projected/65dced9b-bd34-4d5b-a945-7d1a09980e77-kube-api-access-nq7pr\") pod \"network-check-target-krpsb\" (UID: \"65dced9b-bd34-4d5b-a945-7d1a09980e77\") " pod="openshift-network-diagnostics/network-check-target-krpsb" Sep 18 21:06:03.886996 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:03.886865 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fc73b59-e444-4f69-b4cc-1950297674cc-original-pull-secret\") pod \"global-pull-secret-syncer-5mdk8\" (UID: \"1fc73b59-e444-4f69-b4cc-1950297674cc\") " pod="kube-system/global-pull-secret-syncer-5mdk8" Sep 18 21:06:03.887097 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:03.886991 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 21:06:03.887097 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:03.887057 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fc73b59-e444-4f69-b4cc-1950297674cc-original-pull-secret podName:1fc73b59-e444-4f69-b4cc-1950297674cc nodeName:}" failed. No retries permitted until 2026-09-18 21:06:04.887042077 +0000 UTC m=+4.107154445 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1fc73b59-e444-4f69-b4cc-1950297674cc-original-pull-secret") pod "global-pull-secret-syncer-5mdk8" (UID: "1fc73b59-e444-4f69-b4cc-1950297674cc") : object "kube-system"/"original-pull-secret" not registered Sep 18 21:06:03.887097 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:03.886993 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 21:06:03.887224 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:03.887108 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 21:06:03.887224 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:03.887121 2581 projected.go:196] Error preparing data for projected volume kube-api-access-nq7pr for pod openshift-network-diagnostics/network-check-target-krpsb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:06:03.887224 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:03.887203 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65dced9b-bd34-4d5b-a945-7d1a09980e77-kube-api-access-nq7pr podName:65dced9b-bd34-4d5b-a945-7d1a09980e77 nodeName:}" failed. No retries permitted until 2026-09-18 21:06:04.887185821 +0000 UTC m=+4.107298192 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nq7pr" (UniqueName: "kubernetes.io/projected/65dced9b-bd34-4d5b-a945-7d1a09980e77-kube-api-access-nq7pr") pod "network-check-target-krpsb" (UID: "65dced9b-bd34-4d5b-a945-7d1a09980e77") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:06:04.243828 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:04.243793 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 21:01:03 +0000 UTC" deadline="2028-02-14 17:54:15.924120413 +0000 UTC" Sep 18 21:06:04.243828 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:04.243829 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12332h48m11.680297471s" Sep 18 21:06:04.246362 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:04.246335 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9e21649_b986_4d70_aa68_0a935127bd42.slice/crio-36e477a7eed651fac4924bcae5bf0ccd7ac785a8afeddbe3a3b1d64d630ea726 WatchSource:0}: Error finding container 36e477a7eed651fac4924bcae5bf0ccd7ac785a8afeddbe3a3b1d64d630ea726: Status 404 returned error can't find the container with id 36e477a7eed651fac4924bcae5bf0ccd7ac785a8afeddbe3a3b1d64d630ea726 Sep 18 21:06:04.268465 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:04.268435 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb17064e_3205_42e7_b27b_ca0ae7e1a699.slice/crio-ed7b8a3af29dae56bb6bbd6e65cf8a845a00603774eda3286198291d2634f2cd WatchSource:0}: Error finding container ed7b8a3af29dae56bb6bbd6e65cf8a845a00603774eda3286198291d2634f2cd: Status 404 returned error can't find the container with id ed7b8a3af29dae56bb6bbd6e65cf8a845a00603774eda3286198291d2634f2cd Sep 18 21:06:04.269571 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:04.269544 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43ea9d10_49c4_48c3_837a_e475e2dc87b5.slice/crio-c277781a5a0fba68b46d6be727be9eefee16abebd7330c282a9728da74e19aa9 WatchSource:0}: Error finding container c277781a5a0fba68b46d6be727be9eefee16abebd7330c282a9728da74e19aa9: Status 404 returned error can't find the container with id c277781a5a0fba68b46d6be727be9eefee16abebd7330c282a9728da74e19aa9 Sep 18 21:06:04.270246 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:04.270219 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cfef91b_197c_451c_bb28_5c8b7dd3c991.slice/crio-afca1e49e714e282823f51922e50ecbe878ca4f6f7ae3988dc0e733a63d3cd3f WatchSource:0}: Error finding container afca1e49e714e282823f51922e50ecbe878ca4f6f7ae3988dc0e733a63d3cd3f: Status 404 returned error can't find the container with id afca1e49e714e282823f51922e50ecbe878ca4f6f7ae3988dc0e733a63d3cd3f Sep 18 21:06:04.272175 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:04.271783 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf656f6e8_a587_471a_87c6_43939a689aca.slice/crio-8f82449118fe4d1fff7c93ec4bf74d6b28216f45c44990324dbfd961325bb062 WatchSource:0}: Error finding container 8f82449118fe4d1fff7c93ec4bf74d6b28216f45c44990324dbfd961325bb062: Status 404 returned error can't find the container with id 8f82449118fe4d1fff7c93ec4bf74d6b28216f45c44990324dbfd961325bb062 Sep 18 21:06:04.273254 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:04.273229 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod102cab22_2d19_48dc_8b25_20906d94cf62.slice/crio-e2e25a10f8deada42f1458c77bfcb371988d96a677c4c61fc5ca87b7c2c2e840 WatchSource:0}: Error finding container e2e25a10f8deada42f1458c77bfcb371988d96a677c4c61fc5ca87b7c2c2e840: Status 404 returned error can't find the container with id e2e25a10f8deada42f1458c77bfcb371988d96a677c4c61fc5ca87b7c2c2e840 Sep 18 21:06:04.275238 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:04.275192 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" event={"ID":"b9e21649-b986-4d70-aa68-0a935127bd42","Type":"ContainerStarted","Data":"36e477a7eed651fac4924bcae5bf0ccd7ac785a8afeddbe3a3b1d64d630ea726"} Sep 18 21:06:04.275452 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:04.275427 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cc5c883_f3d7_4313_8174_fed3d65dcf2d.slice/crio-74e80c3ad82fed8cd3171bc73b929e1cbb66db8c39c42eb3d2b1b5cd2d056438 WatchSource:0}: Error finding container 74e80c3ad82fed8cd3171bc73b929e1cbb66db8c39c42eb3d2b1b5cd2d056438: Status 404 returned error can't find the container with id 74e80c3ad82fed8cd3171bc73b929e1cbb66db8c39c42eb3d2b1b5cd2d056438 Sep 18 21:06:04.276102 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:04.276066 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2846cc57_5ea3_48e0_a5ea_67f3407e5da0.slice/crio-5e581a8e6bf4e9e1d2a71ea34a89f40cc864e134286aa4f104e75fc3fc77b9ee WatchSource:0}: Error finding container 5e581a8e6bf4e9e1d2a71ea34a89f40cc864e134286aa4f104e75fc3fc77b9ee: Status 404 returned error can't find the container with id 5e581a8e6bf4e9e1d2a71ea34a89f40cc864e134286aa4f104e75fc3fc77b9ee Sep 18 21:06:04.277654 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:04.277624 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-65jch" event={"ID":"5cfef91b-197c-451c-bb28-5c8b7dd3c991","Type":"ContainerStarted","Data":"afca1e49e714e282823f51922e50ecbe878ca4f6f7ae3988dc0e733a63d3cd3f"} Sep 18 21:06:04.278337 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:04.278213 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35647875_14b5_4611_b210_ff84c9eaa6f4.slice/crio-7573c1077059815c41f4b49326d888e0fd3ce6335f0a27c0a99dea04fb92cad3 WatchSource:0}: Error finding container 7573c1077059815c41f4b49326d888e0fd3ce6335f0a27c0a99dea04fb92cad3: Status 404 returned error can't find the container with id 7573c1077059815c41f4b49326d888e0fd3ce6335f0a27c0a99dea04fb92cad3 Sep 18 21:06:04.280633 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:04.280523 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mmzf" event={"ID":"43ea9d10-49c4-48c3-837a-e475e2dc87b5","Type":"ContainerStarted","Data":"c277781a5a0fba68b46d6be727be9eefee16abebd7330c282a9728da74e19aa9"} Sep 18 21:06:04.282731 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:04.282648 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhchd" event={"ID":"fb17064e-3205-42e7-b27b-ca0ae7e1a699","Type":"ContainerStarted","Data":"ed7b8a3af29dae56bb6bbd6e65cf8a845a00603774eda3286198291d2634f2cd"} Sep 18 21:06:04.795620 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:04.794977 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b7697c4-d541-409e-8863-71a4142610e7-metrics-certs\") pod \"network-metrics-daemon-hxmc5\" (UID: \"1b7697c4-d541-409e-8863-71a4142610e7\") " pod="openshift-multus/network-metrics-daemon-hxmc5" Sep 18 21:06:04.795620 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:04.795131 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:06:04.795620 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:04.795218 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b7697c4-d541-409e-8863-71a4142610e7-metrics-certs podName:1b7697c4-d541-409e-8863-71a4142610e7 nodeName:}" failed. No retries permitted until 2026-09-18 21:06:06.795197239 +0000 UTC m=+6.015309622 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b7697c4-d541-409e-8863-71a4142610e7-metrics-certs") pod "network-metrics-daemon-hxmc5" (UID: "1b7697c4-d541-409e-8863-71a4142610e7") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:06:04.895780 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:04.895735 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq7pr\" (UniqueName: \"kubernetes.io/projected/65dced9b-bd34-4d5b-a945-7d1a09980e77-kube-api-access-nq7pr\") pod \"network-check-target-krpsb\" (UID: \"65dced9b-bd34-4d5b-a945-7d1a09980e77\") " pod="openshift-network-diagnostics/network-check-target-krpsb" Sep 18 21:06:04.895967 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:04.895803 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fc73b59-e444-4f69-b4cc-1950297674cc-original-pull-secret\") pod \"global-pull-secret-syncer-5mdk8\" (UID: \"1fc73b59-e444-4f69-b4cc-1950297674cc\") " pod="kube-system/global-pull-secret-syncer-5mdk8" Sep 18 21:06:04.895967 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:04.895944 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 21:06:04.896073 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:04.896010 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fc73b59-e444-4f69-b4cc-1950297674cc-original-pull-secret podName:1fc73b59-e444-4f69-b4cc-1950297674cc nodeName:}" failed. No retries permitted until 2026-09-18 21:06:06.895989765 +0000 UTC m=+6.116102152 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1fc73b59-e444-4f69-b4cc-1950297674cc-original-pull-secret") pod "global-pull-secret-syncer-5mdk8" (UID: "1fc73b59-e444-4f69-b4cc-1950297674cc") : object "kube-system"/"original-pull-secret" not registered Sep 18 21:06:04.896135 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:04.896106 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 21:06:04.896135 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:04.896124 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 21:06:04.896311 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:04.896136 2581 projected.go:196] Error preparing data for projected volume kube-api-access-nq7pr for pod openshift-network-diagnostics/network-check-target-krpsb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:06:04.896874 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:04.896835 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65dced9b-bd34-4d5b-a945-7d1a09980e77-kube-api-access-nq7pr podName:65dced9b-bd34-4d5b-a945-7d1a09980e77 nodeName:}" failed. No retries permitted until 2026-09-18 21:06:06.896802367 +0000 UTC m=+6.116914756 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nq7pr" (UniqueName: "kubernetes.io/projected/65dced9b-bd34-4d5b-a945-7d1a09980e77-kube-api-access-nq7pr") pod "network-check-target-krpsb" (UID: "65dced9b-bd34-4d5b-a945-7d1a09980e77") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:06:05.244942 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:05.244869 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 21:01:03 +0000 UTC" deadline="2028-05-11 19:33:25.358016459 +0000 UTC" Sep 18 21:06:05.244942 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:05.244921 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14422h27m20.113098877s" Sep 18 21:06:05.267718 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:05.267663 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krpsb" Sep 18 21:06:05.267855 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:05.267784 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krpsb" podUID="65dced9b-bd34-4d5b-a945-7d1a09980e77" Sep 18 21:06:05.268215 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:05.268197 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mdk8" Sep 18 21:06:05.268330 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:05.268307 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mdk8" podUID="1fc73b59-e444-4f69-b4cc-1950297674cc" Sep 18 21:06:05.268403 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:05.268390 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxmc5" Sep 18 21:06:05.268506 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:05.268487 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hxmc5" podUID="1b7697c4-d541-409e-8863-71a4142610e7" Sep 18 21:06:05.309036 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:05.307485 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9npgd" event={"ID":"102cab22-2d19-48dc-8b25-20906d94cf62","Type":"ContainerStarted","Data":"e2e25a10f8deada42f1458c77bfcb371988d96a677c4c61fc5ca87b7c2c2e840"} Sep 18 21:06:05.328289 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:05.327935 2581 generic.go:356] "Generic (PLEG): container finished" podID="5deca0065e79f962c53d6bd5963d6479" containerID="e6975bb7125a88f8d838f52f52067266451cc73e7cbc01ab8eaba57256eb756e" exitCode=0 Sep 18 21:06:05.328289 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:05.328220 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-26.ec2.internal" event={"ID":"5deca0065e79f962c53d6bd5963d6479","Type":"ContainerDied","Data":"e6975bb7125a88f8d838f52f52067266451cc73e7cbc01ab8eaba57256eb756e"} Sep 18 21:06:05.346660 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:05.346633 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wdmzv" event={"ID":"2846cc57-5ea3-48e0-a5ea-67f3407e5da0","Type":"ContainerStarted","Data":"5e581a8e6bf4e9e1d2a71ea34a89f40cc864e134286aa4f104e75fc3fc77b9ee"} Sep 18 21:06:05.359464 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:05.359373 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4z79x" event={"ID":"f656f6e8-a587-471a-87c6-43939a689aca","Type":"ContainerStarted","Data":"8f82449118fe4d1fff7c93ec4bf74d6b28216f45c44990324dbfd961325bb062"} Sep 18 21:06:05.381191 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:05.380567 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-26.ec2.internal" event={"ID":"6087d6c1490414fda05efa5f1a508a01","Type":"ContainerStarted","Data":"6d0645dae62f3c277f2dd683dbf0fbb4aa0b00b6a9d0e2304533db81e2e836ad"} Sep 18 21:06:05.389814 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:05.389784 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" event={"ID":"35647875-14b5-4611-b210-ff84c9eaa6f4","Type":"ContainerStarted","Data":"7573c1077059815c41f4b49326d888e0fd3ce6335f0a27c0a99dea04fb92cad3"} Sep 18 21:06:05.396025 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:05.395978 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x968q" event={"ID":"1cc5c883-f3d7-4313-8174-fed3d65dcf2d","Type":"ContainerStarted","Data":"74e80c3ad82fed8cd3171bc73b929e1cbb66db8c39c42eb3d2b1b5cd2d056438"} Sep 18 21:06:06.421861 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:06.421795 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-26.ec2.internal" event={"ID":"5deca0065e79f962c53d6bd5963d6479","Type":"ContainerStarted","Data":"e334379ab7f93749811a7aca8cd5570490dc65c596795a0a4f4d2cc7f574f2e5"} Sep 18 21:06:06.440078 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:06.440016 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-26.ec2.internal" podStartSLOduration=3.440000474 podStartE2EDuration="3.440000474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:06:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:06:05.398874573 +0000 UTC m=+4.618986961" watchObservedRunningTime="2026-09-18 21:06:06.440000474 +0000 UTC m=+5.660112876" Sep 18 21:06:06.440439 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:06.440405 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-26.ec2.internal" podStartSLOduration=3.440394178 podStartE2EDuration="3.440394178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:06:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:06:06.43997986 +0000 UTC m=+5.660092250" watchObservedRunningTime="2026-09-18 21:06:06.440394178 +0000 UTC m=+5.660506566" Sep 18 21:06:06.813257 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:06.813138 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b7697c4-d541-409e-8863-71a4142610e7-metrics-certs\") pod \"network-metrics-daemon-hxmc5\" (UID: \"1b7697c4-d541-409e-8863-71a4142610e7\") " pod="openshift-multus/network-metrics-daemon-hxmc5" Sep 18 21:06:06.813423 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:06.813390 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:06:06.813487 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:06.813457 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b7697c4-d541-409e-8863-71a4142610e7-metrics-certs podName:1b7697c4-d541-409e-8863-71a4142610e7 nodeName:}" failed. No retries permitted until 2026-09-18 21:06:10.813438026 +0000 UTC m=+10.033550396 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b7697c4-d541-409e-8863-71a4142610e7-metrics-certs") pod "network-metrics-daemon-hxmc5" (UID: "1b7697c4-d541-409e-8863-71a4142610e7") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:06:06.914219 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:06.914179 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq7pr\" (UniqueName: \"kubernetes.io/projected/65dced9b-bd34-4d5b-a945-7d1a09980e77-kube-api-access-nq7pr\") pod \"network-check-target-krpsb\" (UID: \"65dced9b-bd34-4d5b-a945-7d1a09980e77\") " pod="openshift-network-diagnostics/network-check-target-krpsb" Sep 18 21:06:06.914411 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:06.914255 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fc73b59-e444-4f69-b4cc-1950297674cc-original-pull-secret\") pod \"global-pull-secret-syncer-5mdk8\" (UID: \"1fc73b59-e444-4f69-b4cc-1950297674cc\") " pod="kube-system/global-pull-secret-syncer-5mdk8" Sep 18 21:06:06.914411 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:06.914384 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 21:06:06.914537 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:06.914447 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fc73b59-e444-4f69-b4cc-1950297674cc-original-pull-secret podName:1fc73b59-e444-4f69-b4cc-1950297674cc nodeName:}" failed. No retries permitted until 2026-09-18 21:06:10.914430108 +0000 UTC m=+10.134542485 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1fc73b59-e444-4f69-b4cc-1950297674cc-original-pull-secret") pod "global-pull-secret-syncer-5mdk8" (UID: "1fc73b59-e444-4f69-b4cc-1950297674cc") : object "kube-system"/"original-pull-secret" not registered Sep 18 21:06:06.914856 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:06.914839 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 21:06:06.914941 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:06.914864 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 21:06:06.914941 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:06.914879 2581 projected.go:196] Error preparing data for projected volume kube-api-access-nq7pr for pod openshift-network-diagnostics/network-check-target-krpsb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:06:06.914941 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:06.914927 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65dced9b-bd34-4d5b-a945-7d1a09980e77-kube-api-access-nq7pr podName:65dced9b-bd34-4d5b-a945-7d1a09980e77 nodeName:}" failed. No retries permitted until 2026-09-18 21:06:10.914912039 +0000 UTC m=+10.135024429 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nq7pr" (UniqueName: "kubernetes.io/projected/65dced9b-bd34-4d5b-a945-7d1a09980e77-kube-api-access-nq7pr") pod "network-check-target-krpsb" (UID: "65dced9b-bd34-4d5b-a945-7d1a09980e77") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:06:07.264318 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:07.264230 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxmc5" Sep 18 21:06:07.264482 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:07.264363 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hxmc5" podUID="1b7697c4-d541-409e-8863-71a4142610e7" Sep 18 21:06:07.264740 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:07.264719 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krpsb" Sep 18 21:06:07.264852 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:07.264805 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krpsb" podUID="65dced9b-bd34-4d5b-a945-7d1a09980e77" Sep 18 21:06:07.265210 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:07.264181 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mdk8" Sep 18 21:06:07.265344 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:07.265287 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mdk8" podUID="1fc73b59-e444-4f69-b4cc-1950297674cc" Sep 18 21:06:09.263487 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:09.263454 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mdk8" Sep 18 21:06:09.263923 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:09.263454 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krpsb" Sep 18 21:06:09.263923 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:09.263581 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mdk8" podUID="1fc73b59-e444-4f69-b4cc-1950297674cc" Sep 18 21:06:09.263923 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:09.263594 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxmc5" Sep 18 21:06:09.263923 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:09.263650 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krpsb" podUID="65dced9b-bd34-4d5b-a945-7d1a09980e77" Sep 18 21:06:09.263923 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:09.263798 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hxmc5" podUID="1b7697c4-d541-409e-8863-71a4142610e7" Sep 18 21:06:10.846642 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:10.846604 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b7697c4-d541-409e-8863-71a4142610e7-metrics-certs\") pod \"network-metrics-daemon-hxmc5\" (UID: \"1b7697c4-d541-409e-8863-71a4142610e7\") " pod="openshift-multus/network-metrics-daemon-hxmc5" Sep 18 21:06:10.847128 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:10.846778 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:06:10.847128 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:10.846850 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b7697c4-d541-409e-8863-71a4142610e7-metrics-certs podName:1b7697c4-d541-409e-8863-71a4142610e7 nodeName:}" failed. No retries permitted until 2026-09-18 21:06:18.846828937 +0000 UTC m=+18.066941306 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b7697c4-d541-409e-8863-71a4142610e7-metrics-certs") pod "network-metrics-daemon-hxmc5" (UID: "1b7697c4-d541-409e-8863-71a4142610e7") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:06:10.947683 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:10.947640 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq7pr\" (UniqueName: \"kubernetes.io/projected/65dced9b-bd34-4d5b-a945-7d1a09980e77-kube-api-access-nq7pr\") pod \"network-check-target-krpsb\" (UID: \"65dced9b-bd34-4d5b-a945-7d1a09980e77\") " pod="openshift-network-diagnostics/network-check-target-krpsb" Sep 18 21:06:10.947845 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:10.947706 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fc73b59-e444-4f69-b4cc-1950297674cc-original-pull-secret\") pod \"global-pull-secret-syncer-5mdk8\" (UID: \"1fc73b59-e444-4f69-b4cc-1950297674cc\") " pod="kube-system/global-pull-secret-syncer-5mdk8" Sep 18 21:06:10.947897 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:10.947850 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 21:06:10.947929 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:10.947912 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fc73b59-e444-4f69-b4cc-1950297674cc-original-pull-secret podName:1fc73b59-e444-4f69-b4cc-1950297674cc nodeName:}" failed. No retries permitted until 2026-09-18 21:06:18.947895502 +0000 UTC m=+18.168007885 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1fc73b59-e444-4f69-b4cc-1950297674cc-original-pull-secret") pod "global-pull-secret-syncer-5mdk8" (UID: "1fc73b59-e444-4f69-b4cc-1950297674cc") : object "kube-system"/"original-pull-secret" not registered Sep 18 21:06:10.948009 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:10.947994 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 21:06:10.948052 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:10.948018 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 21:06:10.948052 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:10.948030 2581 projected.go:196] Error preparing data for projected volume kube-api-access-nq7pr for pod openshift-network-diagnostics/network-check-target-krpsb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:06:10.948111 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:10.948063 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65dced9b-bd34-4d5b-a945-7d1a09980e77-kube-api-access-nq7pr podName:65dced9b-bd34-4d5b-a945-7d1a09980e77 nodeName:}" failed. No retries permitted until 2026-09-18 21:06:18.948052337 +0000 UTC m=+18.168164716 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nq7pr" (UniqueName: "kubernetes.io/projected/65dced9b-bd34-4d5b-a945-7d1a09980e77-kube-api-access-nq7pr") pod "network-check-target-krpsb" (UID: "65dced9b-bd34-4d5b-a945-7d1a09980e77") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:06:11.266363 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:11.266286 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxmc5" Sep 18 21:06:11.266534 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:11.266393 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hxmc5" podUID="1b7697c4-d541-409e-8863-71a4142610e7" Sep 18 21:06:11.266763 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:11.266747 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krpsb" Sep 18 21:06:11.266848 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:11.266823 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krpsb" podUID="65dced9b-bd34-4d5b-a945-7d1a09980e77" Sep 18 21:06:11.266898 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:11.266856 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mdk8" Sep 18 21:06:11.266939 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:11.266908 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mdk8" podUID="1fc73b59-e444-4f69-b4cc-1950297674cc" Sep 18 21:06:13.263903 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:13.263867 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krpsb" Sep 18 21:06:13.263903 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:13.263884 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxmc5" Sep 18 21:06:13.263903 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:13.263868 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mdk8" Sep 18 21:06:13.264481 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:13.264056 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hxmc5" podUID="1b7697c4-d541-409e-8863-71a4142610e7" Sep 18 21:06:13.264481 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:13.264140 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mdk8" podUID="1fc73b59-e444-4f69-b4cc-1950297674cc" Sep 18 21:06:13.264481 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:13.264216 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krpsb" podUID="65dced9b-bd34-4d5b-a945-7d1a09980e77" Sep 18 21:06:15.263847 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:15.263762 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxmc5" Sep 18 21:06:15.263847 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:15.263783 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krpsb" Sep 18 21:06:15.264388 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:15.263910 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hxmc5" podUID="1b7697c4-d541-409e-8863-71a4142610e7" Sep 18 21:06:15.264388 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:15.264354 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krpsb" podUID="65dced9b-bd34-4d5b-a945-7d1a09980e77" Sep 18 21:06:15.264495 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:15.264404 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mdk8" Sep 18 21:06:15.264495 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:15.264479 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mdk8" podUID="1fc73b59-e444-4f69-b4cc-1950297674cc" Sep 18 21:06:17.264115 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:17.264077 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mdk8" Sep 18 21:06:17.264592 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:17.264129 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxmc5" Sep 18 21:06:17.264592 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:17.264078 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krpsb" Sep 18 21:06:17.264592 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:17.264257 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mdk8" podUID="1fc73b59-e444-4f69-b4cc-1950297674cc" Sep 18 21:06:17.264592 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:17.264334 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krpsb" podUID="65dced9b-bd34-4d5b-a945-7d1a09980e77" Sep 18 21:06:17.264592 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:17.264390 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hxmc5" podUID="1b7697c4-d541-409e-8863-71a4142610e7" Sep 18 21:06:18.908180 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:18.908136 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b7697c4-d541-409e-8863-71a4142610e7-metrics-certs\") pod \"network-metrics-daemon-hxmc5\" (UID: \"1b7697c4-d541-409e-8863-71a4142610e7\") " pod="openshift-multus/network-metrics-daemon-hxmc5" Sep 18 21:06:18.908524 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:18.908293 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:06:18.908524 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:18.908356 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b7697c4-d541-409e-8863-71a4142610e7-metrics-certs podName:1b7697c4-d541-409e-8863-71a4142610e7 nodeName:}" failed. No retries permitted until 2026-09-18 21:06:34.908340724 +0000 UTC m=+34.128453111 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b7697c4-d541-409e-8863-71a4142610e7-metrics-certs") pod "network-metrics-daemon-hxmc5" (UID: "1b7697c4-d541-409e-8863-71a4142610e7") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:06:19.009431 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:19.009358 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq7pr\" (UniqueName: \"kubernetes.io/projected/65dced9b-bd34-4d5b-a945-7d1a09980e77-kube-api-access-nq7pr\") pod \"network-check-target-krpsb\" (UID: \"65dced9b-bd34-4d5b-a945-7d1a09980e77\") " pod="openshift-network-diagnostics/network-check-target-krpsb" Sep 18 21:06:19.009431 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:19.009426 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fc73b59-e444-4f69-b4cc-1950297674cc-original-pull-secret\") pod \"global-pull-secret-syncer-5mdk8\" (UID: \"1fc73b59-e444-4f69-b4cc-1950297674cc\") " pod="kube-system/global-pull-secret-syncer-5mdk8" Sep 18 21:06:19.009637 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:19.009544 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 21:06:19.009637 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:19.009547 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 21:06:19.009637 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:19.009581 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 21:06:19.009637 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:19.009595 2581 projected.go:196] Error preparing data for projected volume kube-api-access-nq7pr for pod openshift-network-diagnostics/network-check-target-krpsb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:06:19.009637 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:19.009617 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fc73b59-e444-4f69-b4cc-1950297674cc-original-pull-secret podName:1fc73b59-e444-4f69-b4cc-1950297674cc nodeName:}" failed. No retries permitted until 2026-09-18 21:06:35.009598304 +0000 UTC m=+34.229710686 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1fc73b59-e444-4f69-b4cc-1950297674cc-original-pull-secret") pod "global-pull-secret-syncer-5mdk8" (UID: "1fc73b59-e444-4f69-b4cc-1950297674cc") : object "kube-system"/"original-pull-secret" not registered Sep 18 21:06:19.009837 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:19.009648 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65dced9b-bd34-4d5b-a945-7d1a09980e77-kube-api-access-nq7pr podName:65dced9b-bd34-4d5b-a945-7d1a09980e77 nodeName:}" failed. No retries permitted until 2026-09-18 21:06:35.009632464 +0000 UTC m=+34.229744844 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nq7pr" (UniqueName: "kubernetes.io/projected/65dced9b-bd34-4d5b-a945-7d1a09980e77-kube-api-access-nq7pr") pod "network-check-target-krpsb" (UID: "65dced9b-bd34-4d5b-a945-7d1a09980e77") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:06:19.263532 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:19.263442 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krpsb" Sep 18 21:06:19.263532 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:19.263477 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxmc5" Sep 18 21:06:19.263747 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:19.263447 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mdk8" Sep 18 21:06:19.263747 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:19.263543 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krpsb" podUID="65dced9b-bd34-4d5b-a945-7d1a09980e77" Sep 18 21:06:19.263747 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:19.263647 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hxmc5" podUID="1b7697c4-d541-409e-8863-71a4142610e7" Sep 18 21:06:19.263747 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:19.263713 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mdk8" podUID="1fc73b59-e444-4f69-b4cc-1950297674cc" Sep 18 21:06:21.264753 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:21.264726 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mdk8" Sep 18 21:06:21.265174 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:21.264833 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mdk8" podUID="1fc73b59-e444-4f69-b4cc-1950297674cc" Sep 18 21:06:21.265174 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:21.264929 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxmc5" Sep 18 21:06:21.265174 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:21.265051 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hxmc5" podUID="1b7697c4-d541-409e-8863-71a4142610e7" Sep 18 21:06:21.265174 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:21.265096 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krpsb" Sep 18 21:06:21.265174 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:21.265148 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krpsb" podUID="65dced9b-bd34-4d5b-a945-7d1a09980e77" Sep 18 21:06:23.263825 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:23.263626 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krpsb" Sep 18 21:06:23.264632 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:23.263689 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxmc5" Sep 18 21:06:23.264632 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:23.263915 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krpsb" podUID="65dced9b-bd34-4d5b-a945-7d1a09980e77" Sep 18 21:06:23.264632 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:23.263717 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mdk8" Sep 18 21:06:23.264632 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:23.263983 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hxmc5" podUID="1b7697c4-d541-409e-8863-71a4142610e7" Sep 18 21:06:23.264632 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:23.264081 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mdk8" podUID="1fc73b59-e444-4f69-b4cc-1950297674cc" Sep 18 21:06:23.458790 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:23.458715 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4z79x" event={"ID":"f656f6e8-a587-471a-87c6-43939a689aca","Type":"ContainerStarted","Data":"7a1083795355443c635366cd07c26d148f88257569fcbf2918bbdbb15c2df2ad"} Sep 18 21:06:23.462865 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:23.462828 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhchd" event={"ID":"fb17064e-3205-42e7-b27b-ca0ae7e1a699","Type":"ContainerStarted","Data":"64452c6637b3c41b435bb2ac088105980c955d32dcfcda0bc467d834659c3247"} Sep 18 21:06:23.464387 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:23.464362 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" event={"ID":"35647875-14b5-4611-b210-ff84c9eaa6f4","Type":"ContainerStarted","Data":"5a4dafd2c3f3e69665518733d03ecd09fcb086b92aabe2bcaab3e2e6d20ee27b"} Sep 18 21:06:23.465770 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:23.465751 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x968q" event={"ID":"1cc5c883-f3d7-4313-8174-fed3d65dcf2d","Type":"ContainerStarted","Data":"1140fa6211ca33f911cbddbe9b1ae9197b17e71ce68e1eeaebcba60ddf533545"} Sep 18 21:06:23.467174 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:23.467136 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-65jch" event={"ID":"5cfef91b-197c-451c-bb28-5c8b7dd3c991","Type":"ContainerStarted","Data":"5137631332d836edc44c80886021545310b9ae88d9ffbaf45826bfb7488d0939"} Sep 18 21:06:23.468720 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:23.468698 2581 generic.go:356] "Generic (PLEG): container finished" podID="43ea9d10-49c4-48c3-837a-e475e2dc87b5" containerID="1a77def58eec0d1f69647b57a4e26f738dca6b992ae49f84bba2219283b23662" exitCode=0 Sep 18 21:06:23.468799 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:23.468769 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mmzf" event={"ID":"43ea9d10-49c4-48c3-837a-e475e2dc87b5","Type":"ContainerDied","Data":"1a77def58eec0d1f69647b57a4e26f738dca6b992ae49f84bba2219283b23662"} Sep 18 21:06:23.471957 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:23.471760 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" event={"ID":"b9e21649-b986-4d70-aa68-0a935127bd42","Type":"ContainerStarted","Data":"90e71fea71e1aafd4138bdba08053a143afb408791575fc2718ddf9a63827328"} Sep 18 21:06:23.472049 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:23.472019 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" event={"ID":"b9e21649-b986-4d70-aa68-0a935127bd42","Type":"ContainerStarted","Data":"8e4a2ac1d4105528dfc3aec1a3be81b0cc317f2b2800c478ab2a33ad64dfd1c5"} Sep 18 21:06:23.472103 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:23.472071 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" event={"ID":"b9e21649-b986-4d70-aa68-0a935127bd42","Type":"ContainerStarted","Data":"4c2ba26d5726bd81869b3b69f197970b8c762ee2522590db9023631cb6ebb6e7"} Sep 18 21:06:23.472166 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:23.472123 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" event={"ID":"b9e21649-b986-4d70-aa68-0a935127bd42","Type":"ContainerStarted","Data":"d8a7786c46310db5d2632897d0d2cd3f0c60586a982c0762eb97202cb3fd1945"} Sep 18 21:06:23.472227 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:23.472205 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" event={"ID":"b9e21649-b986-4d70-aa68-0a935127bd42","Type":"ContainerStarted","Data":"160c80abd6ac685bf19d6fcddf5be79d4d6a93a6c6c7f81ecfc5f5c210d53275"} Sep 18 21:06:23.472276 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:23.472254 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" event={"ID":"b9e21649-b986-4d70-aa68-0a935127bd42","Type":"ContainerStarted","Data":"09001b07b118151b056a49f7273d1b70c7ac1c0d876a62b8ec19e3d01ac2e36e"} Sep 18 21:06:23.473222 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:23.473205 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wdmzv" event={"ID":"2846cc57-5ea3-48e0-a5ea-67f3407e5da0","Type":"ContainerStarted","Data":"7a76926581ee0b73bd40ffa57adb0ba317233b02af48e4787107efb12aeb8a66"} Sep 18 21:06:23.489370 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:23.489328 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4z79x" podStartSLOduration=4.3685888219999995 podStartE2EDuration="22.48931408s" totalImagesPullingTime="18.120725258s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:06:23.488893487 +0000 UTC m=+22.709005874" watchObservedRunningTime="2026-09-18 21:06:23.48931408 +0000 UTC m=+22.709426465" Sep 18 21:06:23.546779 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:23.546738 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rnpn2" podStartSLOduration=4.408225434 podStartE2EDuration="22.546723764s" totalImagesPullingTime="18.13849833s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:06:23.520518358 +0000 UTC m=+22.740630745" watchObservedRunningTime="2026-09-18 21:06:23.546723764 +0000 UTC m=+22.766836152" Sep 18 21:06:23.546919 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:23.546824 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-x968q" podStartSLOduration=4.430995735 podStartE2EDuration="22.54681994s" totalImagesPullingTime="18.115824205s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:06:23.546400289 +0000 UTC m=+22.766512678" watchObservedRunningTime="2026-09-18 21:06:23.54681994 +0000 UTC m=+22.766932329" Sep 18 21:06:23.638793 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:23.638746 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-65jch" podStartSLOduration=4.459607803 podStartE2EDuration="22.638730908s" totalImagesPullingTime="18.179123105s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:06:23.589842698 +0000 UTC m=+22.809955085" watchObservedRunningTime="2026-09-18 21:06:23.638730908 +0000 UTC m=+22.858843296" Sep 18 21:06:23.680457 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:23.680410 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wdmzv" podStartSLOduration=4.568721317 podStartE2EDuration="22.680394718s" totalImagesPullingTime="18.111673401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:06:23.639308761 +0000 UTC m=+22.859421148" watchObservedRunningTime="2026-09-18 21:06:23.680394718 +0000 UTC m=+22.900507105" Sep 18 21:06:23.936922 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:23.936895 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 18 21:06:24.244685 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:24.244541 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T21:06:23.936916263Z","UUID":"7f013b81-ca80-4a01-9a1d-9ece90795f55","Handler":null,"Name":"","Endpoint":""} Sep 18 21:06:24.246008 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:24.245985 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 18 21:06:24.246131 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:24.246021 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 18 21:06:24.478014 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:24.477978 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9npgd" event={"ID":"102cab22-2d19-48dc-8b25-20906d94cf62","Type":"ContainerStarted","Data":"6780e34c7c2b76ec2ce24aaa0275b6873117f266814f1de26ba0b40b35e25e26"} Sep 18 21:06:24.480474 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:24.480446 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhchd" event={"ID":"fb17064e-3205-42e7-b27b-ca0ae7e1a699","Type":"ContainerStarted","Data":"1f1494d4414a56b070bfdb22f75d38e7ba28a77b8a2e586c8b4cccb10c6fbd48"} Sep 18 21:06:25.263664 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:25.263629 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxmc5" Sep 18 21:06:25.263786 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:25.263760 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hxmc5" podUID="1b7697c4-d541-409e-8863-71a4142610e7" Sep 18 21:06:25.263879 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:25.263775 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mdk8" Sep 18 21:06:25.264000 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:25.263972 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mdk8" podUID="1fc73b59-e444-4f69-b4cc-1950297674cc" Sep 18 21:06:25.264000 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:25.263629 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krpsb" Sep 18 21:06:25.264330 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:25.264087 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krpsb" podUID="65dced9b-bd34-4d5b-a945-7d1a09980e77" Sep 18 21:06:25.486606 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:25.486523 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" event={"ID":"b9e21649-b986-4d70-aa68-0a935127bd42","Type":"ContainerStarted","Data":"242c3234c94309a2bf9aa9f536c7c9e5539b37c330357383ae01d4a6a870ad90"} Sep 18 21:06:25.488989 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:25.488953 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhchd" event={"ID":"fb17064e-3205-42e7-b27b-ca0ae7e1a699","Type":"ContainerStarted","Data":"e144b9727c6bd8926d9d1a326d4c595a06de4e2c2a7fbf35e203d59d38a4e5ce"} Sep 18 21:06:25.546042 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:25.545998 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9npgd" podStartSLOduration=6.406941807 podStartE2EDuration="24.545984606s" totalImagesPullingTime="18.139042799s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:06:24.515843372 +0000 UTC m=+23.735955758" watchObservedRunningTime="2026-09-18 21:06:25.545984606 +0000 UTC m=+24.766096993" Sep 18 21:06:25.546237 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:25.546211 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xhchd" podStartSLOduration=4.222181031 podStartE2EDuration="24.546206313s" totalImagesPullingTime="20.324025282s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:06:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:06:25.545851623 +0000 UTC m=+24.765964010" watchObservedRunningTime="2026-09-18 21:06:25.546206313 +0000 UTC m=+24.766318700" Sep 18 21:06:27.263969 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:27.263939 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxmc5" Sep 18 21:06:27.263969 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:27.263955 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krpsb" Sep 18 21:06:27.264481 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:27.263958 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mdk8" Sep 18 21:06:27.264481 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:27.264120 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hxmc5" podUID="1b7697c4-d541-409e-8863-71a4142610e7" Sep 18 21:06:27.264481 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:27.264247 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krpsb" podUID="65dced9b-bd34-4d5b-a945-7d1a09980e77" Sep 18 21:06:27.264481 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:27.264313 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mdk8" podUID="1fc73b59-e444-4f69-b4cc-1950297674cc" Sep 18 21:06:27.470135 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:27.470094 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wdmzv" Sep 18 21:06:27.695704 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:27.695588 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wdmzv" Sep 18 21:06:27.696246 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:27.696219 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wdmzv" Sep 18 21:06:28.496900 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:28.496864 2581 generic.go:356] "Generic (PLEG): container finished" podID="43ea9d10-49c4-48c3-837a-e475e2dc87b5" containerID="2060de210e9c29f5efa3f0473e24fa776ae5f3b08dbe7c63784e12fc891b8fa1" exitCode=0 Sep 18 21:06:28.497721 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:28.496919 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mmzf" event={"ID":"43ea9d10-49c4-48c3-837a-e475e2dc87b5","Type":"ContainerDied","Data":"2060de210e9c29f5efa3f0473e24fa776ae5f3b08dbe7c63784e12fc891b8fa1"} Sep 18 21:06:28.500745 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:28.500722 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" event={"ID":"b9e21649-b986-4d70-aa68-0a935127bd42","Type":"ContainerStarted","Data":"20f6da8e08acdbfdda0efec84b6eb3f9787aae881c36d91045fa950e59830591"} Sep 18 21:06:28.501327 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:28.501307 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wdmzv" Sep 18 21:06:29.263567 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:29.263525 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krpsb" Sep 18 21:06:29.263710 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:29.263613 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mdk8" Sep 18 21:06:29.263710 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:29.263624 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krpsb" podUID="65dced9b-bd34-4d5b-a945-7d1a09980e77" Sep 18 21:06:29.263882 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:29.263715 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mdk8" podUID="1fc73b59-e444-4f69-b4cc-1950297674cc" Sep 18 21:06:29.263882 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:29.263738 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxmc5" Sep 18 21:06:29.263882 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:29.263796 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hxmc5" podUID="1b7697c4-d541-409e-8863-71a4142610e7" Sep 18 21:06:29.505665 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:29.505401 2581 generic.go:356] "Generic (PLEG): container finished" podID="43ea9d10-49c4-48c3-837a-e475e2dc87b5" containerID="0a5d8ca22c8ff3476f93ca2f4621d175c8c844a873e79676e7228ceb5c701582" exitCode=0 Sep 18 21:06:29.505665 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:29.505475 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mmzf" event={"ID":"43ea9d10-49c4-48c3-837a-e475e2dc87b5","Type":"ContainerDied","Data":"0a5d8ca22c8ff3476f93ca2f4621d175c8c844a873e79676e7228ceb5c701582"} Sep 18 21:06:29.506430 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:29.506378 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:29.506468 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:29.506447 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:29.506502 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:29.506495 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:29.521901 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:29.521881 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:29.522527 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:29.522510 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:06:29.554955 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:29.554915 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" podStartSLOduration=10.321054476 podStartE2EDuration="28.554900554s" totalImagesPullingTime="18.233846078s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:06:28.606369375 +0000 UTC m=+27.826481762" watchObservedRunningTime="2026-09-18 21:06:29.554900554 +0000 UTC m=+28.775012965" Sep 18 21:06:29.853959 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:29.853933 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hxmc5"] Sep 18 21:06:29.854118 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:29.854080 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxmc5" Sep 18 21:06:29.854221 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:29.854192 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hxmc5" podUID="1b7697c4-d541-409e-8863-71a4142610e7" Sep 18 21:06:29.862195 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:29.862135 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-krpsb"] Sep 18 21:06:29.862327 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:29.862252 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krpsb" Sep 18 21:06:29.862388 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:29.862335 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krpsb" podUID="65dced9b-bd34-4d5b-a945-7d1a09980e77" Sep 18 21:06:29.862916 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:29.862892 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5mdk8"] Sep 18 21:06:29.863012 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:29.862995 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mdk8" Sep 18 21:06:29.863110 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:29.863089 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mdk8" podUID="1fc73b59-e444-4f69-b4cc-1950297674cc" Sep 18 21:06:30.509972 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:30.509890 2581 generic.go:356] "Generic (PLEG): container finished" podID="43ea9d10-49c4-48c3-837a-e475e2dc87b5" containerID="070e7344dbcba0115638f1fac8d7261c3a0031d0c5cf90b403d603ac373f0663" exitCode=0 Sep 18 21:06:30.510365 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:30.509967 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mmzf" event={"ID":"43ea9d10-49c4-48c3-837a-e475e2dc87b5","Type":"ContainerDied","Data":"070e7344dbcba0115638f1fac8d7261c3a0031d0c5cf90b403d603ac373f0663"} Sep 18 21:06:31.264418 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:31.264385 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krpsb" Sep 18 21:06:31.264602 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:31.264512 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krpsb" podUID="65dced9b-bd34-4d5b-a945-7d1a09980e77" Sep 18 21:06:32.264137 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:32.264097 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mdk8" Sep 18 21:06:32.264593 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:32.264247 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mdk8" podUID="1fc73b59-e444-4f69-b4cc-1950297674cc" Sep 18 21:06:32.264593 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:32.264309 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxmc5" Sep 18 21:06:32.264593 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:32.264452 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hxmc5" podUID="1b7697c4-d541-409e-8863-71a4142610e7" Sep 18 21:06:33.263328 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:33.263285 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krpsb" Sep 18 21:06:33.263541 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:33.263438 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krpsb" podUID="65dced9b-bd34-4d5b-a945-7d1a09980e77" Sep 18 21:06:34.263287 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:34.263253 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxmc5" Sep 18 21:06:34.263287 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:34.263274 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mdk8" Sep 18 21:06:34.263801 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:34.263397 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hxmc5" podUID="1b7697c4-d541-409e-8863-71a4142610e7" Sep 18 21:06:34.263801 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:34.263481 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mdk8" podUID="1fc73b59-e444-4f69-b4cc-1950297674cc" Sep 18 21:06:34.923037 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:34.923011 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b7697c4-d541-409e-8863-71a4142610e7-metrics-certs\") pod \"network-metrics-daemon-hxmc5\" (UID: \"1b7697c4-d541-409e-8863-71a4142610e7\") " pod="openshift-multus/network-metrics-daemon-hxmc5" Sep 18 21:06:34.923217 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:34.923109 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:06:34.923217 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:34.923175 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b7697c4-d541-409e-8863-71a4142610e7-metrics-certs podName:1b7697c4-d541-409e-8863-71a4142610e7 nodeName:}" failed. No retries permitted until 2026-09-18 21:07:06.923145134 +0000 UTC m=+66.143257500 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b7697c4-d541-409e-8863-71a4142610e7-metrics-certs") pod "network-metrics-daemon-hxmc5" (UID: "1b7697c4-d541-409e-8863-71a4142610e7") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:06:35.023617 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.023443 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fc73b59-e444-4f69-b4cc-1950297674cc-original-pull-secret\") pod \"global-pull-secret-syncer-5mdk8\" (UID: \"1fc73b59-e444-4f69-b4cc-1950297674cc\") " pod="kube-system/global-pull-secret-syncer-5mdk8" Sep 18 21:06:35.023799 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.023660 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq7pr\" (UniqueName: \"kubernetes.io/projected/65dced9b-bd34-4d5b-a945-7d1a09980e77-kube-api-access-nq7pr\") pod \"network-check-target-krpsb\" (UID: \"65dced9b-bd34-4d5b-a945-7d1a09980e77\") " pod="openshift-network-diagnostics/network-check-target-krpsb" Sep 18 21:06:35.023799 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:35.023579 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 21:06:35.023799 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:35.023733 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fc73b59-e444-4f69-b4cc-1950297674cc-original-pull-secret podName:1fc73b59-e444-4f69-b4cc-1950297674cc nodeName:}" failed. No retries permitted until 2026-09-18 21:07:07.023718856 +0000 UTC m=+66.243831238 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1fc73b59-e444-4f69-b4cc-1950297674cc-original-pull-secret") pod "global-pull-secret-syncer-5mdk8" (UID: "1fc73b59-e444-4f69-b4cc-1950297674cc") : object "kube-system"/"original-pull-secret" not registered Sep 18 21:06:35.023799 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:35.023759 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 21:06:35.023799 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:35.023776 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 21:06:35.023799 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:35.023789 2581 projected.go:196] Error preparing data for projected volume kube-api-access-nq7pr for pod openshift-network-diagnostics/network-check-target-krpsb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:06:35.024122 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:35.023833 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65dced9b-bd34-4d5b-a945-7d1a09980e77-kube-api-access-nq7pr podName:65dced9b-bd34-4d5b-a945-7d1a09980e77 nodeName:}" failed. No retries permitted until 2026-09-18 21:07:07.023822807 +0000 UTC m=+66.243935196 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nq7pr" (UniqueName: "kubernetes.io/projected/65dced9b-bd34-4d5b-a945-7d1a09980e77-kube-api-access-nq7pr") pod "network-check-target-krpsb" (UID: "65dced9b-bd34-4d5b-a945-7d1a09980e77") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:06:35.078459 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.078440 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-26.ec2.internal" event="NodeReady" Sep 18 21:06:35.078575 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.078563 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 18 21:06:35.134528 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.134497 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tg8b4"] Sep 18 21:06:35.154835 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.154807 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6r8fz"] Sep 18 21:06:35.154981 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.154954 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tg8b4" Sep 18 21:06:35.157702 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.157678 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 18 21:06:35.157702 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.157697 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qsk7s\"" Sep 18 21:06:35.157901 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.157774 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 18 21:06:35.178727 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.178706 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tg8b4"] Sep 18 21:06:35.178821 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.178744 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6r8fz"] Sep 18 21:06:35.178821 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.178813 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6r8fz" Sep 18 21:06:35.181513 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.181491 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 18 21:06:35.181695 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.181673 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 18 21:06:35.181778 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.181718 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5tlbx\"" Sep 18 21:06:35.183599 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.183581 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 18 21:06:35.224192 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.224126 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbgj9\" (UniqueName: \"kubernetes.io/projected/ad969dab-7207-48f2-b60e-b5d09c455d31-kube-api-access-mbgj9\") pod \"dns-default-tg8b4\" (UID: \"ad969dab-7207-48f2-b60e-b5d09c455d31\") " pod="openshift-dns/dns-default-tg8b4" Sep 18 21:06:35.224323 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.224211 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad969dab-7207-48f2-b60e-b5d09c455d31-metrics-tls\") pod \"dns-default-tg8b4\" (UID: \"ad969dab-7207-48f2-b60e-b5d09c455d31\") " pod="openshift-dns/dns-default-tg8b4" Sep 18 21:06:35.224323 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.224251 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ad969dab-7207-48f2-b60e-b5d09c455d31-config-volume\") pod \"dns-default-tg8b4\" (UID: \"ad969dab-7207-48f2-b60e-b5d09c455d31\") " pod="openshift-dns/dns-default-tg8b4" Sep 18 21:06:35.224323 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.224301 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad969dab-7207-48f2-b60e-b5d09c455d31-tmp-dir\") pod \"dns-default-tg8b4\" (UID: \"ad969dab-7207-48f2-b60e-b5d09c455d31\") " pod="openshift-dns/dns-default-tg8b4" Sep 18 21:06:35.264200 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.264170 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krpsb" Sep 18 21:06:35.267946 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.267916 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 21:06:35.268145 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.268121 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l7qn9\"" Sep 18 21:06:35.268272 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.268214 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 21:06:35.324701 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.324678 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad969dab-7207-48f2-b60e-b5d09c455d31-metrics-tls\") pod \"dns-default-tg8b4\" (UID: \"ad969dab-7207-48f2-b60e-b5d09c455d31\") " pod="openshift-dns/dns-default-tg8b4" Sep 18 21:06:35.324827 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.324722 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ad969dab-7207-48f2-b60e-b5d09c455d31-config-volume\") pod \"dns-default-tg8b4\" (UID: \"ad969dab-7207-48f2-b60e-b5d09c455d31\") " pod="openshift-dns/dns-default-tg8b4" Sep 18 21:06:35.324827 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.324744 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0991a3e-79b3-4eaa-8ed4-5b95dafae484-cert\") pod \"ingress-canary-6r8fz\" (UID: \"b0991a3e-79b3-4eaa-8ed4-5b95dafae484\") " pod="openshift-ingress-canary/ingress-canary-6r8fz" Sep 18 21:06:35.324827 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.324773 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzndt\" (UniqueName: \"kubernetes.io/projected/b0991a3e-79b3-4eaa-8ed4-5b95dafae484-kube-api-access-gzndt\") pod \"ingress-canary-6r8fz\" (UID: \"b0991a3e-79b3-4eaa-8ed4-5b95dafae484\") " pod="openshift-ingress-canary/ingress-canary-6r8fz" Sep 18 21:06:35.324934 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:35.324826 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 21:06:35.324934 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.324834 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad969dab-7207-48f2-b60e-b5d09c455d31-tmp-dir\") pod \"dns-default-tg8b4\" (UID: \"ad969dab-7207-48f2-b60e-b5d09c455d31\") " pod="openshift-dns/dns-default-tg8b4" Sep 18 21:06:35.324934 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.324874 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbgj9\" (UniqueName: \"kubernetes.io/projected/ad969dab-7207-48f2-b60e-b5d09c455d31-kube-api-access-mbgj9\") pod \"dns-default-tg8b4\" (UID: \"ad969dab-7207-48f2-b60e-b5d09c455d31\") " pod="openshift-dns/dns-default-tg8b4" Sep 18 21:06:35.324934 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:35.324888 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad969dab-7207-48f2-b60e-b5d09c455d31-metrics-tls podName:ad969dab-7207-48f2-b60e-b5d09c455d31 nodeName:}" failed. No retries permitted until 2026-09-18 21:06:35.824873246 +0000 UTC m=+35.044985615 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad969dab-7207-48f2-b60e-b5d09c455d31-metrics-tls") pod "dns-default-tg8b4" (UID: "ad969dab-7207-48f2-b60e-b5d09c455d31") : secret "dns-default-metrics-tls" not found Sep 18 21:06:35.325218 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.325203 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad969dab-7207-48f2-b60e-b5d09c455d31-tmp-dir\") pod \"dns-default-tg8b4\" (UID: \"ad969dab-7207-48f2-b60e-b5d09c455d31\") " pod="openshift-dns/dns-default-tg8b4" Sep 18 21:06:35.325262 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.325244 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ad969dab-7207-48f2-b60e-b5d09c455d31-config-volume\") pod \"dns-default-tg8b4\" (UID: \"ad969dab-7207-48f2-b60e-b5d09c455d31\") " pod="openshift-dns/dns-default-tg8b4" Sep 18 21:06:35.336631 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.336611 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbgj9\" (UniqueName: \"kubernetes.io/projected/ad969dab-7207-48f2-b60e-b5d09c455d31-kube-api-access-mbgj9\") pod \"dns-default-tg8b4\" (UID: \"ad969dab-7207-48f2-b60e-b5d09c455d31\") " pod="openshift-dns/dns-default-tg8b4" Sep 18 21:06:35.426069 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.426024 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzndt\" (UniqueName: \"kubernetes.io/projected/b0991a3e-79b3-4eaa-8ed4-5b95dafae484-kube-api-access-gzndt\") pod \"ingress-canary-6r8fz\" (UID: \"b0991a3e-79b3-4eaa-8ed4-5b95dafae484\") " pod="openshift-ingress-canary/ingress-canary-6r8fz" Sep 18 21:06:35.426172 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.426117 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0991a3e-79b3-4eaa-8ed4-5b95dafae484-cert\") pod \"ingress-canary-6r8fz\" (UID: \"b0991a3e-79b3-4eaa-8ed4-5b95dafae484\") " pod="openshift-ingress-canary/ingress-canary-6r8fz" Sep 18 21:06:35.428477 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.428458 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0991a3e-79b3-4eaa-8ed4-5b95dafae484-cert\") pod \"ingress-canary-6r8fz\" (UID: \"b0991a3e-79b3-4eaa-8ed4-5b95dafae484\") " pod="openshift-ingress-canary/ingress-canary-6r8fz" Sep 18 21:06:35.435800 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.435779 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzndt\" (UniqueName: \"kubernetes.io/projected/b0991a3e-79b3-4eaa-8ed4-5b95dafae484-kube-api-access-gzndt\") pod \"ingress-canary-6r8fz\" (UID: \"b0991a3e-79b3-4eaa-8ed4-5b95dafae484\") " pod="openshift-ingress-canary/ingress-canary-6r8fz" Sep 18 21:06:35.524304 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.524276 2581 generic.go:356] "Generic (PLEG): container finished" podID="43ea9d10-49c4-48c3-837a-e475e2dc87b5" containerID="321cdea402efa2a1d489b69465e1548c62593f4ffe101240c34db5194127a72f" exitCode=0 Sep 18 21:06:35.524422 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.524331 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mmzf" event={"ID":"43ea9d10-49c4-48c3-837a-e475e2dc87b5","Type":"ContainerDied","Data":"321cdea402efa2a1d489b69465e1548c62593f4ffe101240c34db5194127a72f"} Sep 18 21:06:35.533307 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.533289 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6r8fz" Sep 18 21:06:35.828385 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.828348 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad969dab-7207-48f2-b60e-b5d09c455d31-metrics-tls\") pod \"dns-default-tg8b4\" (UID: \"ad969dab-7207-48f2-b60e-b5d09c455d31\") " pod="openshift-dns/dns-default-tg8b4" Sep 18 21:06:35.828515 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:35.828495 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 21:06:35.828570 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:35.828560 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad969dab-7207-48f2-b60e-b5d09c455d31-metrics-tls podName:ad969dab-7207-48f2-b60e-b5d09c455d31 nodeName:}" failed. No retries permitted until 2026-09-18 21:06:36.828544809 +0000 UTC m=+36.048657175 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad969dab-7207-48f2-b60e-b5d09c455d31-metrics-tls") pod "dns-default-tg8b4" (UID: "ad969dab-7207-48f2-b60e-b5d09c455d31") : secret "dns-default-metrics-tls" not found Sep 18 21:06:35.878599 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:35.878576 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6r8fz"] Sep 18 21:06:35.881123 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:06:35.881101 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0991a3e_79b3_4eaa_8ed4_5b95dafae484.slice/crio-2d7810c9de8c871e631dd6bc77f0a8d898939dafe1575b9cd7d25019b1fd852a WatchSource:0}: Error finding container 2d7810c9de8c871e631dd6bc77f0a8d898939dafe1575b9cd7d25019b1fd852a: Status 404 returned error can't find the container with id 2d7810c9de8c871e631dd6bc77f0a8d898939dafe1575b9cd7d25019b1fd852a Sep 18 21:06:36.263984 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:36.263804 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxmc5" Sep 18 21:06:36.264181 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:36.263847 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mdk8" Sep 18 21:06:36.266972 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:36.266955 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 21:06:36.267610 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:36.266988 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 21:06:36.267610 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:36.266960 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pzg28\"" Sep 18 21:06:36.528321 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:36.528197 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6r8fz" event={"ID":"b0991a3e-79b3-4eaa-8ed4-5b95dafae484","Type":"ContainerStarted","Data":"2d7810c9de8c871e631dd6bc77f0a8d898939dafe1575b9cd7d25019b1fd852a"} Sep 18 21:06:36.531906 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:36.531878 2581 generic.go:356] "Generic (PLEG): container finished" podID="43ea9d10-49c4-48c3-837a-e475e2dc87b5" containerID="ca60c3307c8793b32d4a52a68daae1c95462df4810ca3c1e351211ee8442d3b6" exitCode=0 Sep 18 21:06:36.532052 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:36.531923 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mmzf" event={"ID":"43ea9d10-49c4-48c3-837a-e475e2dc87b5","Type":"ContainerDied","Data":"ca60c3307c8793b32d4a52a68daae1c95462df4810ca3c1e351211ee8442d3b6"} Sep 18 21:06:36.835014 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:36.834926 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad969dab-7207-48f2-b60e-b5d09c455d31-metrics-tls\") pod \"dns-default-tg8b4\" (UID: \"ad969dab-7207-48f2-b60e-b5d09c455d31\") " pod="openshift-dns/dns-default-tg8b4" Sep 18 21:06:36.835199 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:36.835077 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 21:06:36.835199 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:36.835146 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad969dab-7207-48f2-b60e-b5d09c455d31-metrics-tls podName:ad969dab-7207-48f2-b60e-b5d09c455d31 nodeName:}" failed. No retries permitted until 2026-09-18 21:06:38.835130445 +0000 UTC m=+38.055242815 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad969dab-7207-48f2-b60e-b5d09c455d31-metrics-tls") pod "dns-default-tg8b4" (UID: "ad969dab-7207-48f2-b60e-b5d09c455d31") : secret "dns-default-metrics-tls" not found Sep 18 21:06:37.538269 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:37.538236 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mmzf" event={"ID":"43ea9d10-49c4-48c3-837a-e475e2dc87b5","Type":"ContainerStarted","Data":"83314ed71675c6b151114540a06542d066f68e5402c7998f02f10de41e5413df"} Sep 18 21:06:37.567939 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:37.565623 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4mmzf" podStartSLOduration=8.314530172 podStartE2EDuration="36.565603817s" totalImagesPullingTime="28.251073645s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:06:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:06:37.564684477 +0000 UTC m=+36.784796889" watchObservedRunningTime="2026-09-18 21:06:37.565603817 +0000 UTC m=+36.785716207" Sep 18 21:06:38.542213 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:38.542184 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6r8fz" event={"ID":"b0991a3e-79b3-4eaa-8ed4-5b95dafae484","Type":"ContainerStarted","Data":"ac65a52c679d8b83a6c1f35a4a5a6e63a33cdd5c3b14db0ef4cf789ba9496f06"} Sep 18 21:06:38.561658 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:38.561613 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6r8fz" podStartSLOduration=1.029463961 podStartE2EDuration="3.561598059s" totalImagesPullingTime="2.532134098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:06:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:06:38.561423655 +0000 UTC m=+37.781536044" watchObservedRunningTime="2026-09-18 21:06:38.561598059 +0000 UTC m=+37.781710446" Sep 18 21:06:38.850755 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:38.850722 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad969dab-7207-48f2-b60e-b5d09c455d31-metrics-tls\") pod \"dns-default-tg8b4\" (UID: \"ad969dab-7207-48f2-b60e-b5d09c455d31\") " pod="openshift-dns/dns-default-tg8b4" Sep 18 21:06:38.850911 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:38.850863 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 21:06:38.850948 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:38.850925 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad969dab-7207-48f2-b60e-b5d09c455d31-metrics-tls podName:ad969dab-7207-48f2-b60e-b5d09c455d31 nodeName:}" failed. No retries permitted until 2026-09-18 21:06:42.850911781 +0000 UTC m=+42.071024163 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad969dab-7207-48f2-b60e-b5d09c455d31-metrics-tls") pod "dns-default-tg8b4" (UID: "ad969dab-7207-48f2-b60e-b5d09c455d31") : secret "dns-default-metrics-tls" not found Sep 18 21:06:42.875841 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:42.875787 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad969dab-7207-48f2-b60e-b5d09c455d31-metrics-tls\") pod \"dns-default-tg8b4\" (UID: \"ad969dab-7207-48f2-b60e-b5d09c455d31\") " pod="openshift-dns/dns-default-tg8b4" Sep 18 21:06:42.876261 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:42.875948 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 21:06:42.876261 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:42.876022 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad969dab-7207-48f2-b60e-b5d09c455d31-metrics-tls podName:ad969dab-7207-48f2-b60e-b5d09c455d31 nodeName:}" failed. No retries permitted until 2026-09-18 21:06:50.87600687 +0000 UTC m=+50.096119248 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad969dab-7207-48f2-b60e-b5d09c455d31-metrics-tls") pod "dns-default-tg8b4" (UID: "ad969dab-7207-48f2-b60e-b5d09c455d31") : secret "dns-default-metrics-tls" not found Sep 18 21:06:50.931924 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:06:50.931882 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad969dab-7207-48f2-b60e-b5d09c455d31-metrics-tls\") pod \"dns-default-tg8b4\" (UID: \"ad969dab-7207-48f2-b60e-b5d09c455d31\") " pod="openshift-dns/dns-default-tg8b4" Sep 18 21:06:50.932385 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:50.932038 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 21:06:50.932385 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:06:50.932115 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad969dab-7207-48f2-b60e-b5d09c455d31-metrics-tls podName:ad969dab-7207-48f2-b60e-b5d09c455d31 nodeName:}" failed. No retries permitted until 2026-09-18 21:07:06.932099649 +0000 UTC m=+66.152212015 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad969dab-7207-48f2-b60e-b5d09c455d31-metrics-tls") pod "dns-default-tg8b4" (UID: "ad969dab-7207-48f2-b60e-b5d09c455d31") : secret "dns-default-metrics-tls" not found Sep 18 21:07:01.523076 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:01.523049 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5hgdh" Sep 18 21:07:06.941995 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:06.941954 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b7697c4-d541-409e-8863-71a4142610e7-metrics-certs\") pod \"network-metrics-daemon-hxmc5\" (UID: \"1b7697c4-d541-409e-8863-71a4142610e7\") " pod="openshift-multus/network-metrics-daemon-hxmc5" Sep 18 21:07:06.941995 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:06.942007 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad969dab-7207-48f2-b60e-b5d09c455d31-metrics-tls\") pod \"dns-default-tg8b4\" (UID: \"ad969dab-7207-48f2-b60e-b5d09c455d31\") " pod="openshift-dns/dns-default-tg8b4" Sep 18 21:07:06.942566 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:06.942122 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 21:07:06.942566 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:06.942214 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad969dab-7207-48f2-b60e-b5d09c455d31-metrics-tls podName:ad969dab-7207-48f2-b60e-b5d09c455d31 nodeName:}" failed. No retries permitted until 2026-09-18 21:07:38.942193826 +0000 UTC m=+98.162306212 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad969dab-7207-48f2-b60e-b5d09c455d31-metrics-tls") pod "dns-default-tg8b4" (UID: "ad969dab-7207-48f2-b60e-b5d09c455d31") : secret "dns-default-metrics-tls" not found Sep 18 21:07:06.945915 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:06.945895 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 21:07:06.952684 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:06.952664 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 18 21:07:06.952766 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:06.952707 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b7697c4-d541-409e-8863-71a4142610e7-metrics-certs podName:1b7697c4-d541-409e-8863-71a4142610e7 nodeName:}" failed. No retries permitted until 2026-09-18 21:08:10.952695441 +0000 UTC m=+130.172807820 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b7697c4-d541-409e-8863-71a4142610e7-metrics-certs") pod "network-metrics-daemon-hxmc5" (UID: "1b7697c4-d541-409e-8863-71a4142610e7") : secret "metrics-daemon-secret" not found Sep 18 21:07:07.042303 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:07.042267 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq7pr\" (UniqueName: \"kubernetes.io/projected/65dced9b-bd34-4d5b-a945-7d1a09980e77-kube-api-access-nq7pr\") pod \"network-check-target-krpsb\" (UID: \"65dced9b-bd34-4d5b-a945-7d1a09980e77\") " pod="openshift-network-diagnostics/network-check-target-krpsb" Sep 18 21:07:07.042401 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:07.042327 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fc73b59-e444-4f69-b4cc-1950297674cc-original-pull-secret\") pod \"global-pull-secret-syncer-5mdk8\" (UID: \"1fc73b59-e444-4f69-b4cc-1950297674cc\") " pod="kube-system/global-pull-secret-syncer-5mdk8" Sep 18 21:07:07.045300 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:07.045284 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 21:07:07.045545 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:07.045531 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 21:07:07.056544 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:07.056524 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 21:07:07.056962 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:07.056944 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fc73b59-e444-4f69-b4cc-1950297674cc-original-pull-secret\") pod \"global-pull-secret-syncer-5mdk8\" (UID: \"1fc73b59-e444-4f69-b4cc-1950297674cc\") " pod="kube-system/global-pull-secret-syncer-5mdk8" Sep 18 21:07:07.065861 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:07.065839 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq7pr\" (UniqueName: \"kubernetes.io/projected/65dced9b-bd34-4d5b-a945-7d1a09980e77-kube-api-access-nq7pr\") pod \"network-check-target-krpsb\" (UID: \"65dced9b-bd34-4d5b-a945-7d1a09980e77\") " pod="openshift-network-diagnostics/network-check-target-krpsb" Sep 18 21:07:07.080056 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:07.080039 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l7qn9\"" Sep 18 21:07:07.086483 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:07.086472 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krpsb" Sep 18 21:07:07.177922 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:07.177882 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mdk8" Sep 18 21:07:07.366230 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:07.366198 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-krpsb"] Sep 18 21:07:07.370767 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:07:07.370742 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65dced9b_bd34_4d5b_a945_7d1a09980e77.slice/crio-ca3d64f1eb1e360afdb4363857a3d401563c0a98f82214d471194d1afc55c9a7 WatchSource:0}: Error finding container ca3d64f1eb1e360afdb4363857a3d401563c0a98f82214d471194d1afc55c9a7: Status 404 returned error can't find the container with id ca3d64f1eb1e360afdb4363857a3d401563c0a98f82214d471194d1afc55c9a7 Sep 18 21:07:07.451002 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:07.450974 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5mdk8"] Sep 18 21:07:07.453549 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:07:07.453520 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fc73b59_e444_4f69_b4cc_1950297674cc.slice/crio-a1bd8e8e31cdad0cc0655ba90e267b618a438b12aeb34d598238a2887568758c WatchSource:0}: Error finding container a1bd8e8e31cdad0cc0655ba90e267b618a438b12aeb34d598238a2887568758c: Status 404 returned error can't find the container with id a1bd8e8e31cdad0cc0655ba90e267b618a438b12aeb34d598238a2887568758c Sep 18 21:07:07.611811 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:07.611724 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5mdk8" event={"ID":"1fc73b59-e444-4f69-b4cc-1950297674cc","Type":"ContainerStarted","Data":"a1bd8e8e31cdad0cc0655ba90e267b618a438b12aeb34d598238a2887568758c"} Sep 18 21:07:07.612866 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:07.612844 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-krpsb" event={"ID":"65dced9b-bd34-4d5b-a945-7d1a09980e77","Type":"ContainerStarted","Data":"ca3d64f1eb1e360afdb4363857a3d401563c0a98f82214d471194d1afc55c9a7"} Sep 18 21:07:12.626945 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:12.626904 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5mdk8" event={"ID":"1fc73b59-e444-4f69-b4cc-1950297674cc","Type":"ContainerStarted","Data":"570373f8504121281dfa8f319d28a17e192c83ccde36437416953a11bcec64b2"} Sep 18 21:07:12.628468 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:12.628447 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-krpsb" event={"ID":"65dced9b-bd34-4d5b-a945-7d1a09980e77","Type":"ContainerStarted","Data":"ab9c913b1f52916f17afcbe5b3e4572accd493e6cdb58a784134bbd0c4f9b262"} Sep 18 21:07:12.628582 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:12.628571 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-krpsb" Sep 18 21:07:12.649015 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:12.648963 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5mdk8" podStartSLOduration=67.307540142 podStartE2EDuration="1m11.648948833s" totalImagesPullingTime="4.341408691s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:07:12.648297102 +0000 UTC m=+71.868409490" watchObservedRunningTime="2026-09-18 21:07:12.648948833 +0000 UTC m=+71.869061221" Sep 18 21:07:12.672508 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:12.672454 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-krpsb" podStartSLOduration=67.25139874 podStartE2EDuration="1m11.672437858s" totalImagesPullingTime="4.421039118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:07:12.672352034 +0000 UTC m=+71.892464445" watchObservedRunningTime="2026-09-18 21:07:12.672437858 +0000 UTC m=+71.892550249" Sep 18 21:07:37.675110 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.675073 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hv96v"] Sep 18 21:07:37.679244 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.679229 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hv96v" Sep 18 21:07:37.682017 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.681994 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 18 21:07:37.682293 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.682277 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 18 21:07:37.682349 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.682307 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 18 21:07:37.683048 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.683033 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-sh8wt\"" Sep 18 21:07:37.693673 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.693652 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hv96v"] Sep 18 21:07:37.792042 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.792004 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-gbl2s"] Sep 18 21:07:37.794732 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.794710 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-gbl2s" Sep 18 21:07:37.796051 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.796030 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-f7zlc"] Sep 18 21:07:37.798330 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.798312 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-4rjjp\"" Sep 18 21:07:37.798695 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.798678 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tt5rp"] Sep 18 21:07:37.798805 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.798792 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-f7zlc" Sep 18 21:07:37.801386 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.801368 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tt5rp" Sep 18 21:07:37.803259 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.803240 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 18 21:07:37.803400 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.803381 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 18 21:07:37.804018 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.804001 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-pb8rf\"" Sep 18 21:07:37.804496 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.804483 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 18 21:07:37.805280 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.805262 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 18 21:07:37.805376 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.805333 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-jkbg8\"" Sep 18 21:07:37.805508 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.805492 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 18 21:07:37.805600 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.805582 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 18 21:07:37.806455 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.806440 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 18 21:07:37.817672 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.817653 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-gbl2s"] Sep 18 21:07:37.818827 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.818814 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 18 21:07:37.826605 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.826590 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 18 21:07:37.829713 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.829697 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tt5rp"] Sep 18 21:07:37.832783 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.832761 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-f7zlc"] Sep 18 21:07:37.843931 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.843908 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsx4w\" (UniqueName: \"kubernetes.io/projected/cb2bb290-f144-43d4-84af-1d631c5edd08-kube-api-access-gsx4w\") pod \"cluster-samples-operator-685d7d68b5-hv96v\" (UID: \"cb2bb290-f144-43d4-84af-1d631c5edd08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hv96v" Sep 18 21:07:37.844012 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.843948 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb2bb290-f144-43d4-84af-1d631c5edd08-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-hv96v\" (UID: \"cb2bb290-f144-43d4-84af-1d631c5edd08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hv96v" Sep 18 21:07:37.927668 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.927590 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-9n8jv"] Sep 18 21:07:37.930441 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.930425 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c8c458dcf-wvcqd"] Sep 18 21:07:37.930574 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.930544 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-9n8jv" Sep 18 21:07:37.933170 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.933137 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-dvrg7\"" Sep 18 21:07:37.933326 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.933307 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 18 21:07:37.933413 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.933396 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" Sep 18 21:07:37.933569 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.933550 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 18 21:07:37.939847 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.939833 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 18 21:07:37.944325 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.944302 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f721584-d286-4964-bb65-916774fab8db-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-tt5rp\" (UID: \"6f721584-d286-4964-bb65-916774fab8db\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tt5rp" Sep 18 21:07:37.944420 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.944377 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwr4q\" (UniqueName: \"kubernetes.io/projected/6f721584-d286-4964-bb65-916774fab8db-kube-api-access-bwr4q\") pod \"cluster-monitoring-operator-847b8bd8d7-tt5rp\" (UID: \"6f721584-d286-4964-bb65-916774fab8db\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tt5rp" Sep 18 21:07:37.944420 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.944394 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 18 21:07:37.944532 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.944458 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvhnp\" (UniqueName: \"kubernetes.io/projected/41dea388-08ce-4b4a-8d4f-0abe5c7062b9-kube-api-access-xvhnp\") pod \"network-check-source-7cbc45fddc-gbl2s\" (UID: \"41dea388-08ce-4b4a-8d4f-0abe5c7062b9\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-gbl2s" Sep 18 21:07:37.944532 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.944478 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 18 21:07:37.944532 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.944483 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-26f2c\"" Sep 18 21:07:37.944532 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.944495 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsx4w\" (UniqueName: \"kubernetes.io/projected/cb2bb290-f144-43d4-84af-1d631c5edd08-kube-api-access-gsx4w\") pod \"cluster-samples-operator-685d7d68b5-hv96v\" (UID: \"cb2bb290-f144-43d4-84af-1d631c5edd08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hv96v" Sep 18 21:07:37.944731 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.944548 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38857100-523d-487d-bd52-329001743062-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-f7zlc\" (UID: \"38857100-523d-487d-bd52-329001743062\") " pod="openshift-insights/insights-operator-6f9c644dd9-f7zlc" Sep 18 21:07:37.944731 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.944576 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54wp7\" (UniqueName: \"kubernetes.io/projected/38857100-523d-487d-bd52-329001743062-kube-api-access-54wp7\") pod \"insights-operator-6f9c644dd9-f7zlc\" (UID: \"38857100-523d-487d-bd52-329001743062\") " pod="openshift-insights/insights-operator-6f9c644dd9-f7zlc" Sep 18 21:07:37.944731 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.944638 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb2bb290-f144-43d4-84af-1d631c5edd08-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-hv96v\" (UID: \"cb2bb290-f144-43d4-84af-1d631c5edd08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hv96v" Sep 18 21:07:37.944731 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.944669 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38857100-523d-487d-bd52-329001743062-tmp\") pod \"insights-operator-6f9c644dd9-f7zlc\" (UID: \"38857100-523d-487d-bd52-329001743062\") " pod="openshift-insights/insights-operator-6f9c644dd9-f7zlc" Sep 18 21:07:37.944731 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.944724 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6f721584-d286-4964-bb65-916774fab8db-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-tt5rp\" (UID: \"6f721584-d286-4964-bb65-916774fab8db\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tt5rp" Sep 18 21:07:37.944946 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:37.944744 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 18 21:07:37.944946 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.944764 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/38857100-523d-487d-bd52-329001743062-snapshots\") pod \"insights-operator-6f9c644dd9-f7zlc\" (UID: \"38857100-523d-487d-bd52-329001743062\") " pod="openshift-insights/insights-operator-6f9c644dd9-f7zlc" Sep 18 21:07:37.944946 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.944802 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38857100-523d-487d-bd52-329001743062-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-f7zlc\" (UID: \"38857100-523d-487d-bd52-329001743062\") " pod="openshift-insights/insights-operator-6f9c644dd9-f7zlc" Sep 18 21:07:37.944946 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:37.944810 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb2bb290-f144-43d4-84af-1d631c5edd08-samples-operator-tls podName:cb2bb290-f144-43d4-84af-1d631c5edd08 nodeName:}" failed. No retries permitted until 2026-09-18 21:07:38.444791639 +0000 UTC m=+97.664904025 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cb2bb290-f144-43d4-84af-1d631c5edd08-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-hv96v" (UID: "cb2bb290-f144-43d4-84af-1d631c5edd08") : secret "samples-operator-tls" not found Sep 18 21:07:37.944946 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.944863 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/38857100-523d-487d-bd52-329001743062-serving-cert\") pod \"insights-operator-6f9c644dd9-f7zlc\" (UID: \"38857100-523d-487d-bd52-329001743062\") " pod="openshift-insights/insights-operator-6f9c644dd9-f7zlc" Sep 18 21:07:37.951728 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.951706 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-9n8jv"] Sep 18 21:07:37.952418 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.952399 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 18 21:07:37.966289 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.966263 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsx4w\" (UniqueName: \"kubernetes.io/projected/cb2bb290-f144-43d4-84af-1d631c5edd08-kube-api-access-gsx4w\") pod \"cluster-samples-operator-685d7d68b5-hv96v\" (UID: \"cb2bb290-f144-43d4-84af-1d631c5edd08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hv96v" Sep 18 21:07:37.981714 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:37.981695 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c8c458dcf-wvcqd"] Sep 18 21:07:38.045191 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.045142 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38857100-523d-487d-bd52-329001743062-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-f7zlc\" (UID: \"38857100-523d-487d-bd52-329001743062\") " pod="openshift-insights/insights-operator-6f9c644dd9-f7zlc" Sep 18 21:07:38.045367 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.045212 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/38857100-523d-487d-bd52-329001743062-serving-cert\") pod \"insights-operator-6f9c644dd9-f7zlc\" (UID: \"38857100-523d-487d-bd52-329001743062\") " pod="openshift-insights/insights-operator-6f9c644dd9-f7zlc" Sep 18 21:07:38.045367 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.045241 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce1d3f40-3c78-4465-aa1f-e684e23455cf-installation-pull-secrets\") pod \"image-registry-c8c458dcf-wvcqd\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" Sep 18 21:07:38.045367 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.045267 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce1d3f40-3c78-4465-aa1f-e684e23455cf-bound-sa-token\") pod \"image-registry-c8c458dcf-wvcqd\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" Sep 18 21:07:38.045367 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.045293 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp2fx\" (UniqueName: \"kubernetes.io/projected/3be1e7ed-092e-42b6-9a91-b8f984a02b4f-kube-api-access-qp2fx\") pod \"volume-data-source-validator-5c4db8bdf9-9n8jv\" (UID: \"3be1e7ed-092e-42b6-9a91-b8f984a02b4f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-9n8jv" Sep 18 21:07:38.045512 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.045441 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce1d3f40-3c78-4465-aa1f-e684e23455cf-trusted-ca\") pod \"image-registry-c8c458dcf-wvcqd\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" Sep 18 21:07:38.045512 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.045474 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f721584-d286-4964-bb65-916774fab8db-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-tt5rp\" (UID: \"6f721584-d286-4964-bb65-916774fab8db\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tt5rp" Sep 18 21:07:38.045512 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.045491 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwr4q\" (UniqueName: \"kubernetes.io/projected/6f721584-d286-4964-bb65-916774fab8db-kube-api-access-bwr4q\") pod \"cluster-monitoring-operator-847b8bd8d7-tt5rp\" (UID: \"6f721584-d286-4964-bb65-916774fab8db\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tt5rp" Sep 18 21:07:38.045512 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.045507 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce1d3f40-3c78-4465-aa1f-e684e23455cf-registry-certificates\") pod \"image-registry-c8c458dcf-wvcqd\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" Sep 18 21:07:38.045688 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.045563 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvhnp\" (UniqueName: \"kubernetes.io/projected/41dea388-08ce-4b4a-8d4f-0abe5c7062b9-kube-api-access-xvhnp\") pod \"network-check-source-7cbc45fddc-gbl2s\" (UID: \"41dea388-08ce-4b4a-8d4f-0abe5c7062b9\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-gbl2s" Sep 18 21:07:38.045688 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.045591 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce1d3f40-3c78-4465-aa1f-e684e23455cf-image-registry-private-configuration\") pod \"image-registry-c8c458dcf-wvcqd\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" Sep 18 21:07:38.045688 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:38.045595 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 18 21:07:38.045688 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.045634 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38857100-523d-487d-bd52-329001743062-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-f7zlc\" (UID: \"38857100-523d-487d-bd52-329001743062\") " pod="openshift-insights/insights-operator-6f9c644dd9-f7zlc" Sep 18 21:07:38.045688 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:38.045659 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f721584-d286-4964-bb65-916774fab8db-cluster-monitoring-operator-tls podName:6f721584-d286-4964-bb65-916774fab8db nodeName:}" failed. No retries permitted until 2026-09-18 21:07:38.545641767 +0000 UTC m=+97.765754135 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6f721584-d286-4964-bb65-916774fab8db-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-tt5rp" (UID: "6f721584-d286-4964-bb65-916774fab8db") : secret "cluster-monitoring-operator-tls" not found Sep 18 21:07:38.045937 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.045769 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54wp7\" (UniqueName: \"kubernetes.io/projected/38857100-523d-487d-bd52-329001743062-kube-api-access-54wp7\") pod \"insights-operator-6f9c644dd9-f7zlc\" (UID: \"38857100-523d-487d-bd52-329001743062\") " pod="openshift-insights/insights-operator-6f9c644dd9-f7zlc" Sep 18 21:07:38.045937 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.045798 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1d3f40-3c78-4465-aa1f-e684e23455cf-registry-tls\") pod \"image-registry-c8c458dcf-wvcqd\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" Sep 18 21:07:38.045937 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.045823 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmhwq\" (UniqueName: \"kubernetes.io/projected/ce1d3f40-3c78-4465-aa1f-e684e23455cf-kube-api-access-lmhwq\") pod \"image-registry-c8c458dcf-wvcqd\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" Sep 18 21:07:38.045937 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.045859 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce1d3f40-3c78-4465-aa1f-e684e23455cf-ca-trust-extracted\") pod \"image-registry-c8c458dcf-wvcqd\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" Sep 18 21:07:38.046147 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.045940 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38857100-523d-487d-bd52-329001743062-tmp\") pod \"insights-operator-6f9c644dd9-f7zlc\" (UID: \"38857100-523d-487d-bd52-329001743062\") " pod="openshift-insights/insights-operator-6f9c644dd9-f7zlc" Sep 18 21:07:38.046147 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.045963 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6f721584-d286-4964-bb65-916774fab8db-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-tt5rp\" (UID: \"6f721584-d286-4964-bb65-916774fab8db\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tt5rp" Sep 18 21:07:38.046147 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.045987 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/38857100-523d-487d-bd52-329001743062-snapshots\") pod \"insights-operator-6f9c644dd9-f7zlc\" (UID: \"38857100-523d-487d-bd52-329001743062\") " pod="openshift-insights/insights-operator-6f9c644dd9-f7zlc" Sep 18 21:07:38.046335 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.046249 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38857100-523d-487d-bd52-329001743062-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-f7zlc\" (UID: \"38857100-523d-487d-bd52-329001743062\") " pod="openshift-insights/insights-operator-6f9c644dd9-f7zlc" Sep 18 21:07:38.046335 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.046300 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38857100-523d-487d-bd52-329001743062-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-f7zlc\" (UID: \"38857100-523d-487d-bd52-329001743062\") " pod="openshift-insights/insights-operator-6f9c644dd9-f7zlc" Sep 18 21:07:38.046335 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.046305 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38857100-523d-487d-bd52-329001743062-tmp\") pod \"insights-operator-6f9c644dd9-f7zlc\" (UID: \"38857100-523d-487d-bd52-329001743062\") " pod="openshift-insights/insights-operator-6f9c644dd9-f7zlc" Sep 18 21:07:38.046629 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.046607 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/38857100-523d-487d-bd52-329001743062-snapshots\") pod \"insights-operator-6f9c644dd9-f7zlc\" (UID: \"38857100-523d-487d-bd52-329001743062\") " pod="openshift-insights/insights-operator-6f9c644dd9-f7zlc" Sep 18 21:07:38.046746 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.046728 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6f721584-d286-4964-bb65-916774fab8db-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-tt5rp\" (UID: \"6f721584-d286-4964-bb65-916774fab8db\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tt5rp" Sep 18 21:07:38.047694 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.047677 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/38857100-523d-487d-bd52-329001743062-serving-cert\") pod \"insights-operator-6f9c644dd9-f7zlc\" (UID: \"38857100-523d-487d-bd52-329001743062\") " pod="openshift-insights/insights-operator-6f9c644dd9-f7zlc" Sep 18 21:07:38.069547 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.069520 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwr4q\" (UniqueName: \"kubernetes.io/projected/6f721584-d286-4964-bb65-916774fab8db-kube-api-access-bwr4q\") pod \"cluster-monitoring-operator-847b8bd8d7-tt5rp\" (UID: \"6f721584-d286-4964-bb65-916774fab8db\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tt5rp" Sep 18 21:07:38.070974 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.070954 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvhnp\" (UniqueName: \"kubernetes.io/projected/41dea388-08ce-4b4a-8d4f-0abe5c7062b9-kube-api-access-xvhnp\") pod \"network-check-source-7cbc45fddc-gbl2s\" (UID: \"41dea388-08ce-4b4a-8d4f-0abe5c7062b9\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-gbl2s" Sep 18 21:07:38.075582 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.075561 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54wp7\" (UniqueName: \"kubernetes.io/projected/38857100-523d-487d-bd52-329001743062-kube-api-access-54wp7\") pod \"insights-operator-6f9c644dd9-f7zlc\" (UID: \"38857100-523d-487d-bd52-329001743062\") " pod="openshift-insights/insights-operator-6f9c644dd9-f7zlc" Sep 18 21:07:38.104945 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.104915 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-gbl2s" Sep 18 21:07:38.109926 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.109906 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-f7zlc" Sep 18 21:07:38.147054 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.146998 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce1d3f40-3c78-4465-aa1f-e684e23455cf-image-registry-private-configuration\") pod \"image-registry-c8c458dcf-wvcqd\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" Sep 18 21:07:38.147054 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.147041 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1d3f40-3c78-4465-aa1f-e684e23455cf-registry-tls\") pod \"image-registry-c8c458dcf-wvcqd\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" Sep 18 21:07:38.147054 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.147059 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmhwq\" (UniqueName: \"kubernetes.io/projected/ce1d3f40-3c78-4465-aa1f-e684e23455cf-kube-api-access-lmhwq\") pod \"image-registry-c8c458dcf-wvcqd\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" Sep 18 21:07:38.147368 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.147080 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce1d3f40-3c78-4465-aa1f-e684e23455cf-ca-trust-extracted\") pod \"image-registry-c8c458dcf-wvcqd\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" Sep 18 21:07:38.147368 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:38.147237 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 21:07:38.147368 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:38.147261 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c8c458dcf-wvcqd: secret "image-registry-tls" not found Sep 18 21:07:38.147368 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:38.147338 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce1d3f40-3c78-4465-aa1f-e684e23455cf-registry-tls podName:ce1d3f40-3c78-4465-aa1f-e684e23455cf nodeName:}" failed. No retries permitted until 2026-09-18 21:07:38.647315397 +0000 UTC m=+97.867427779 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce1d3f40-3c78-4465-aa1f-e684e23455cf-registry-tls") pod "image-registry-c8c458dcf-wvcqd" (UID: "ce1d3f40-3c78-4465-aa1f-e684e23455cf") : secret "image-registry-tls" not found Sep 18 21:07:38.147568 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.147477 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce1d3f40-3c78-4465-aa1f-e684e23455cf-installation-pull-secrets\") pod \"image-registry-c8c458dcf-wvcqd\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" Sep 18 21:07:38.147568 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.147513 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce1d3f40-3c78-4465-aa1f-e684e23455cf-bound-sa-token\") pod \"image-registry-c8c458dcf-wvcqd\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" Sep 18 21:07:38.147568 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.147479 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce1d3f40-3c78-4465-aa1f-e684e23455cf-ca-trust-extracted\") pod \"image-registry-c8c458dcf-wvcqd\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" Sep 18 21:07:38.147568 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.147540 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp2fx\" (UniqueName: \"kubernetes.io/projected/3be1e7ed-092e-42b6-9a91-b8f984a02b4f-kube-api-access-qp2fx\") pod \"volume-data-source-validator-5c4db8bdf9-9n8jv\" (UID: \"3be1e7ed-092e-42b6-9a91-b8f984a02b4f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-9n8jv" Sep 18 21:07:38.147756 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.147605 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce1d3f40-3c78-4465-aa1f-e684e23455cf-trusted-ca\") pod \"image-registry-c8c458dcf-wvcqd\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" Sep 18 21:07:38.147756 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.147652 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce1d3f40-3c78-4465-aa1f-e684e23455cf-registry-certificates\") pod \"image-registry-c8c458dcf-wvcqd\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" Sep 18 21:07:38.148189 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.148144 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce1d3f40-3c78-4465-aa1f-e684e23455cf-registry-certificates\") pod \"image-registry-c8c458dcf-wvcqd\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" Sep 18 21:07:38.148853 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.148831 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce1d3f40-3c78-4465-aa1f-e684e23455cf-trusted-ca\") pod \"image-registry-c8c458dcf-wvcqd\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" Sep 18 21:07:38.149858 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.149839 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce1d3f40-3c78-4465-aa1f-e684e23455cf-installation-pull-secrets\") pod \"image-registry-c8c458dcf-wvcqd\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" Sep 18 21:07:38.150197 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.150178 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce1d3f40-3c78-4465-aa1f-e684e23455cf-image-registry-private-configuration\") pod \"image-registry-c8c458dcf-wvcqd\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" Sep 18 21:07:38.176252 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.175856 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp2fx\" (UniqueName: \"kubernetes.io/projected/3be1e7ed-092e-42b6-9a91-b8f984a02b4f-kube-api-access-qp2fx\") pod \"volume-data-source-validator-5c4db8bdf9-9n8jv\" (UID: \"3be1e7ed-092e-42b6-9a91-b8f984a02b4f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-9n8jv" Sep 18 21:07:38.177402 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.177365 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce1d3f40-3c78-4465-aa1f-e684e23455cf-bound-sa-token\") pod \"image-registry-c8c458dcf-wvcqd\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" Sep 18 21:07:38.178553 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.178490 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmhwq\" (UniqueName: \"kubernetes.io/projected/ce1d3f40-3c78-4465-aa1f-e684e23455cf-kube-api-access-lmhwq\") pod \"image-registry-c8c458dcf-wvcqd\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" Sep 18 21:07:38.240763 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.240742 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-9n8jv" Sep 18 21:07:38.378426 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.378398 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-gbl2s"] Sep 18 21:07:38.381320 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:07:38.381294 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41dea388_08ce_4b4a_8d4f_0abe5c7062b9.slice/crio-353fc01213d334622a116d01ed598ea4187596678410b0896664f69a9cdd32bf WatchSource:0}: Error finding container 353fc01213d334622a116d01ed598ea4187596678410b0896664f69a9cdd32bf: Status 404 returned error can't find the container with id 353fc01213d334622a116d01ed598ea4187596678410b0896664f69a9cdd32bf Sep 18 21:07:38.382583 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.382563 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-f7zlc"] Sep 18 21:07:38.385070 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:07:38.385048 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38857100_523d_487d_bd52_329001743062.slice/crio-2a032e0ba846458d1f2e5713ab74ace71aefd6d605518f4ae1a3413d8748bcd3 WatchSource:0}: Error finding container 2a032e0ba846458d1f2e5713ab74ace71aefd6d605518f4ae1a3413d8748bcd3: Status 404 returned error can't find the container with id 2a032e0ba846458d1f2e5713ab74ace71aefd6d605518f4ae1a3413d8748bcd3 Sep 18 21:07:38.448743 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.448716 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb2bb290-f144-43d4-84af-1d631c5edd08-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-hv96v\" (UID: \"cb2bb290-f144-43d4-84af-1d631c5edd08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hv96v" Sep 18 21:07:38.448879 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:38.448858 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 18 21:07:38.448947 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:38.448922 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb2bb290-f144-43d4-84af-1d631c5edd08-samples-operator-tls podName:cb2bb290-f144-43d4-84af-1d631c5edd08 nodeName:}" failed. No retries permitted until 2026-09-18 21:07:39.448908474 +0000 UTC m=+98.669020843 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cb2bb290-f144-43d4-84af-1d631c5edd08-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-hv96v" (UID: "cb2bb290-f144-43d4-84af-1d631c5edd08") : secret "samples-operator-tls" not found Sep 18 21:07:38.509066 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.509037 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-9n8jv"] Sep 18 21:07:38.512245 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:07:38.512213 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3be1e7ed_092e_42b6_9a91_b8f984a02b4f.slice/crio-fbccce9f18034874c36b139e82e5336a8e1321d2b7d1fd6ef4cf42a69709b580 WatchSource:0}: Error finding container fbccce9f18034874c36b139e82e5336a8e1321d2b7d1fd6ef4cf42a69709b580: Status 404 returned error can't find the container with id fbccce9f18034874c36b139e82e5336a8e1321d2b7d1fd6ef4cf42a69709b580 Sep 18 21:07:38.549142 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.549119 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f721584-d286-4964-bb65-916774fab8db-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-tt5rp\" (UID: \"6f721584-d286-4964-bb65-916774fab8db\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tt5rp" Sep 18 21:07:38.549264 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:38.549252 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 18 21:07:38.549313 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:38.549305 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f721584-d286-4964-bb65-916774fab8db-cluster-monitoring-operator-tls podName:6f721584-d286-4964-bb65-916774fab8db nodeName:}" failed. No retries permitted until 2026-09-18 21:07:39.549286966 +0000 UTC m=+98.769399344 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6f721584-d286-4964-bb65-916774fab8db-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-tt5rp" (UID: "6f721584-d286-4964-bb65-916774fab8db") : secret "cluster-monitoring-operator-tls" not found Sep 18 21:07:38.649865 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.649838 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1d3f40-3c78-4465-aa1f-e684e23455cf-registry-tls\") pod \"image-registry-c8c458dcf-wvcqd\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" Sep 18 21:07:38.649983 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:38.649966 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 21:07:38.650021 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:38.649985 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c8c458dcf-wvcqd: secret "image-registry-tls" not found Sep 18 21:07:38.650064 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:38.650031 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce1d3f40-3c78-4465-aa1f-e684e23455cf-registry-tls podName:ce1d3f40-3c78-4465-aa1f-e684e23455cf nodeName:}" failed. No retries permitted until 2026-09-18 21:07:39.650018818 +0000 UTC m=+98.870131184 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce1d3f40-3c78-4465-aa1f-e684e23455cf-registry-tls") pod "image-registry-c8c458dcf-wvcqd" (UID: "ce1d3f40-3c78-4465-aa1f-e684e23455cf") : secret "image-registry-tls" not found Sep 18 21:07:38.688817 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.688757 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-f7zlc" event={"ID":"38857100-523d-487d-bd52-329001743062","Type":"ContainerStarted","Data":"2a032e0ba846458d1f2e5713ab74ace71aefd6d605518f4ae1a3413d8748bcd3"} Sep 18 21:07:38.690347 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.690316 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-gbl2s" event={"ID":"41dea388-08ce-4b4a-8d4f-0abe5c7062b9","Type":"ContainerStarted","Data":"afad138cf36d02b1601e009af96c0e6f6ae8be24322553b4cfd3286f6d522920"} Sep 18 21:07:38.690428 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.690362 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-gbl2s" event={"ID":"41dea388-08ce-4b4a-8d4f-0abe5c7062b9","Type":"ContainerStarted","Data":"353fc01213d334622a116d01ed598ea4187596678410b0896664f69a9cdd32bf"} Sep 18 21:07:38.691478 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.691459 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-9n8jv" event={"ID":"3be1e7ed-092e-42b6-9a91-b8f984a02b4f","Type":"ContainerStarted","Data":"fbccce9f18034874c36b139e82e5336a8e1321d2b7d1fd6ef4cf42a69709b580"} Sep 18 21:07:38.708897 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.708400 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-gbl2s" podStartSLOduration=1.708384096 podStartE2EDuration="1.708384096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:07:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:07:38.707961944 +0000 UTC m=+97.928074333" watchObservedRunningTime="2026-09-18 21:07:38.708384096 +0000 UTC m=+97.928496486" Sep 18 21:07:38.951438 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:38.951362 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad969dab-7207-48f2-b60e-b5d09c455d31-metrics-tls\") pod \"dns-default-tg8b4\" (UID: \"ad969dab-7207-48f2-b60e-b5d09c455d31\") " pod="openshift-dns/dns-default-tg8b4" Sep 18 21:07:38.951641 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:38.951524 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 21:07:38.951641 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:38.951584 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad969dab-7207-48f2-b60e-b5d09c455d31-metrics-tls podName:ad969dab-7207-48f2-b60e-b5d09c455d31 nodeName:}" failed. No retries permitted until 2026-09-18 21:08:42.951569051 +0000 UTC m=+162.171681437 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad969dab-7207-48f2-b60e-b5d09c455d31-metrics-tls") pod "dns-default-tg8b4" (UID: "ad969dab-7207-48f2-b60e-b5d09c455d31") : secret "dns-default-metrics-tls" not found Sep 18 21:07:39.456662 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:39.456047 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb2bb290-f144-43d4-84af-1d631c5edd08-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-hv96v\" (UID: \"cb2bb290-f144-43d4-84af-1d631c5edd08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hv96v" Sep 18 21:07:39.456662 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:39.456258 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 18 21:07:39.456662 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:39.456329 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb2bb290-f144-43d4-84af-1d631c5edd08-samples-operator-tls podName:cb2bb290-f144-43d4-84af-1d631c5edd08 nodeName:}" failed. No retries permitted until 2026-09-18 21:07:41.456309989 +0000 UTC m=+100.676422375 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cb2bb290-f144-43d4-84af-1d631c5edd08-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-hv96v" (UID: "cb2bb290-f144-43d4-84af-1d631c5edd08") : secret "samples-operator-tls" not found Sep 18 21:07:39.557377 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:39.557269 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f721584-d286-4964-bb65-916774fab8db-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-tt5rp\" (UID: \"6f721584-d286-4964-bb65-916774fab8db\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tt5rp" Sep 18 21:07:39.557542 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:39.557394 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 18 21:07:39.557542 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:39.557463 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f721584-d286-4964-bb65-916774fab8db-cluster-monitoring-operator-tls podName:6f721584-d286-4964-bb65-916774fab8db nodeName:}" failed. No retries permitted until 2026-09-18 21:07:41.55744485 +0000 UTC m=+100.777557232 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6f721584-d286-4964-bb65-916774fab8db-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-tt5rp" (UID: "6f721584-d286-4964-bb65-916774fab8db") : secret "cluster-monitoring-operator-tls" not found Sep 18 21:07:39.658325 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:39.658286 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1d3f40-3c78-4465-aa1f-e684e23455cf-registry-tls\") pod \"image-registry-c8c458dcf-wvcqd\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" Sep 18 21:07:39.658485 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:39.658464 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 21:07:39.658564 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:39.658489 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c8c458dcf-wvcqd: secret "image-registry-tls" not found Sep 18 21:07:39.658618 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:39.658563 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce1d3f40-3c78-4465-aa1f-e684e23455cf-registry-tls podName:ce1d3f40-3c78-4465-aa1f-e684e23455cf nodeName:}" failed. No retries permitted until 2026-09-18 21:07:41.658541196 +0000 UTC m=+100.878653582 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce1d3f40-3c78-4465-aa1f-e684e23455cf-registry-tls") pod "image-registry-c8c458dcf-wvcqd" (UID: "ce1d3f40-3c78-4465-aa1f-e684e23455cf") : secret "image-registry-tls" not found Sep 18 21:07:40.699384 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:40.699290 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-9n8jv" event={"ID":"3be1e7ed-092e-42b6-9a91-b8f984a02b4f","Type":"ContainerStarted","Data":"4ba29d89ba75fc7c2c980070ffdadff32f19fd15accbc65444e054f9b547e32f"} Sep 18 21:07:40.700786 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:40.700757 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-f7zlc" event={"ID":"38857100-523d-487d-bd52-329001743062","Type":"ContainerStarted","Data":"94e6bbbb860e3fe05900325502d21035985331a39ab7db00fa6cf4d2f6ee0496"} Sep 18 21:07:40.717086 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:40.717043 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-9n8jv" podStartSLOduration=2.572426501 podStartE2EDuration="3.717030211s" totalImagesPullingTime="1.14460371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:07:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:07:40.716415838 +0000 UTC m=+99.936528227" watchObservedRunningTime="2026-09-18 21:07:40.717030211 +0000 UTC m=+99.937142593" Sep 18 21:07:40.735040 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:40.734996 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-6f9c644dd9-f7zlc" podStartSLOduration=1.800851113 podStartE2EDuration="3.734980394s" totalImagesPullingTime="1.934129281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:07:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:07:40.734293826 +0000 UTC m=+99.954406212" watchObservedRunningTime="2026-09-18 21:07:40.734980394 +0000 UTC m=+99.955092822" Sep 18 21:07:41.471935 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:41.471902 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb2bb290-f144-43d4-84af-1d631c5edd08-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-hv96v\" (UID: \"cb2bb290-f144-43d4-84af-1d631c5edd08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hv96v" Sep 18 21:07:41.472096 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:41.472019 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 18 21:07:41.472096 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:41.472070 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb2bb290-f144-43d4-84af-1d631c5edd08-samples-operator-tls podName:cb2bb290-f144-43d4-84af-1d631c5edd08 nodeName:}" failed. No retries permitted until 2026-09-18 21:07:45.472056931 +0000 UTC m=+104.692169310 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cb2bb290-f144-43d4-84af-1d631c5edd08-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-hv96v" (UID: "cb2bb290-f144-43d4-84af-1d631c5edd08") : secret "samples-operator-tls" not found Sep 18 21:07:41.572987 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:41.572951 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f721584-d286-4964-bb65-916774fab8db-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-tt5rp\" (UID: \"6f721584-d286-4964-bb65-916774fab8db\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tt5rp" Sep 18 21:07:41.573137 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:41.573113 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 18 21:07:41.573201 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:41.573193 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f721584-d286-4964-bb65-916774fab8db-cluster-monitoring-operator-tls podName:6f721584-d286-4964-bb65-916774fab8db nodeName:}" failed. No retries permitted until 2026-09-18 21:07:45.573177542 +0000 UTC m=+104.793289920 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6f721584-d286-4964-bb65-916774fab8db-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-tt5rp" (UID: "6f721584-d286-4964-bb65-916774fab8db") : secret "cluster-monitoring-operator-tls" not found Sep 18 21:07:41.615498 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:41.615469 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-x2gp6"] Sep 18 21:07:41.618776 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:41.618757 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x2gp6" Sep 18 21:07:41.621401 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:41.621384 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 18 21:07:41.621603 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:41.621584 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 18 21:07:41.622523 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:41.622507 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-k6nnv\"" Sep 18 21:07:41.637852 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:41.637825 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x2gp6"] Sep 18 21:07:41.673825 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:41.673804 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/512251b1-b84f-4a85-990d-dfe424c05143-data-volume\") pod \"insights-runtime-extractor-x2gp6\" (UID: \"512251b1-b84f-4a85-990d-dfe424c05143\") " pod="openshift-insights/insights-runtime-extractor-x2gp6" Sep 18 21:07:41.673941 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:41.673833 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k9p5\" (UniqueName: \"kubernetes.io/projected/512251b1-b84f-4a85-990d-dfe424c05143-kube-api-access-6k9p5\") pod \"insights-runtime-extractor-x2gp6\" (UID: \"512251b1-b84f-4a85-990d-dfe424c05143\") " pod="openshift-insights/insights-runtime-extractor-x2gp6" Sep 18 21:07:41.673941 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:41.673856 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/512251b1-b84f-4a85-990d-dfe424c05143-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2gp6\" (UID: \"512251b1-b84f-4a85-990d-dfe424c05143\") " pod="openshift-insights/insights-runtime-extractor-x2gp6" Sep 18 21:07:41.674026 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:41.673960 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/512251b1-b84f-4a85-990d-dfe424c05143-crio-socket\") pod \"insights-runtime-extractor-x2gp6\" (UID: \"512251b1-b84f-4a85-990d-dfe424c05143\") " pod="openshift-insights/insights-runtime-extractor-x2gp6" Sep 18 21:07:41.674026 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:41.673995 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1d3f40-3c78-4465-aa1f-e684e23455cf-registry-tls\") pod \"image-registry-c8c458dcf-wvcqd\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" Sep 18 21:07:41.674026 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:41.674013 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/512251b1-b84f-4a85-990d-dfe424c05143-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x2gp6\" (UID: \"512251b1-b84f-4a85-990d-dfe424c05143\") " pod="openshift-insights/insights-runtime-extractor-x2gp6" Sep 18 21:07:41.674125 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:41.674093 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 21:07:41.674125 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:41.674118 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c8c458dcf-wvcqd: secret "image-registry-tls" not found Sep 18 21:07:41.674204 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:41.674187 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce1d3f40-3c78-4465-aa1f-e684e23455cf-registry-tls podName:ce1d3f40-3c78-4465-aa1f-e684e23455cf nodeName:}" failed. No retries permitted until 2026-09-18 21:07:45.674171844 +0000 UTC m=+104.894284223 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce1d3f40-3c78-4465-aa1f-e684e23455cf-registry-tls") pod "image-registry-c8c458dcf-wvcqd" (UID: "ce1d3f40-3c78-4465-aa1f-e684e23455cf") : secret "image-registry-tls" not found Sep 18 21:07:41.774381 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:41.774299 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/512251b1-b84f-4a85-990d-dfe424c05143-crio-socket\") pod \"insights-runtime-extractor-x2gp6\" (UID: \"512251b1-b84f-4a85-990d-dfe424c05143\") " pod="openshift-insights/insights-runtime-extractor-x2gp6" Sep 18 21:07:41.774381 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:41.774347 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/512251b1-b84f-4a85-990d-dfe424c05143-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x2gp6\" (UID: \"512251b1-b84f-4a85-990d-dfe424c05143\") " pod="openshift-insights/insights-runtime-extractor-x2gp6" Sep 18 21:07:41.774844 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:41.774414 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/512251b1-b84f-4a85-990d-dfe424c05143-crio-socket\") pod \"insights-runtime-extractor-x2gp6\" (UID: \"512251b1-b84f-4a85-990d-dfe424c05143\") " pod="openshift-insights/insights-runtime-extractor-x2gp6" Sep 18 21:07:41.774844 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:41.774420 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/512251b1-b84f-4a85-990d-dfe424c05143-data-volume\") pod \"insights-runtime-extractor-x2gp6\" (UID: \"512251b1-b84f-4a85-990d-dfe424c05143\") " pod="openshift-insights/insights-runtime-extractor-x2gp6" Sep 18 21:07:41.774844 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:41.774471 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 21:07:41.774844 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:41.774507 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k9p5\" (UniqueName: \"kubernetes.io/projected/512251b1-b84f-4a85-990d-dfe424c05143-kube-api-access-6k9p5\") pod \"insights-runtime-extractor-x2gp6\" (UID: \"512251b1-b84f-4a85-990d-dfe424c05143\") " pod="openshift-insights/insights-runtime-extractor-x2gp6" Sep 18 21:07:41.774844 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:41.774544 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/512251b1-b84f-4a85-990d-dfe424c05143-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2gp6\" (UID: \"512251b1-b84f-4a85-990d-dfe424c05143\") " pod="openshift-insights/insights-runtime-extractor-x2gp6" Sep 18 21:07:41.774844 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:41.774617 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 21:07:41.774844 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:41.774727 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/512251b1-b84f-4a85-990d-dfe424c05143-data-volume\") pod \"insights-runtime-extractor-x2gp6\" (UID: \"512251b1-b84f-4a85-990d-dfe424c05143\") " pod="openshift-insights/insights-runtime-extractor-x2gp6" Sep 18 21:07:41.774844 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:41.774845 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/512251b1-b84f-4a85-990d-dfe424c05143-kube-rbac-proxy-cm podName:512251b1-b84f-4a85-990d-dfe424c05143 nodeName:}" failed. No retries permitted until 2026-09-18 21:07:42.274545888 +0000 UTC m=+101.494658285 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/512251b1-b84f-4a85-990d-dfe424c05143-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x2gp6" (UID: "512251b1-b84f-4a85-990d-dfe424c05143") : configmap "kube-rbac-proxy" not found Sep 18 21:07:41.775111 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:41.774893 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/512251b1-b84f-4a85-990d-dfe424c05143-insights-runtime-extractor-tls podName:512251b1-b84f-4a85-990d-dfe424c05143 nodeName:}" failed. No retries permitted until 2026-09-18 21:07:42.274876827 +0000 UTC m=+101.494989210 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/512251b1-b84f-4a85-990d-dfe424c05143-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x2gp6" (UID: "512251b1-b84f-4a85-990d-dfe424c05143") : secret "insights-runtime-extractor-tls" not found Sep 18 21:07:41.786143 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:41.786123 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k9p5\" (UniqueName: \"kubernetes.io/projected/512251b1-b84f-4a85-990d-dfe424c05143-kube-api-access-6k9p5\") pod \"insights-runtime-extractor-x2gp6\" (UID: \"512251b1-b84f-4a85-990d-dfe424c05143\") " pod="openshift-insights/insights-runtime-extractor-x2gp6" Sep 18 21:07:42.279955 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:42.279918 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/512251b1-b84f-4a85-990d-dfe424c05143-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x2gp6\" (UID: \"512251b1-b84f-4a85-990d-dfe424c05143\") " pod="openshift-insights/insights-runtime-extractor-x2gp6" Sep 18 21:07:42.280092 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:42.279975 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/512251b1-b84f-4a85-990d-dfe424c05143-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2gp6\" (UID: \"512251b1-b84f-4a85-990d-dfe424c05143\") " pod="openshift-insights/insights-runtime-extractor-x2gp6" Sep 18 21:07:42.280092 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:42.280041 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 21:07:42.280204 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:42.280100 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/512251b1-b84f-4a85-990d-dfe424c05143-kube-rbac-proxy-cm podName:512251b1-b84f-4a85-990d-dfe424c05143 nodeName:}" failed. No retries permitted until 2026-09-18 21:07:43.280085696 +0000 UTC m=+102.500198062 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/512251b1-b84f-4a85-990d-dfe424c05143-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x2gp6" (UID: "512251b1-b84f-4a85-990d-dfe424c05143") : configmap "kube-rbac-proxy" not found Sep 18 21:07:42.280204 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:42.280118 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 21:07:42.280299 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:42.280216 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/512251b1-b84f-4a85-990d-dfe424c05143-insights-runtime-extractor-tls podName:512251b1-b84f-4a85-990d-dfe424c05143 nodeName:}" failed. No retries permitted until 2026-09-18 21:07:43.280202621 +0000 UTC m=+102.500314999 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/512251b1-b84f-4a85-990d-dfe424c05143-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x2gp6" (UID: "512251b1-b84f-4a85-990d-dfe424c05143") : secret "insights-runtime-extractor-tls" not found Sep 18 21:07:43.287779 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:43.287749 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/512251b1-b84f-4a85-990d-dfe424c05143-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2gp6\" (UID: \"512251b1-b84f-4a85-990d-dfe424c05143\") " pod="openshift-insights/insights-runtime-extractor-x2gp6" Sep 18 21:07:43.288269 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:43.287834 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/512251b1-b84f-4a85-990d-dfe424c05143-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x2gp6\" (UID: \"512251b1-b84f-4a85-990d-dfe424c05143\") " pod="openshift-insights/insights-runtime-extractor-x2gp6" Sep 18 21:07:43.288269 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:43.287891 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 21:07:43.288269 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:43.287910 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 21:07:43.288269 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:43.287954 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/512251b1-b84f-4a85-990d-dfe424c05143-insights-runtime-extractor-tls podName:512251b1-b84f-4a85-990d-dfe424c05143 nodeName:}" failed. No retries permitted until 2026-09-18 21:07:45.287939266 +0000 UTC m=+104.508051664 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/512251b1-b84f-4a85-990d-dfe424c05143-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x2gp6" (UID: "512251b1-b84f-4a85-990d-dfe424c05143") : secret "insights-runtime-extractor-tls" not found Sep 18 21:07:43.288269 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:43.287967 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/512251b1-b84f-4a85-990d-dfe424c05143-kube-rbac-proxy-cm podName:512251b1-b84f-4a85-990d-dfe424c05143 nodeName:}" failed. No retries permitted until 2026-09-18 21:07:45.287961259 +0000 UTC m=+104.508073624 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/512251b1-b84f-4a85-990d-dfe424c05143-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x2gp6" (UID: "512251b1-b84f-4a85-990d-dfe424c05143") : configmap "kube-rbac-proxy" not found Sep 18 21:07:43.634096 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:43.634015 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-krpsb" Sep 18 21:07:43.703869 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:43.703842 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x968q_1cc5c883-f3d7-4313-8174-fed3d65dcf2d/dns-node-resolver/0.log" Sep 18 21:07:44.305726 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:44.305703 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4z79x_f656f6e8-a587-471a-87c6-43939a689aca/node-ca/0.log" Sep 18 21:07:45.304484 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:45.304459 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6r8fz_b0991a3e-79b3-4eaa-8ed4-5b95dafae484/serve-healthcheck-canary/0.log" Sep 18 21:07:45.305567 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:45.305548 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/512251b1-b84f-4a85-990d-dfe424c05143-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2gp6\" (UID: \"512251b1-b84f-4a85-990d-dfe424c05143\") " pod="openshift-insights/insights-runtime-extractor-x2gp6" Sep 18 21:07:45.305656 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:45.305640 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/512251b1-b84f-4a85-990d-dfe424c05143-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x2gp6\" (UID: \"512251b1-b84f-4a85-990d-dfe424c05143\") " pod="openshift-insights/insights-runtime-extractor-x2gp6" Sep 18 21:07:45.305712 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:45.305691 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 21:07:45.305764 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:45.305719 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 21:07:45.305764 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:45.305753 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/512251b1-b84f-4a85-990d-dfe424c05143-insights-runtime-extractor-tls podName:512251b1-b84f-4a85-990d-dfe424c05143 nodeName:}" failed. No retries permitted until 2026-09-18 21:07:49.305737668 +0000 UTC m=+108.525850049 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/512251b1-b84f-4a85-990d-dfe424c05143-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x2gp6" (UID: "512251b1-b84f-4a85-990d-dfe424c05143") : secret "insights-runtime-extractor-tls" not found Sep 18 21:07:45.306190 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:45.305770 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/512251b1-b84f-4a85-990d-dfe424c05143-kube-rbac-proxy-cm podName:512251b1-b84f-4a85-990d-dfe424c05143 nodeName:}" failed. No retries permitted until 2026-09-18 21:07:49.305761202 +0000 UTC m=+108.525873569 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/512251b1-b84f-4a85-990d-dfe424c05143-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x2gp6" (UID: "512251b1-b84f-4a85-990d-dfe424c05143") : configmap "kube-rbac-proxy" not found Sep 18 21:07:45.507018 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:45.506983 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb2bb290-f144-43d4-84af-1d631c5edd08-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-hv96v\" (UID: \"cb2bb290-f144-43d4-84af-1d631c5edd08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hv96v" Sep 18 21:07:45.507208 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:45.507111 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 18 21:07:45.507208 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:45.507197 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb2bb290-f144-43d4-84af-1d631c5edd08-samples-operator-tls podName:cb2bb290-f144-43d4-84af-1d631c5edd08 nodeName:}" failed. No retries permitted until 2026-09-18 21:07:53.50717832 +0000 UTC m=+112.727290685 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cb2bb290-f144-43d4-84af-1d631c5edd08-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-hv96v" (UID: "cb2bb290-f144-43d4-84af-1d631c5edd08") : secret "samples-operator-tls" not found Sep 18 21:07:45.607450 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:45.607383 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f721584-d286-4964-bb65-916774fab8db-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-tt5rp\" (UID: \"6f721584-d286-4964-bb65-916774fab8db\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tt5rp" Sep 18 21:07:45.607560 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:45.607522 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 18 21:07:45.607600 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:45.607576 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f721584-d286-4964-bb65-916774fab8db-cluster-monitoring-operator-tls podName:6f721584-d286-4964-bb65-916774fab8db nodeName:}" failed. No retries permitted until 2026-09-18 21:07:53.607562598 +0000 UTC m=+112.827674986 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6f721584-d286-4964-bb65-916774fab8db-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-tt5rp" (UID: "6f721584-d286-4964-bb65-916774fab8db") : secret "cluster-monitoring-operator-tls" not found Sep 18 21:07:45.707902 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:45.707873 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1d3f40-3c78-4465-aa1f-e684e23455cf-registry-tls\") pod \"image-registry-c8c458dcf-wvcqd\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" Sep 18 21:07:45.708029 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:45.707985 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 21:07:45.708029 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:45.707995 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c8c458dcf-wvcqd: secret "image-registry-tls" not found Sep 18 21:07:45.708113 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:45.708037 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce1d3f40-3c78-4465-aa1f-e684e23455cf-registry-tls podName:ce1d3f40-3c78-4465-aa1f-e684e23455cf nodeName:}" failed. No retries permitted until 2026-09-18 21:07:53.708025204 +0000 UTC m=+112.928137570 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce1d3f40-3c78-4465-aa1f-e684e23455cf-registry-tls") pod "image-registry-c8c458dcf-wvcqd" (UID: "ce1d3f40-3c78-4465-aa1f-e684e23455cf") : secret "image-registry-tls" not found Sep 18 21:07:49.335948 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:49.335917 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/512251b1-b84f-4a85-990d-dfe424c05143-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2gp6\" (UID: \"512251b1-b84f-4a85-990d-dfe424c05143\") " pod="openshift-insights/insights-runtime-extractor-x2gp6" Sep 18 21:07:49.336463 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:49.336026 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/512251b1-b84f-4a85-990d-dfe424c05143-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x2gp6\" (UID: \"512251b1-b84f-4a85-990d-dfe424c05143\") " pod="openshift-insights/insights-runtime-extractor-x2gp6" Sep 18 21:07:49.336463 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:49.336115 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 21:07:49.336463 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:49.336144 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 21:07:49.336463 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:49.336221 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/512251b1-b84f-4a85-990d-dfe424c05143-kube-rbac-proxy-cm podName:512251b1-b84f-4a85-990d-dfe424c05143 nodeName:}" failed. No retries permitted until 2026-09-18 21:07:57.336208046 +0000 UTC m=+116.556320557 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/512251b1-b84f-4a85-990d-dfe424c05143-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x2gp6" (UID: "512251b1-b84f-4a85-990d-dfe424c05143") : configmap "kube-rbac-proxy" not found Sep 18 21:07:49.336463 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:07:49.336244 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/512251b1-b84f-4a85-990d-dfe424c05143-insights-runtime-extractor-tls podName:512251b1-b84f-4a85-990d-dfe424c05143 nodeName:}" failed. No retries permitted until 2026-09-18 21:07:57.336229508 +0000 UTC m=+116.556341887 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/512251b1-b84f-4a85-990d-dfe424c05143-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x2gp6" (UID: "512251b1-b84f-4a85-990d-dfe424c05143") : secret "insights-runtime-extractor-tls" not found Sep 18 21:07:53.569896 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:53.569845 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb2bb290-f144-43d4-84af-1d631c5edd08-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-hv96v\" (UID: \"cb2bb290-f144-43d4-84af-1d631c5edd08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hv96v" Sep 18 21:07:53.572436 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:53.572413 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb2bb290-f144-43d4-84af-1d631c5edd08-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-hv96v\" (UID: \"cb2bb290-f144-43d4-84af-1d631c5edd08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hv96v" Sep 18 21:07:53.588295 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:53.588266 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hv96v" Sep 18 21:07:53.671108 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:53.671076 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f721584-d286-4964-bb65-916774fab8db-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-tt5rp\" (UID: \"6f721584-d286-4964-bb65-916774fab8db\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tt5rp" Sep 18 21:07:53.673611 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:53.673593 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f721584-d286-4964-bb65-916774fab8db-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-tt5rp\" (UID: \"6f721584-d286-4964-bb65-916774fab8db\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tt5rp" Sep 18 21:07:53.715529 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:53.715494 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tt5rp" Sep 18 21:07:53.772397 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:53.771950 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1d3f40-3c78-4465-aa1f-e684e23455cf-registry-tls\") pod \"image-registry-c8c458dcf-wvcqd\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" Sep 18 21:07:53.775345 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:53.775322 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1d3f40-3c78-4465-aa1f-e684e23455cf-registry-tls\") pod \"image-registry-c8c458dcf-wvcqd\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" Sep 18 21:07:53.845036 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:53.844973 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" Sep 18 21:07:53.856973 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:53.856941 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hv96v"] Sep 18 21:07:53.992056 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:53.992022 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tt5rp"] Sep 18 21:07:53.994809 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:07:53.994782 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f721584_d286_4964_bb65_916774fab8db.slice/crio-1109b9ce8721e1aa69adfeb2da10be1e7a3199f77e47c5b40b71fa743724b98f WatchSource:0}: Error finding container 1109b9ce8721e1aa69adfeb2da10be1e7a3199f77e47c5b40b71fa743724b98f: Status 404 returned error can't find the container with id 1109b9ce8721e1aa69adfeb2da10be1e7a3199f77e47c5b40b71fa743724b98f Sep 18 21:07:54.119020 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:54.118811 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c8c458dcf-wvcqd"] Sep 18 21:07:54.121392 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:07:54.121367 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce1d3f40_3c78_4465_aa1f_e684e23455cf.slice/crio-ceb1a4d78d711c5077fbbdc59fe9e8a6adad427a73e84fb6d41172bd0d107259 WatchSource:0}: Error finding container ceb1a4d78d711c5077fbbdc59fe9e8a6adad427a73e84fb6d41172bd0d107259: Status 404 returned error can't find the container with id ceb1a4d78d711c5077fbbdc59fe9e8a6adad427a73e84fb6d41172bd0d107259 Sep 18 21:07:54.751042 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:54.750996 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" event={"ID":"ce1d3f40-3c78-4465-aa1f-e684e23455cf","Type":"ContainerStarted","Data":"0e570df481c95897d4b6d99ce8cca4b2732becbb2cec6b8c814bcc7e42fad551"} Sep 18 21:07:54.751488 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:54.751056 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" event={"ID":"ce1d3f40-3c78-4465-aa1f-e684e23455cf","Type":"ContainerStarted","Data":"ceb1a4d78d711c5077fbbdc59fe9e8a6adad427a73e84fb6d41172bd0d107259"} Sep 18 21:07:54.751488 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:54.751101 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" Sep 18 21:07:54.753175 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:54.753121 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tt5rp" event={"ID":"6f721584-d286-4964-bb65-916774fab8db","Type":"ContainerStarted","Data":"1109b9ce8721e1aa69adfeb2da10be1e7a3199f77e47c5b40b71fa743724b98f"} Sep 18 21:07:54.754738 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:54.754674 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hv96v" event={"ID":"cb2bb290-f144-43d4-84af-1d631c5edd08","Type":"ContainerStarted","Data":"b0b7f872f2c24ef2336f950c21124716011fb809bcbd1bb359efe5416113323f"} Sep 18 21:07:54.777340 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:54.777284 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" podStartSLOduration=17.777261841 podStartE2EDuration="17.777261841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:07:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:07:54.776991034 +0000 UTC m=+113.997103433" watchObservedRunningTime="2026-09-18 21:07:54.777261841 +0000 UTC m=+113.997374231" Sep 18 21:07:56.768278 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:56.768236 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hv96v" event={"ID":"cb2bb290-f144-43d4-84af-1d631c5edd08","Type":"ContainerStarted","Data":"d80c1aeb6861e6a8f8b017eaecffeb7abac3cf5af699f88197f27cfb638ae5fb"} Sep 18 21:07:56.768738 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:56.768301 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hv96v" event={"ID":"cb2bb290-f144-43d4-84af-1d631c5edd08","Type":"ContainerStarted","Data":"40c85f1548700d028bc0a4bf0bed67cf70ad06e961b33fc567049239a347dea8"} Sep 18 21:07:56.769640 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:56.769617 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tt5rp" event={"ID":"6f721584-d286-4964-bb65-916774fab8db","Type":"ContainerStarted","Data":"d542b273f2d07c623cda2d2aa55b1963477ecc5bc95c6b764589038a9a20c4e7"} Sep 18 21:07:56.790566 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:56.790521 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hv96v" podStartSLOduration=17.699921965 podStartE2EDuration="19.790504097s" totalImagesPullingTime="2.090582132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:07:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:07:56.789770917 +0000 UTC m=+116.009883306" watchObservedRunningTime="2026-09-18 21:07:56.790504097 +0000 UTC m=+116.010616488" Sep 18 21:07:56.806912 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:56.806875 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-tt5rp" podStartSLOduration=17.818481875 podStartE2EDuration="19.806859393s" totalImagesPullingTime="1.988377518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:07:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:07:56.8062457 +0000 UTC m=+116.026358088" watchObservedRunningTime="2026-09-18 21:07:56.806859393 +0000 UTC m=+116.026971824" Sep 18 21:07:57.404570 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:57.404515 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/512251b1-b84f-4a85-990d-dfe424c05143-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x2gp6\" (UID: \"512251b1-b84f-4a85-990d-dfe424c05143\") " pod="openshift-insights/insights-runtime-extractor-x2gp6" Sep 18 21:07:57.404757 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:57.404595 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/512251b1-b84f-4a85-990d-dfe424c05143-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2gp6\" (UID: \"512251b1-b84f-4a85-990d-dfe424c05143\") " pod="openshift-insights/insights-runtime-extractor-x2gp6" Sep 18 21:07:57.408612 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:57.405677 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/512251b1-b84f-4a85-990d-dfe424c05143-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x2gp6\" (UID: \"512251b1-b84f-4a85-990d-dfe424c05143\") " pod="openshift-insights/insights-runtime-extractor-x2gp6" Sep 18 21:07:57.409352 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:57.409334 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/512251b1-b84f-4a85-990d-dfe424c05143-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2gp6\" (UID: \"512251b1-b84f-4a85-990d-dfe424c05143\") " pod="openshift-insights/insights-runtime-extractor-x2gp6" Sep 18 21:07:57.527013 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:57.526964 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x2gp6" Sep 18 21:07:57.806885 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:57.806853 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x2gp6"] Sep 18 21:07:57.810298 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:07:57.810272 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod512251b1_b84f_4a85_990d_dfe424c05143.slice/crio-ccf2be8f68e575601e9f89946ab51688aec38ee3cd37c3634272bdbf5bd07ae8 WatchSource:0}: Error finding container ccf2be8f68e575601e9f89946ab51688aec38ee3cd37c3634272bdbf5bd07ae8: Status 404 returned error can't find the container with id ccf2be8f68e575601e9f89946ab51688aec38ee3cd37c3634272bdbf5bd07ae8 Sep 18 21:07:58.778890 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:58.778848 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x2gp6" event={"ID":"512251b1-b84f-4a85-990d-dfe424c05143","Type":"ContainerStarted","Data":"92e9bc15665bdff01c59cada76c8b40a461e120dfce7c0dade6d1ffb7d1c1e28"} Sep 18 21:07:58.779024 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:58.778905 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x2gp6" event={"ID":"512251b1-b84f-4a85-990d-dfe424c05143","Type":"ContainerStarted","Data":"84c2265cc5e52d479cc39373b7e53496c11056aa435b9237f958922d48b56d32"} Sep 18 21:07:58.779024 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:58.778923 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x2gp6" event={"ID":"512251b1-b84f-4a85-990d-dfe424c05143","Type":"ContainerStarted","Data":"ccf2be8f68e575601e9f89946ab51688aec38ee3cd37c3634272bdbf5bd07ae8"} Sep 18 21:07:59.784003 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:59.783973 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x2gp6" event={"ID":"512251b1-b84f-4a85-990d-dfe424c05143","Type":"ContainerStarted","Data":"926403c6541426fe2bfb06e6abba455beed8db6e0203c2b1a5df152f49d1d0d0"} Sep 18 21:07:59.806975 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:07:59.806932 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-x2gp6" podStartSLOduration=17.037473479 podStartE2EDuration="18.806917218s" totalImagesPullingTime="1.769443739s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:07:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:07:59.805649465 +0000 UTC m=+119.025761853" watchObservedRunningTime="2026-09-18 21:07:59.806917218 +0000 UTC m=+119.027029606" Sep 18 21:08:06.014911 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:06.014860 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-857c77bf8d-65zqs"] Sep 18 21:08:06.018701 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:06.018677 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-857c77bf8d-65zqs" Sep 18 21:08:06.022788 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:06.022767 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 18 21:08:06.023433 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:06.023397 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 18 21:08:06.024099 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:06.024072 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 18 21:08:06.024271 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:06.024122 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 18 21:08:06.060326 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:06.060290 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-857c77bf8d-65zqs"] Sep 18 21:08:06.067880 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:06.067854 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45d5850c-5576-4c0e-8255-c51ed23ae75e-tmp\") pod \"klusterlet-addon-workmgr-857c77bf8d-65zqs\" (UID: \"45d5850c-5576-4c0e-8255-c51ed23ae75e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-857c77bf8d-65zqs" Sep 18 21:08:06.068029 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:06.067917 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/45d5850c-5576-4c0e-8255-c51ed23ae75e-klusterlet-config\") pod \"klusterlet-addon-workmgr-857c77bf8d-65zqs\" (UID: \"45d5850c-5576-4c0e-8255-c51ed23ae75e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-857c77bf8d-65zqs" Sep 18 21:08:06.068029 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:06.068011 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xn7z\" (UniqueName: \"kubernetes.io/projected/45d5850c-5576-4c0e-8255-c51ed23ae75e-kube-api-access-6xn7z\") pod \"klusterlet-addon-workmgr-857c77bf8d-65zqs\" (UID: \"45d5850c-5576-4c0e-8255-c51ed23ae75e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-857c77bf8d-65zqs" Sep 18 21:08:06.131320 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:06.131287 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c8c458dcf-wvcqd"] Sep 18 21:08:06.158710 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:06.158682 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6594f4c75-65mfq"] Sep 18 21:08:06.160879 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:06.160864 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-65mfq" Sep 18 21:08:06.166950 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:06.166851 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 18 21:08:06.167411 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:06.167390 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-2h2cl\"" Sep 18 21:08:06.167516 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:06.167413 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 18 21:08:06.168578 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:06.168557 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45d5850c-5576-4c0e-8255-c51ed23ae75e-tmp\") pod \"klusterlet-addon-workmgr-857c77bf8d-65zqs\" (UID: \"45d5850c-5576-4c0e-8255-c51ed23ae75e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-857c77bf8d-65zqs" Sep 18 21:08:06.168667 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:06.168615 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/45d5850c-5576-4c0e-8255-c51ed23ae75e-klusterlet-config\") pod \"klusterlet-addon-workmgr-857c77bf8d-65zqs\" (UID: \"45d5850c-5576-4c0e-8255-c51ed23ae75e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-857c77bf8d-65zqs" Sep 18 21:08:06.168667 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:06.168643 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xn7z\" (UniqueName: \"kubernetes.io/projected/45d5850c-5576-4c0e-8255-c51ed23ae75e-kube-api-access-6xn7z\") pod \"klusterlet-addon-workmgr-857c77bf8d-65zqs\" (UID: \"45d5850c-5576-4c0e-8255-c51ed23ae75e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-857c77bf8d-65zqs" Sep 18 21:08:06.168934 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:06.168917 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45d5850c-5576-4c0e-8255-c51ed23ae75e-tmp\") pod \"klusterlet-addon-workmgr-857c77bf8d-65zqs\" (UID: \"45d5850c-5576-4c0e-8255-c51ed23ae75e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-857c77bf8d-65zqs" Sep 18 21:08:06.171136 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:06.171117 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/45d5850c-5576-4c0e-8255-c51ed23ae75e-klusterlet-config\") pod \"klusterlet-addon-workmgr-857c77bf8d-65zqs\" (UID: \"45d5850c-5576-4c0e-8255-c51ed23ae75e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-857c77bf8d-65zqs" Sep 18 21:08:06.181841 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:06.181812 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-65mfq"] Sep 18 21:08:06.203841 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:06.203806 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xn7z\" (UniqueName: \"kubernetes.io/projected/45d5850c-5576-4c0e-8255-c51ed23ae75e-kube-api-access-6xn7z\") pod \"klusterlet-addon-workmgr-857c77bf8d-65zqs\" (UID: \"45d5850c-5576-4c0e-8255-c51ed23ae75e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-857c77bf8d-65zqs" Sep 18 21:08:06.269009 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:06.268920 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7hk2\" (UniqueName: \"kubernetes.io/projected/dbb189f6-362a-4c49-8e96-67f01b1ff430-kube-api-access-z7hk2\") pod \"downloads-6594f4c75-65mfq\" (UID: \"dbb189f6-362a-4c49-8e96-67f01b1ff430\") " pod="openshift-console/downloads-6594f4c75-65mfq" Sep 18 21:08:06.327495 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:06.327458 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-857c77bf8d-65zqs" Sep 18 21:08:06.369972 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:06.369916 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7hk2\" (UniqueName: \"kubernetes.io/projected/dbb189f6-362a-4c49-8e96-67f01b1ff430-kube-api-access-z7hk2\") pod \"downloads-6594f4c75-65mfq\" (UID: \"dbb189f6-362a-4c49-8e96-67f01b1ff430\") " pod="openshift-console/downloads-6594f4c75-65mfq" Sep 18 21:08:06.382068 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:06.382023 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7hk2\" (UniqueName: \"kubernetes.io/projected/dbb189f6-362a-4c49-8e96-67f01b1ff430-kube-api-access-z7hk2\") pod \"downloads-6594f4c75-65mfq\" (UID: \"dbb189f6-362a-4c49-8e96-67f01b1ff430\") " pod="openshift-console/downloads-6594f4c75-65mfq" Sep 18 21:08:06.469309 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:06.469274 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-65mfq" Sep 18 21:08:06.620969 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:06.620899 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-857c77bf8d-65zqs"] Sep 18 21:08:06.623660 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:08:06.623634 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45d5850c_5576_4c0e_8255_c51ed23ae75e.slice/crio-d384ebaff5010a276bc188464a96e1d48f99b6f9e46447c71d661b118e916984 WatchSource:0}: Error finding container d384ebaff5010a276bc188464a96e1d48f99b6f9e46447c71d661b118e916984: Status 404 returned error can't find the container with id d384ebaff5010a276bc188464a96e1d48f99b6f9e46447c71d661b118e916984 Sep 18 21:08:06.745910 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:06.745881 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-65mfq"] Sep 18 21:08:06.748795 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:08:06.748760 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbb189f6_362a_4c49_8e96_67f01b1ff430.slice/crio-4b9359b7db9a7e891a245b92b983f49136d06e6ec09a45966d4eab0d8d91a935 WatchSource:0}: Error finding container 4b9359b7db9a7e891a245b92b983f49136d06e6ec09a45966d4eab0d8d91a935: Status 404 returned error can't find the container with id 4b9359b7db9a7e891a245b92b983f49136d06e6ec09a45966d4eab0d8d91a935 Sep 18 21:08:06.807530 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:06.807490 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-65mfq" event={"ID":"dbb189f6-362a-4c49-8e96-67f01b1ff430","Type":"ContainerStarted","Data":"4b9359b7db9a7e891a245b92b983f49136d06e6ec09a45966d4eab0d8d91a935"} Sep 18 21:08:06.808680 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:06.808652 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-857c77bf8d-65zqs" event={"ID":"45d5850c-5576-4c0e-8255-c51ed23ae75e","Type":"ContainerStarted","Data":"d384ebaff5010a276bc188464a96e1d48f99b6f9e46447c71d661b118e916984"} Sep 18 21:08:09.602925 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:09.602882 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-2xl8t"] Sep 18 21:08:09.606018 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:09.605989 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2xl8t" Sep 18 21:08:09.611580 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:09.611320 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 18 21:08:09.611580 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:09.611362 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 18 21:08:09.611580 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:09.611382 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 18 21:08:09.611580 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:09.611471 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-7p69s\"" Sep 18 21:08:09.616141 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:09.616116 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-2xl8t"] Sep 18 21:08:09.698202 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:09.698140 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/977132de-47da-4600-bfb4-a8d90bab8408-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-2xl8t\" (UID: \"977132de-47da-4600-bfb4-a8d90bab8408\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2xl8t" Sep 18 21:08:09.698387 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:09.698233 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/977132de-47da-4600-bfb4-a8d90bab8408-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-2xl8t\" (UID: \"977132de-47da-4600-bfb4-a8d90bab8408\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2xl8t" Sep 18 21:08:09.698387 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:09.698290 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/977132de-47da-4600-bfb4-a8d90bab8408-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-2xl8t\" (UID: \"977132de-47da-4600-bfb4-a8d90bab8408\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2xl8t" Sep 18 21:08:09.698387 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:09.698346 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdn7z\" (UniqueName: \"kubernetes.io/projected/977132de-47da-4600-bfb4-a8d90bab8408-kube-api-access-kdn7z\") pod \"prometheus-operator-7bd5d56d6-2xl8t\" (UID: \"977132de-47da-4600-bfb4-a8d90bab8408\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2xl8t" Sep 18 21:08:09.799024 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:09.798992 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/977132de-47da-4600-bfb4-a8d90bab8408-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-2xl8t\" (UID: \"977132de-47da-4600-bfb4-a8d90bab8408\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2xl8t" Sep 18 21:08:09.799256 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:09.799034 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/977132de-47da-4600-bfb4-a8d90bab8408-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-2xl8t\" (UID: \"977132de-47da-4600-bfb4-a8d90bab8408\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2xl8t" Sep 18 21:08:09.799256 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:09.799081 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/977132de-47da-4600-bfb4-a8d90bab8408-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-2xl8t\" (UID: \"977132de-47da-4600-bfb4-a8d90bab8408\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2xl8t" Sep 18 21:08:09.799256 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:09.799116 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdn7z\" (UniqueName: \"kubernetes.io/projected/977132de-47da-4600-bfb4-a8d90bab8408-kube-api-access-kdn7z\") pod \"prometheus-operator-7bd5d56d6-2xl8t\" (UID: \"977132de-47da-4600-bfb4-a8d90bab8408\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2xl8t" Sep 18 21:08:09.800376 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:09.800325 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/977132de-47da-4600-bfb4-a8d90bab8408-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-2xl8t\" (UID: \"977132de-47da-4600-bfb4-a8d90bab8408\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2xl8t" Sep 18 21:08:09.804757 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:09.804693 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/977132de-47da-4600-bfb4-a8d90bab8408-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-2xl8t\" (UID: \"977132de-47da-4600-bfb4-a8d90bab8408\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2xl8t" Sep 18 21:08:09.807184 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:09.807118 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/977132de-47da-4600-bfb4-a8d90bab8408-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-2xl8t\" (UID: \"977132de-47da-4600-bfb4-a8d90bab8408\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2xl8t" Sep 18 21:08:09.810682 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:09.810658 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdn7z\" (UniqueName: \"kubernetes.io/projected/977132de-47da-4600-bfb4-a8d90bab8408-kube-api-access-kdn7z\") pod \"prometheus-operator-7bd5d56d6-2xl8t\" (UID: \"977132de-47da-4600-bfb4-a8d90bab8408\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2xl8t" Sep 18 21:08:09.919776 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:09.919690 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2xl8t" Sep 18 21:08:10.828048 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:10.828000 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-857c77bf8d-65zqs" event={"ID":"45d5850c-5576-4c0e-8255-c51ed23ae75e","Type":"ContainerStarted","Data":"f922ac621c6cd0f157cc70bdf2a8c0c250f12a8bbdbde8d01dcb8841dec67a88"} Sep 18 21:08:10.828481 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:10.828271 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-857c77bf8d-65zqs" Sep 18 21:08:10.829575 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:10.829452 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-857c77bf8d-65zqs" podUID="45d5850c-5576-4c0e-8255-c51ed23ae75e" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.15:8000/readyz\": dial tcp 10.133.0.15:8000: connect: connection refused" Sep 18 21:08:10.846699 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:10.846651 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-857c77bf8d-65zqs" podStartSLOduration=1.725304328 podStartE2EDuration="5.846636084s" totalImagesPullingTime="4.121331756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:08:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:08:10.845828388 +0000 UTC m=+130.065940798" watchObservedRunningTime="2026-09-18 21:08:10.846636084 +0000 UTC m=+130.066748472" Sep 18 21:08:10.942609 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:10.942584 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-2xl8t"] Sep 18 21:08:10.944607 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:08:10.944569 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod977132de_47da_4600_bfb4_a8d90bab8408.slice/crio-8b80982087a6a0289fbd1d3801aea1818762d746d8d9750a7501fab2da5bdb14 WatchSource:0}: Error finding container 8b80982087a6a0289fbd1d3801aea1818762d746d8d9750a7501fab2da5bdb14: Status 404 returned error can't find the container with id 8b80982087a6a0289fbd1d3801aea1818762d746d8d9750a7501fab2da5bdb14 Sep 18 21:08:11.017111 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:11.017080 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b7697c4-d541-409e-8863-71a4142610e7-metrics-certs\") pod \"network-metrics-daemon-hxmc5\" (UID: \"1b7697c4-d541-409e-8863-71a4142610e7\") " pod="openshift-multus/network-metrics-daemon-hxmc5" Sep 18 21:08:11.019819 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:11.019784 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b7697c4-d541-409e-8863-71a4142610e7-metrics-certs\") pod \"network-metrics-daemon-hxmc5\" (UID: \"1b7697c4-d541-409e-8863-71a4142610e7\") " pod="openshift-multus/network-metrics-daemon-hxmc5" Sep 18 21:08:11.076596 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:11.076558 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pzg28\"" Sep 18 21:08:11.083944 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:11.083913 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hxmc5" Sep 18 21:08:11.385194 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:11.385169 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hxmc5"] Sep 18 21:08:11.388190 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:08:11.388143 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b7697c4_d541_409e_8863_71a4142610e7.slice/crio-7491a1e76ca1c40548df149d2289b4184e74467a04ed8d0929b458b7bed7cf9b WatchSource:0}: Error finding container 7491a1e76ca1c40548df149d2289b4184e74467a04ed8d0929b458b7bed7cf9b: Status 404 returned error can't find the container with id 7491a1e76ca1c40548df149d2289b4184e74467a04ed8d0929b458b7bed7cf9b Sep 18 21:08:11.833406 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:11.833374 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2xl8t" event={"ID":"977132de-47da-4600-bfb4-a8d90bab8408","Type":"ContainerStarted","Data":"8b80982087a6a0289fbd1d3801aea1818762d746d8d9750a7501fab2da5bdb14"} Sep 18 21:08:11.834742 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:11.834708 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hxmc5" event={"ID":"1b7697c4-d541-409e-8863-71a4142610e7","Type":"ContainerStarted","Data":"7491a1e76ca1c40548df149d2289b4184e74467a04ed8d0929b458b7bed7cf9b"} Sep 18 21:08:11.836200 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:11.836181 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-857c77bf8d-65zqs" Sep 18 21:08:12.840361 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:12.840319 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2xl8t" event={"ID":"977132de-47da-4600-bfb4-a8d90bab8408","Type":"ContainerStarted","Data":"4172a0a331c076d562cfd0bbd6a58fc50b6ef5e3862b8fe08ae0607ce564a9f2"} Sep 18 21:08:12.840754 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:12.840382 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2xl8t" event={"ID":"977132de-47da-4600-bfb4-a8d90bab8408","Type":"ContainerStarted","Data":"82c4e96ca44b572cb5f5cbe7e5f49d605f0f6707cb51fbd18c472612b9904bba"} Sep 18 21:08:12.862583 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:12.862534 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2xl8t" podStartSLOduration=2.568429448 podStartE2EDuration="3.862516176s" totalImagesPullingTime="1.294086728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:08:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:08:12.861223049 +0000 UTC m=+132.081335436" watchObservedRunningTime="2026-09-18 21:08:12.862516176 +0000 UTC m=+132.082628563" Sep 18 21:08:13.846856 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:13.846817 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hxmc5" event={"ID":"1b7697c4-d541-409e-8863-71a4142610e7","Type":"ContainerStarted","Data":"96fa3f612ccbd4a2e1978f7b3a9df7ab866a3aee71ef177247644661f679d420"} Sep 18 21:08:13.847310 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:13.846882 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hxmc5" event={"ID":"1b7697c4-d541-409e-8863-71a4142610e7","Type":"ContainerStarted","Data":"963e839d06fa5c6864703806a4bee1e7c8f8fd35c3c5559b839ea431045009fc"} Sep 18 21:08:13.868413 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:13.868365 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hxmc5" podStartSLOduration=130.803386144 podStartE2EDuration="2m12.86834528s" totalImagesPullingTime="2.064959136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:08:13.866435441 +0000 UTC m=+133.086547830" watchObservedRunningTime="2026-09-18 21:08:13.86834528 +0000 UTC m=+133.088457669" Sep 18 21:08:15.131725 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:15.131688 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6l67p"] Sep 18 21:08:15.135431 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:15.135411 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6l67p" Sep 18 21:08:15.141054 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:15.141036 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 18 21:08:15.142040 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:15.141819 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 18 21:08:15.142040 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:15.141857 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 18 21:08:15.142040 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:15.141865 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6tklw\"" Sep 18 21:08:15.252676 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:15.252640 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c4b5545a-71f2-4647-ac2b-ef870aa919c4-node-exporter-textfile\") pod \"node-exporter-6l67p\" (UID: \"c4b5545a-71f2-4647-ac2b-ef870aa919c4\") " pod="openshift-monitoring/node-exporter-6l67p" Sep 18 21:08:15.252865 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:15.252687 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6czb5\" (UniqueName: \"kubernetes.io/projected/c4b5545a-71f2-4647-ac2b-ef870aa919c4-kube-api-access-6czb5\") pod \"node-exporter-6l67p\" (UID: \"c4b5545a-71f2-4647-ac2b-ef870aa919c4\") " pod="openshift-monitoring/node-exporter-6l67p" Sep 18 21:08:15.252865 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:15.252708 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c4b5545a-71f2-4647-ac2b-ef870aa919c4-root\") pod \"node-exporter-6l67p\" (UID: \"c4b5545a-71f2-4647-ac2b-ef870aa919c4\") " pod="openshift-monitoring/node-exporter-6l67p" Sep 18 21:08:15.252865 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:15.252781 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4b5545a-71f2-4647-ac2b-ef870aa919c4-sys\") pod \"node-exporter-6l67p\" (UID: \"c4b5545a-71f2-4647-ac2b-ef870aa919c4\") " pod="openshift-monitoring/node-exporter-6l67p" Sep 18 21:08:15.253033 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:15.252870 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c4b5545a-71f2-4647-ac2b-ef870aa919c4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6l67p\" (UID: \"c4b5545a-71f2-4647-ac2b-ef870aa919c4\") " pod="openshift-monitoring/node-exporter-6l67p" Sep 18 21:08:15.253033 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:15.252909 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c4b5545a-71f2-4647-ac2b-ef870aa919c4-node-exporter-tls\") pod \"node-exporter-6l67p\" (UID: \"c4b5545a-71f2-4647-ac2b-ef870aa919c4\") " pod="openshift-monitoring/node-exporter-6l67p" Sep 18 21:08:15.253033 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:15.252957 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4b5545a-71f2-4647-ac2b-ef870aa919c4-metrics-client-ca\") pod \"node-exporter-6l67p\" (UID: \"c4b5545a-71f2-4647-ac2b-ef870aa919c4\") " pod="openshift-monitoring/node-exporter-6l67p" Sep 18 21:08:15.253033 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:15.252987 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c4b5545a-71f2-4647-ac2b-ef870aa919c4-node-exporter-accelerators-collector-config\") pod \"node-exporter-6l67p\" (UID: \"c4b5545a-71f2-4647-ac2b-ef870aa919c4\") " pod="openshift-monitoring/node-exporter-6l67p" Sep 18 21:08:15.253033 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:15.253025 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c4b5545a-71f2-4647-ac2b-ef870aa919c4-node-exporter-wtmp\") pod \"node-exporter-6l67p\" (UID: \"c4b5545a-71f2-4647-ac2b-ef870aa919c4\") " pod="openshift-monitoring/node-exporter-6l67p" Sep 18 21:08:15.353625 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:15.353590 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c4b5545a-71f2-4647-ac2b-ef870aa919c4-node-exporter-textfile\") pod \"node-exporter-6l67p\" (UID: \"c4b5545a-71f2-4647-ac2b-ef870aa919c4\") " pod="openshift-monitoring/node-exporter-6l67p" Sep 18 21:08:15.353803 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:15.353642 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6czb5\" (UniqueName: \"kubernetes.io/projected/c4b5545a-71f2-4647-ac2b-ef870aa919c4-kube-api-access-6czb5\") pod \"node-exporter-6l67p\" (UID: \"c4b5545a-71f2-4647-ac2b-ef870aa919c4\") " pod="openshift-monitoring/node-exporter-6l67p" Sep 18 21:08:15.353803 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:15.353664 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c4b5545a-71f2-4647-ac2b-ef870aa919c4-root\") pod \"node-exporter-6l67p\" (UID: \"c4b5545a-71f2-4647-ac2b-ef870aa919c4\") " pod="openshift-monitoring/node-exporter-6l67p" Sep 18 21:08:15.353803 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:15.353691 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4b5545a-71f2-4647-ac2b-ef870aa919c4-sys\") pod \"node-exporter-6l67p\" (UID: \"c4b5545a-71f2-4647-ac2b-ef870aa919c4\") " pod="openshift-monitoring/node-exporter-6l67p" Sep 18 21:08:15.353803 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:15.353721 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c4b5545a-71f2-4647-ac2b-ef870aa919c4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6l67p\" (UID: \"c4b5545a-71f2-4647-ac2b-ef870aa919c4\") " pod="openshift-monitoring/node-exporter-6l67p" Sep 18 21:08:15.353803 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:15.353749 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c4b5545a-71f2-4647-ac2b-ef870aa919c4-node-exporter-tls\") pod \"node-exporter-6l67p\" (UID: \"c4b5545a-71f2-4647-ac2b-ef870aa919c4\") " pod="openshift-monitoring/node-exporter-6l67p" Sep 18 21:08:15.353803 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:15.353785 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4b5545a-71f2-4647-ac2b-ef870aa919c4-metrics-client-ca\") pod \"node-exporter-6l67p\" (UID: \"c4b5545a-71f2-4647-ac2b-ef870aa919c4\") " pod="openshift-monitoring/node-exporter-6l67p" Sep 18 21:08:15.354109 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:15.353809 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4b5545a-71f2-4647-ac2b-ef870aa919c4-sys\") pod \"node-exporter-6l67p\" (UID: \"c4b5545a-71f2-4647-ac2b-ef870aa919c4\") " pod="openshift-monitoring/node-exporter-6l67p" Sep 18 21:08:15.354109 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:15.353820 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c4b5545a-71f2-4647-ac2b-ef870aa919c4-root\") pod \"node-exporter-6l67p\" (UID: \"c4b5545a-71f2-4647-ac2b-ef870aa919c4\") " pod="openshift-monitoring/node-exporter-6l67p" Sep 18 21:08:15.354109 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:15.353811 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c4b5545a-71f2-4647-ac2b-ef870aa919c4-node-exporter-accelerators-collector-config\") pod \"node-exporter-6l67p\" (UID: \"c4b5545a-71f2-4647-ac2b-ef870aa919c4\") " pod="openshift-monitoring/node-exporter-6l67p" Sep 18 21:08:15.354109 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:15.353891 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c4b5545a-71f2-4647-ac2b-ef870aa919c4-node-exporter-wtmp\") pod \"node-exporter-6l67p\" (UID: \"c4b5545a-71f2-4647-ac2b-ef870aa919c4\") " pod="openshift-monitoring/node-exporter-6l67p" Sep 18 21:08:15.354109 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:15.353988 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c4b5545a-71f2-4647-ac2b-ef870aa919c4-node-exporter-textfile\") pod \"node-exporter-6l67p\" (UID: \"c4b5545a-71f2-4647-ac2b-ef870aa919c4\") " pod="openshift-monitoring/node-exporter-6l67p" Sep 18 21:08:15.354109 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:15.354093 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c4b5545a-71f2-4647-ac2b-ef870aa919c4-node-exporter-wtmp\") pod \"node-exporter-6l67p\" (UID: \"c4b5545a-71f2-4647-ac2b-ef870aa919c4\") " pod="openshift-monitoring/node-exporter-6l67p" Sep 18 21:08:15.354426 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:15.354400 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c4b5545a-71f2-4647-ac2b-ef870aa919c4-node-exporter-accelerators-collector-config\") pod \"node-exporter-6l67p\" (UID: \"c4b5545a-71f2-4647-ac2b-ef870aa919c4\") " pod="openshift-monitoring/node-exporter-6l67p" Sep 18 21:08:15.354483 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:15.354467 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4b5545a-71f2-4647-ac2b-ef870aa919c4-metrics-client-ca\") pod \"node-exporter-6l67p\" (UID: \"c4b5545a-71f2-4647-ac2b-ef870aa919c4\") " pod="openshift-monitoring/node-exporter-6l67p" Sep 18 21:08:15.356942 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:15.356900 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c4b5545a-71f2-4647-ac2b-ef870aa919c4-node-exporter-tls\") pod \"node-exporter-6l67p\" (UID: \"c4b5545a-71f2-4647-ac2b-ef870aa919c4\") " pod="openshift-monitoring/node-exporter-6l67p" Sep 18 21:08:15.356942 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:15.356940 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c4b5545a-71f2-4647-ac2b-ef870aa919c4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6l67p\" (UID: \"c4b5545a-71f2-4647-ac2b-ef870aa919c4\") " pod="openshift-monitoring/node-exporter-6l67p" Sep 18 21:08:15.367792 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:15.367768 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6czb5\" (UniqueName: \"kubernetes.io/projected/c4b5545a-71f2-4647-ac2b-ef870aa919c4-kube-api-access-6czb5\") pod \"node-exporter-6l67p\" (UID: \"c4b5545a-71f2-4647-ac2b-ef870aa919c4\") " pod="openshift-monitoring/node-exporter-6l67p" Sep 18 21:08:15.446879 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:15.446813 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6l67p" Sep 18 21:08:15.474180 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:08:15.467378 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4b5545a_71f2_4647_ac2b_ef870aa919c4.slice/crio-84a30b3f538f5adbb24cf1cafc74a975211af8931d8c7561471da5e32b18f858 WatchSource:0}: Error finding container 84a30b3f538f5adbb24cf1cafc74a975211af8931d8c7561471da5e32b18f858: Status 404 returned error can't find the container with id 84a30b3f538f5adbb24cf1cafc74a975211af8931d8c7561471da5e32b18f858 Sep 18 21:08:15.856492 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:15.856417 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6l67p" event={"ID":"c4b5545a-71f2-4647-ac2b-ef870aa919c4","Type":"ContainerStarted","Data":"84a30b3f538f5adbb24cf1cafc74a975211af8931d8c7561471da5e32b18f858"} Sep 18 21:08:16.138678 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.138594 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" Sep 18 21:08:16.162975 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.162945 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 21:08:16.168900 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.168874 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.174928 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.172599 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 18 21:08:16.174928 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.172829 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 18 21:08:16.174928 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.172919 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 18 21:08:16.174928 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.172962 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bq8vk\"" Sep 18 21:08:16.174928 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.172858 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 18 21:08:16.174928 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.173245 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 18 21:08:16.174928 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.173474 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 18 21:08:16.174928 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.173671 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 18 21:08:16.174928 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.173753 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 18 21:08:16.174928 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.174338 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 18 21:08:16.187306 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.187217 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 21:08:16.261306 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.261269 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.261480 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.261314 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-config-volume\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.261480 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.261349 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f8015b31-a308-44de-9299-3acb68d58104-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.261480 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.261380 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvch5\" (UniqueName: \"kubernetes.io/projected/f8015b31-a308-44de-9299-3acb68d58104-kube-api-access-tvch5\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.261480 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.261406 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.261480 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.261452 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8015b31-a308-44de-9299-3acb68d58104-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.261739 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.261476 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.261739 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.261523 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.261739 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.261552 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f8015b31-a308-44de-9299-3acb68d58104-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.261739 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.261588 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8015b31-a308-44de-9299-3acb68d58104-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.261739 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.261628 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.261739 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.261656 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f8015b31-a308-44de-9299-3acb68d58104-config-out\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.261739 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.261685 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-web-config\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.362549 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.362508 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.362716 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.362564 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f8015b31-a308-44de-9299-3acb68d58104-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.362716 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.362599 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8015b31-a308-44de-9299-3acb68d58104-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.362716 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.362659 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.362716 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.362688 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f8015b31-a308-44de-9299-3acb68d58104-config-out\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.362868 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.362716 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-web-config\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.362868 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.362756 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.362868 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.362786 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-config-volume\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.362868 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.362819 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f8015b31-a308-44de-9299-3acb68d58104-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.362868 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.362850 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvch5\" (UniqueName: \"kubernetes.io/projected/f8015b31-a308-44de-9299-3acb68d58104-kube-api-access-tvch5\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.363116 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.362876 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.363116 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.362921 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8015b31-a308-44de-9299-3acb68d58104-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.363116 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.362941 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.364638 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.364605 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8015b31-a308-44de-9299-3acb68d58104-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.366049 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.365414 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8015b31-a308-44de-9299-3acb68d58104-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.366625 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.366352 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f8015b31-a308-44de-9299-3acb68d58104-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.367041 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.366941 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.367389 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.367339 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-config-volume\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.367476 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.367443 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.367544 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.367505 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.368508 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.368482 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f8015b31-a308-44de-9299-3acb68d58104-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.368891 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.368871 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.369240 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.369199 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.369435 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.369415 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f8015b31-a308-44de-9299-3acb68d58104-config-out\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.370081 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.370064 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-web-config\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.374213 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.374192 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvch5\" (UniqueName: \"kubernetes.io/projected/f8015b31-a308-44de-9299-3acb68d58104-kube-api-access-tvch5\") pod \"alertmanager-main-0\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.486148 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.485961 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:08:16.793358 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.793323 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 21:08:16.865314 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.865277 2581 generic.go:356] "Generic (PLEG): container finished" podID="c4b5545a-71f2-4647-ac2b-ef870aa919c4" containerID="d7b15d94ef01a0297ffb14f24bc2fea56a504d526d77e846c5e516dc393af984" exitCode=0 Sep 18 21:08:16.865473 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:16.865358 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6l67p" event={"ID":"c4b5545a-71f2-4647-ac2b-ef870aa919c4","Type":"ContainerDied","Data":"d7b15d94ef01a0297ffb14f24bc2fea56a504d526d77e846c5e516dc393af984"} Sep 18 21:08:17.624535 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:17.624460 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77d7fd98fb-hb9gs"] Sep 18 21:08:17.628853 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:17.628827 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77d7fd98fb-hb9gs" Sep 18 21:08:17.632364 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:17.632335 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 18 21:08:17.632486 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:17.632346 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 18 21:08:17.632640 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:17.632621 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 18 21:08:17.633781 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:17.633760 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 18 21:08:17.636363 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:17.636337 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 18 21:08:17.636363 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:17.636358 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mt5tq\"" Sep 18 21:08:17.640571 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:17.640554 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 18 21:08:17.641622 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:17.641602 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77d7fd98fb-hb9gs"] Sep 18 21:08:17.778276 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:17.778243 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9bf43279-386a-4526-af8d-eb9981658d54-console-serving-cert\") pod \"console-77d7fd98fb-hb9gs\" (UID: \"9bf43279-386a-4526-af8d-eb9981658d54\") " pod="openshift-console/console-77d7fd98fb-hb9gs" Sep 18 21:08:17.778276 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:17.778280 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g54dp\" (UniqueName: \"kubernetes.io/projected/9bf43279-386a-4526-af8d-eb9981658d54-kube-api-access-g54dp\") pod \"console-77d7fd98fb-hb9gs\" (UID: \"9bf43279-386a-4526-af8d-eb9981658d54\") " pod="openshift-console/console-77d7fd98fb-hb9gs" Sep 18 21:08:17.778488 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:17.778312 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9bf43279-386a-4526-af8d-eb9981658d54-oauth-serving-cert\") pod \"console-77d7fd98fb-hb9gs\" (UID: \"9bf43279-386a-4526-af8d-eb9981658d54\") " pod="openshift-console/console-77d7fd98fb-hb9gs" Sep 18 21:08:17.778488 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:17.778457 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bf43279-386a-4526-af8d-eb9981658d54-trusted-ca-bundle\") pod \"console-77d7fd98fb-hb9gs\" (UID: \"9bf43279-386a-4526-af8d-eb9981658d54\") " pod="openshift-console/console-77d7fd98fb-hb9gs" Sep 18 21:08:17.778575 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:17.778493 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9bf43279-386a-4526-af8d-eb9981658d54-console-oauth-config\") pod \"console-77d7fd98fb-hb9gs\" (UID: \"9bf43279-386a-4526-af8d-eb9981658d54\") " pod="openshift-console/console-77d7fd98fb-hb9gs" Sep 18 21:08:17.778575 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:17.778517 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9bf43279-386a-4526-af8d-eb9981658d54-console-config\") pod \"console-77d7fd98fb-hb9gs\" (UID: \"9bf43279-386a-4526-af8d-eb9981658d54\") " pod="openshift-console/console-77d7fd98fb-hb9gs" Sep 18 21:08:17.778575 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:17.778545 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9bf43279-386a-4526-af8d-eb9981658d54-service-ca\") pod \"console-77d7fd98fb-hb9gs\" (UID: \"9bf43279-386a-4526-af8d-eb9981658d54\") " pod="openshift-console/console-77d7fd98fb-hb9gs" Sep 18 21:08:17.879457 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:17.879374 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bf43279-386a-4526-af8d-eb9981658d54-trusted-ca-bundle\") pod \"console-77d7fd98fb-hb9gs\" (UID: \"9bf43279-386a-4526-af8d-eb9981658d54\") " pod="openshift-console/console-77d7fd98fb-hb9gs" Sep 18 21:08:17.879457 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:17.879420 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9bf43279-386a-4526-af8d-eb9981658d54-console-oauth-config\") pod \"console-77d7fd98fb-hb9gs\" (UID: \"9bf43279-386a-4526-af8d-eb9981658d54\") " pod="openshift-console/console-77d7fd98fb-hb9gs" Sep 18 21:08:17.879457 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:17.879437 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9bf43279-386a-4526-af8d-eb9981658d54-console-config\") pod \"console-77d7fd98fb-hb9gs\" (UID: \"9bf43279-386a-4526-af8d-eb9981658d54\") " pod="openshift-console/console-77d7fd98fb-hb9gs" Sep 18 21:08:17.879729 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:17.879476 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9bf43279-386a-4526-af8d-eb9981658d54-service-ca\") pod \"console-77d7fd98fb-hb9gs\" (UID: \"9bf43279-386a-4526-af8d-eb9981658d54\") " pod="openshift-console/console-77d7fd98fb-hb9gs" Sep 18 21:08:17.879729 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:17.879520 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9bf43279-386a-4526-af8d-eb9981658d54-console-serving-cert\") pod \"console-77d7fd98fb-hb9gs\" (UID: \"9bf43279-386a-4526-af8d-eb9981658d54\") " pod="openshift-console/console-77d7fd98fb-hb9gs" Sep 18 21:08:17.879729 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:17.879545 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g54dp\" (UniqueName: \"kubernetes.io/projected/9bf43279-386a-4526-af8d-eb9981658d54-kube-api-access-g54dp\") pod \"console-77d7fd98fb-hb9gs\" (UID: \"9bf43279-386a-4526-af8d-eb9981658d54\") " pod="openshift-console/console-77d7fd98fb-hb9gs" Sep 18 21:08:17.879729 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:17.879567 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9bf43279-386a-4526-af8d-eb9981658d54-oauth-serving-cert\") pod \"console-77d7fd98fb-hb9gs\" (UID: \"9bf43279-386a-4526-af8d-eb9981658d54\") " pod="openshift-console/console-77d7fd98fb-hb9gs" Sep 18 21:08:17.880323 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:17.880298 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9bf43279-386a-4526-af8d-eb9981658d54-service-ca\") pod \"console-77d7fd98fb-hb9gs\" (UID: \"9bf43279-386a-4526-af8d-eb9981658d54\") " pod="openshift-console/console-77d7fd98fb-hb9gs" Sep 18 21:08:17.880445 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:17.880422 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9bf43279-386a-4526-af8d-eb9981658d54-oauth-serving-cert\") pod \"console-77d7fd98fb-hb9gs\" (UID: \"9bf43279-386a-4526-af8d-eb9981658d54\") " pod="openshift-console/console-77d7fd98fb-hb9gs" Sep 18 21:08:17.880511 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:17.880422 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9bf43279-386a-4526-af8d-eb9981658d54-console-config\") pod \"console-77d7fd98fb-hb9gs\" (UID: \"9bf43279-386a-4526-af8d-eb9981658d54\") " pod="openshift-console/console-77d7fd98fb-hb9gs" Sep 18 21:08:17.880511 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:17.880434 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bf43279-386a-4526-af8d-eb9981658d54-trusted-ca-bundle\") pod \"console-77d7fd98fb-hb9gs\" (UID: \"9bf43279-386a-4526-af8d-eb9981658d54\") " pod="openshift-console/console-77d7fd98fb-hb9gs" Sep 18 21:08:17.882517 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:17.882497 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9bf43279-386a-4526-af8d-eb9981658d54-console-oauth-config\") pod \"console-77d7fd98fb-hb9gs\" (UID: \"9bf43279-386a-4526-af8d-eb9981658d54\") " pod="openshift-console/console-77d7fd98fb-hb9gs" Sep 18 21:08:17.882647 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:17.882622 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9bf43279-386a-4526-af8d-eb9981658d54-console-serving-cert\") pod \"console-77d7fd98fb-hb9gs\" (UID: \"9bf43279-386a-4526-af8d-eb9981658d54\") " pod="openshift-console/console-77d7fd98fb-hb9gs" Sep 18 21:08:17.889378 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:17.889357 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g54dp\" (UniqueName: \"kubernetes.io/projected/9bf43279-386a-4526-af8d-eb9981658d54-kube-api-access-g54dp\") pod \"console-77d7fd98fb-hb9gs\" (UID: \"9bf43279-386a-4526-af8d-eb9981658d54\") " pod="openshift-console/console-77d7fd98fb-hb9gs" Sep 18 21:08:17.941332 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:17.941297 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77d7fd98fb-hb9gs" Sep 18 21:08:21.434718 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.434686 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 21:08:21.439556 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.439530 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.447048 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.447020 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 18 21:08:21.447191 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.447053 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 18 21:08:21.447336 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.447192 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 18 21:08:21.447438 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.447347 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2nt1kfmc6s3t0\"" Sep 18 21:08:21.447438 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.447425 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 18 21:08:21.452376 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.452324 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 18 21:08:21.452376 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.452340 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 18 21:08:21.452376 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.452364 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 18 21:08:21.452635 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.452427 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 18 21:08:21.452635 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.452346 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 18 21:08:21.452763 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.452704 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 18 21:08:21.452763 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.452749 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 18 21:08:21.452841 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.452705 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 18 21:08:21.452942 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.452925 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 18 21:08:21.453356 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.453337 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 18 21:08:21.453681 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.453660 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xlwkw\"" Sep 18 21:08:21.464679 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.464647 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 18 21:08:21.476857 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.475457 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 21:08:21.610492 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.610460 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e71cae21-8003-4168-b058-02c885648c5c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.610663 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.610501 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.610663 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.610587 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e71cae21-8003-4168-b058-02c885648c5c-config-out\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.610663 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.610634 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.610772 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.610674 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.610772 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.610703 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.610772 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.610723 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.610772 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.610760 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.610935 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.610785 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.610935 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.610823 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-config\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.610935 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.610872 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.610935 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.610904 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.610935 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.610926 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-web-config\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.611201 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.610941 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.611201 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.610987 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.611201 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.611045 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e71cae21-8003-4168-b058-02c885648c5c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.611201 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.611094 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.611201 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.611122 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48vkp\" (UniqueName: \"kubernetes.io/projected/e71cae21-8003-4168-b058-02c885648c5c-kube-api-access-48vkp\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.611201 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.611173 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.611201 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.611199 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.712848 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.712765 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e71cae21-8003-4168-b058-02c885648c5c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.712848 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.712819 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.713039 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.712872 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e71cae21-8003-4168-b058-02c885648c5c-config-out\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.713039 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.712904 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.713039 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.712940 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.713039 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.712970 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.713039 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.712993 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.713039 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.713019 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.713039 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.713037 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.713327 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.713051 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-config\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.713327 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.713072 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.713327 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.713089 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.713327 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.713106 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-web-config\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.713327 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.713120 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.713327 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.713146 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.713327 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.713211 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e71cae21-8003-4168-b058-02c885648c5c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.713327 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.713239 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.713327 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.713262 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48vkp\" (UniqueName: \"kubernetes.io/projected/e71cae21-8003-4168-b058-02c885648c5c-kube-api-access-48vkp\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.713327 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.713265 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e71cae21-8003-4168-b058-02c885648c5c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.713327 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.713289 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.713327 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.713313 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.714893 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.714329 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.715298 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.715267 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.715451 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.715427 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.716383 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.716356 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.716714 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.716689 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-config\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.717496 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.717473 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.717596 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.717519 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.717596 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.717564 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.718720 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.718168 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.718720 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.718526 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e71cae21-8003-4168-b058-02c885648c5c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.718720 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.718646 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.719364 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.719308 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.719772 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.719747 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.720301 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.720260 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-web-config\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.720457 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.720437 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.722908 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.722654 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.723077 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.722990 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e71cae21-8003-4168-b058-02c885648c5c-config-out\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.723077 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.723064 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.732513 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.732487 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48vkp\" (UniqueName: \"kubernetes.io/projected/e71cae21-8003-4168-b058-02c885648c5c-kube-api-access-48vkp\") pod \"prometheus-k8s-0\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:21.753554 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:21.753521 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:22.687924 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:22.687837 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77d7fd98fb-hb9gs"] Sep 18 21:08:23.900324 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:08:23.900293 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8015b31_a308_44de_9299_3acb68d58104.slice/crio-ba9a17b96eeb223916e040169612a3dc760a6a763ccebdc784714cef8a3d748d WatchSource:0}: Error finding container ba9a17b96eeb223916e040169612a3dc760a6a763ccebdc784714cef8a3d748d: Status 404 returned error can't find the container with id ba9a17b96eeb223916e040169612a3dc760a6a763ccebdc784714cef8a3d748d Sep 18 21:08:24.193212 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:24.193112 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77d7fd98fb-hb9gs"] Sep 18 21:08:24.197091 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:08:24.197056 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bf43279_386a_4526_af8d_eb9981658d54.slice/crio-69e09f5ab5096cff2516969c606bef3990c59326140977144388116fa1887bc5 WatchSource:0}: Error finding container 69e09f5ab5096cff2516969c606bef3990c59326140977144388116fa1887bc5: Status 404 returned error can't find the container with id 69e09f5ab5096cff2516969c606bef3990c59326140977144388116fa1887bc5 Sep 18 21:08:24.206538 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:24.206510 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 21:08:24.213336 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:08:24.212904 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode71cae21_8003_4168_b058_02c885648c5c.slice/crio-82cdb1a3eb76a074214c3019c06ae636415e2c5256d7fa0673f9494d8613c944 WatchSource:0}: Error finding container 82cdb1a3eb76a074214c3019c06ae636415e2c5256d7fa0673f9494d8613c944: Status 404 returned error can't find the container with id 82cdb1a3eb76a074214c3019c06ae636415e2c5256d7fa0673f9494d8613c944 Sep 18 21:08:24.913790 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:24.913230 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-65mfq" event={"ID":"dbb189f6-362a-4c49-8e96-67f01b1ff430","Type":"ContainerStarted","Data":"01462a4a80e80a3f37a799f10b75d9c9e06807205465654d782a42315eefc9a1"} Sep 18 21:08:24.913790 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:24.913683 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6594f4c75-65mfq" Sep 18 21:08:24.915849 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:24.915495 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e71cae21-8003-4168-b058-02c885648c5c","Type":"ContainerStarted","Data":"82cdb1a3eb76a074214c3019c06ae636415e2c5256d7fa0673f9494d8613c944"} Sep 18 21:08:24.919342 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:24.919233 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f8015b31-a308-44de-9299-3acb68d58104","Type":"ContainerStarted","Data":"ba9a17b96eeb223916e040169612a3dc760a6a763ccebdc784714cef8a3d748d"} Sep 18 21:08:24.925617 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:24.925422 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6594f4c75-65mfq" Sep 18 21:08:24.926293 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:24.926040 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6l67p" event={"ID":"c4b5545a-71f2-4647-ac2b-ef870aa919c4","Type":"ContainerStarted","Data":"a539843842e12be7fc1fe7ebd43da0f2ea96fafe32f4bee4f08d900550064df0"} Sep 18 21:08:24.926293 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:24.926093 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6l67p" event={"ID":"c4b5545a-71f2-4647-ac2b-ef870aa919c4","Type":"ContainerStarted","Data":"2a9645c917a531c92495b6611ada36714aa69b85b3306508c1b39b5d3c7c8955"} Sep 18 21:08:24.930012 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:24.929944 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77d7fd98fb-hb9gs" event={"ID":"9bf43279-386a-4526-af8d-eb9981658d54","Type":"ContainerStarted","Data":"69e09f5ab5096cff2516969c606bef3990c59326140977144388116fa1887bc5"} Sep 18 21:08:24.954561 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:24.953062 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6594f4c75-65mfq" podStartSLOduration=1.678630199 podStartE2EDuration="18.953037094s" totalImagesPullingTime="17.274406895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:08:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:08:24.952133345 +0000 UTC m=+144.172245734" watchObservedRunningTime="2026-09-18 21:08:24.953037094 +0000 UTC m=+144.173149482" Sep 18 21:08:25.003075 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:25.002982 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6l67p" podStartSLOduration=8.968064233 podStartE2EDuration="10.002959409s" totalImagesPullingTime="937.651887ms" totalInitContainerRuntime="97.243289ms" isStatefulPod=true podCreationTimestamp="2026-09-18 21:08:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:08:25.002479604 +0000 UTC m=+144.222591993" watchObservedRunningTime="2026-09-18 21:08:25.002959409 +0000 UTC m=+144.223071798" Sep 18 21:08:26.944579 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:26.944500 2581 generic.go:356] "Generic (PLEG): container finished" podID="e71cae21-8003-4168-b058-02c885648c5c" containerID="e423a47e7154d05dc76fbeb791868389b88bbb847bfffdf864f0f02fe88bee34" exitCode=0 Sep 18 21:08:26.945432 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:26.945275 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e71cae21-8003-4168-b058-02c885648c5c","Type":"ContainerDied","Data":"e423a47e7154d05dc76fbeb791868389b88bbb847bfffdf864f0f02fe88bee34"} Sep 18 21:08:26.948802 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:26.948235 2581 generic.go:356] "Generic (PLEG): container finished" podID="f8015b31-a308-44de-9299-3acb68d58104" containerID="b4c499b1c68a81ad3106631e2ed9393f3757ece1f2f6a859c0997ac29de3858f" exitCode=0 Sep 18 21:08:26.948802 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:26.948462 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f8015b31-a308-44de-9299-3acb68d58104","Type":"ContainerDied","Data":"b4c499b1c68a81ad3106631e2ed9393f3757ece1f2f6a859c0997ac29de3858f"} Sep 18 21:08:31.150417 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:31.150368 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" podUID="ce1d3f40-3c78-4465-aa1f-e684e23455cf" containerName="registry" containerID="cri-o://0e570df481c95897d4b6d99ce8cca4b2732becbb2cec6b8c814bcc7e42fad551" gracePeriod=30 Sep 18 21:08:31.444228 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:31.444194 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" Sep 18 21:08:31.523320 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:31.523284 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce1d3f40-3c78-4465-aa1f-e684e23455cf-trusted-ca\") pod \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " Sep 18 21:08:31.523511 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:31.523332 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce1d3f40-3c78-4465-aa1f-e684e23455cf-registry-certificates\") pod \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " Sep 18 21:08:31.523511 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:31.523367 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1d3f40-3c78-4465-aa1f-e684e23455cf-registry-tls\") pod \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " Sep 18 21:08:31.523511 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:31.523431 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce1d3f40-3c78-4465-aa1f-e684e23455cf-ca-trust-extracted\") pod \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " Sep 18 21:08:31.523511 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:31.523462 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce1d3f40-3c78-4465-aa1f-e684e23455cf-bound-sa-token\") pod \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " Sep 18 21:08:31.523791 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:31.523527 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce1d3f40-3c78-4465-aa1f-e684e23455cf-installation-pull-secrets\") pod \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " Sep 18 21:08:31.523791 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:31.523567 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmhwq\" (UniqueName: \"kubernetes.io/projected/ce1d3f40-3c78-4465-aa1f-e684e23455cf-kube-api-access-lmhwq\") pod \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " Sep 18 21:08:31.523791 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:31.523590 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce1d3f40-3c78-4465-aa1f-e684e23455cf-image-registry-private-configuration\") pod \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\" (UID: \"ce1d3f40-3c78-4465-aa1f-e684e23455cf\") " Sep 18 21:08:31.526687 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:31.526646 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce1d3f40-3c78-4465-aa1f-e684e23455cf-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ce1d3f40-3c78-4465-aa1f-e684e23455cf" (UID: "ce1d3f40-3c78-4465-aa1f-e684e23455cf"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:08:31.526911 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:31.526890 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce1d3f40-3c78-4465-aa1f-e684e23455cf-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ce1d3f40-3c78-4465-aa1f-e684e23455cf" (UID: "ce1d3f40-3c78-4465-aa1f-e684e23455cf"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:08:31.535442 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:31.533849 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce1d3f40-3c78-4465-aa1f-e684e23455cf-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ce1d3f40-3c78-4465-aa1f-e684e23455cf" (UID: "ce1d3f40-3c78-4465-aa1f-e684e23455cf"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:08:31.535442 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:31.534194 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce1d3f40-3c78-4465-aa1f-e684e23455cf-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ce1d3f40-3c78-4465-aa1f-e684e23455cf" (UID: "ce1d3f40-3c78-4465-aa1f-e684e23455cf"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:08:31.536539 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:31.536392 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce1d3f40-3c78-4465-aa1f-e684e23455cf-kube-api-access-lmhwq" (OuterVolumeSpecName: "kube-api-access-lmhwq") pod "ce1d3f40-3c78-4465-aa1f-e684e23455cf" (UID: "ce1d3f40-3c78-4465-aa1f-e684e23455cf"). InnerVolumeSpecName "kube-api-access-lmhwq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 21:08:31.536539 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:31.536504 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce1d3f40-3c78-4465-aa1f-e684e23455cf-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ce1d3f40-3c78-4465-aa1f-e684e23455cf" (UID: "ce1d3f40-3c78-4465-aa1f-e684e23455cf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 21:08:31.538116 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:31.538085 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce1d3f40-3c78-4465-aa1f-e684e23455cf-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ce1d3f40-3c78-4465-aa1f-e684e23455cf" (UID: "ce1d3f40-3c78-4465-aa1f-e684e23455cf"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 21:08:31.542658 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:31.542630 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce1d3f40-3c78-4465-aa1f-e684e23455cf-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ce1d3f40-3c78-4465-aa1f-e684e23455cf" (UID: "ce1d3f40-3c78-4465-aa1f-e684e23455cf"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 21:08:31.625303 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:31.625263 2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce1d3f40-3c78-4465-aa1f-e684e23455cf-bound-sa-token\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:08:31.625303 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:31.625296 2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce1d3f40-3c78-4465-aa1f-e684e23455cf-installation-pull-secrets\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:08:31.625303 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:31.625310 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmhwq\" (UniqueName: \"kubernetes.io/projected/ce1d3f40-3c78-4465-aa1f-e684e23455cf-kube-api-access-lmhwq\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:08:31.625587 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:31.625319 2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce1d3f40-3c78-4465-aa1f-e684e23455cf-image-registry-private-configuration\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:08:31.625587 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:31.625328 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce1d3f40-3c78-4465-aa1f-e684e23455cf-trusted-ca\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:08:31.625587 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:31.625336 2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce1d3f40-3c78-4465-aa1f-e684e23455cf-registry-certificates\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:08:31.625587 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:31.625343 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1d3f40-3c78-4465-aa1f-e684e23455cf-registry-tls\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:08:31.625587 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:31.625351 2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce1d3f40-3c78-4465-aa1f-e684e23455cf-ca-trust-extracted\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:08:31.978724 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:31.978622 2581 generic.go:356] "Generic (PLEG): container finished" podID="ce1d3f40-3c78-4465-aa1f-e684e23455cf" containerID="0e570df481c95897d4b6d99ce8cca4b2732becbb2cec6b8c814bcc7e42fad551" exitCode=0 Sep 18 21:08:31.978724 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:31.978684 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" Sep 18 21:08:31.978724 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:31.978709 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" event={"ID":"ce1d3f40-3c78-4465-aa1f-e684e23455cf","Type":"ContainerDied","Data":"0e570df481c95897d4b6d99ce8cca4b2732becbb2cec6b8c814bcc7e42fad551"} Sep 18 21:08:31.979021 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:31.978772 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c8c458dcf-wvcqd" event={"ID":"ce1d3f40-3c78-4465-aa1f-e684e23455cf","Type":"ContainerDied","Data":"ceb1a4d78d711c5077fbbdc59fe9e8a6adad427a73e84fb6d41172bd0d107259"} Sep 18 21:08:31.979021 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:31.978800 2581 scope.go:117] "RemoveContainer" containerID="0e570df481c95897d4b6d99ce8cca4b2732becbb2cec6b8c814bcc7e42fad551" Sep 18 21:08:32.009802 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:32.009770 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c8c458dcf-wvcqd"] Sep 18 21:08:32.013898 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:32.013868 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-c8c458dcf-wvcqd"] Sep 18 21:08:32.186618 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:32.186394 2581 scope.go:117] "RemoveContainer" containerID="0e570df481c95897d4b6d99ce8cca4b2732becbb2cec6b8c814bcc7e42fad551" Sep 18 21:08:32.186904 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:08:32.186733 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e570df481c95897d4b6d99ce8cca4b2732becbb2cec6b8c814bcc7e42fad551\": container with ID starting with 0e570df481c95897d4b6d99ce8cca4b2732becbb2cec6b8c814bcc7e42fad551 not found: ID does not exist" containerID="0e570df481c95897d4b6d99ce8cca4b2732becbb2cec6b8c814bcc7e42fad551" Sep 18 21:08:32.186904 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:32.186774 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e570df481c95897d4b6d99ce8cca4b2732becbb2cec6b8c814bcc7e42fad551"} err="failed to get container status \"0e570df481c95897d4b6d99ce8cca4b2732becbb2cec6b8c814bcc7e42fad551\": rpc error: code = NotFound desc = could not find container \"0e570df481c95897d4b6d99ce8cca4b2732becbb2cec6b8c814bcc7e42fad551\": container with ID starting with 0e570df481c95897d4b6d99ce8cca4b2732becbb2cec6b8c814bcc7e42fad551 not found: ID does not exist" Sep 18 21:08:33.269992 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:33.269959 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce1d3f40-3c78-4465-aa1f-e684e23455cf" path="/var/lib/kubelet/pods/ce1d3f40-3c78-4465-aa1f-e684e23455cf/volumes" Sep 18 21:08:33.994729 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:33.994697 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e71cae21-8003-4168-b058-02c885648c5c","Type":"ContainerStarted","Data":"e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32"} Sep 18 21:08:33.997502 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:33.997478 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f8015b31-a308-44de-9299-3acb68d58104","Type":"ContainerStarted","Data":"b4c96d2b8415c320f9678dbe826d3e82ec8a3115d10ef73f71892d2859b94538"} Sep 18 21:08:33.999221 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:33.999196 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77d7fd98fb-hb9gs" event={"ID":"9bf43279-386a-4526-af8d-eb9981658d54","Type":"ContainerStarted","Data":"aed050a3007d596435fd719a98dcaf3617b8c3cb50724c5a9e58413dabbb95af"} Sep 18 21:08:34.026169 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:34.025948 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77d7fd98fb-hb9gs" podStartSLOduration=7.46074957 podStartE2EDuration="17.025927502s" totalImagesPullingTime="9.565177932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:08:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:08:34.025449485 +0000 UTC m=+153.245561900" watchObservedRunningTime="2026-09-18 21:08:34.025927502 +0000 UTC m=+153.246039891" Sep 18 21:08:35.011095 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:35.011054 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e71cae21-8003-4168-b058-02c885648c5c","Type":"ContainerStarted","Data":"34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276"} Sep 18 21:08:35.014975 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:35.014942 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f8015b31-a308-44de-9299-3acb68d58104","Type":"ContainerStarted","Data":"412a09eb2fac7a007c69dd14340f72aec16394386d3c1d6c199c8d1b9d7d975f"} Sep 18 21:08:35.015117 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:35.015025 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f8015b31-a308-44de-9299-3acb68d58104","Type":"ContainerStarted","Data":"b62ecdfad07ef8e37295c6ce49588b4dfb652e6599d61b69aa9796ebd2861711"} Sep 18 21:08:35.015117 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:35.015067 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f8015b31-a308-44de-9299-3acb68d58104","Type":"ContainerStarted","Data":"d2fadefbce4eeea9949ecf98a196663a4bf374e6308243496b404782c8171814"} Sep 18 21:08:35.015117 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:35.015108 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f8015b31-a308-44de-9299-3acb68d58104","Type":"ContainerStarted","Data":"5af81d6113408c892f71aec8f44e08313f3574e246de13643d79b16eef20776e"} Sep 18 21:08:37.028032 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:37.027998 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e71cae21-8003-4168-b058-02c885648c5c","Type":"ContainerStarted","Data":"a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95"} Sep 18 21:08:37.028459 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:37.028089 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e71cae21-8003-4168-b058-02c885648c5c","Type":"ContainerStarted","Data":"d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52"} Sep 18 21:08:37.031996 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:37.031972 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f8015b31-a308-44de-9299-3acb68d58104","Type":"ContainerStarted","Data":"c8bc4acd4bb6740737feda8bf40a6f87f59e30bb46da9cff0c5f1f787abdd762"} Sep 18 21:08:37.076901 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:37.076846 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=9.892708454 podStartE2EDuration="21.076822396s" totalImagesPullingTime="11.160019085s" totalInitContainerRuntime="24.094857ms" isStatefulPod=false podCreationTimestamp="2026-09-18 21:08:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:08:37.076205568 +0000 UTC m=+156.296317960" watchObservedRunningTime="2026-09-18 21:08:37.076822396 +0000 UTC m=+156.296934784" Sep 18 21:08:37.941751 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:37.941710 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77d7fd98fb-hb9gs" Sep 18 21:08:38.044053 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:38.044016 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e71cae21-8003-4168-b058-02c885648c5c","Type":"ContainerStarted","Data":"c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8"} Sep 18 21:08:38.044640 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:38.044110 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e71cae21-8003-4168-b058-02c885648c5c","Type":"ContainerStarted","Data":"7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de"} Sep 18 21:08:38.084464 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:38.084401 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.470729888 podStartE2EDuration="17.084379328s" totalImagesPullingTime="11.5882576s" totalInitContainerRuntime="25.39184ms" isStatefulPod=false podCreationTimestamp="2026-09-18 21:08:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:08:38.082556733 +0000 UTC m=+157.302669136" watchObservedRunningTime="2026-09-18 21:08:38.084379328 +0000 UTC m=+157.304491719" Sep 18 21:08:38.165136 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:08:38.165093 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-tg8b4" podUID="ad969dab-7207-48f2-b60e-b5d09c455d31" Sep 18 21:08:39.047572 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:39.047539 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tg8b4" Sep 18 21:08:41.754530 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:41.754500 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:08:43.031593 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:43.031558 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad969dab-7207-48f2-b60e-b5d09c455d31-metrics-tls\") pod \"dns-default-tg8b4\" (UID: \"ad969dab-7207-48f2-b60e-b5d09c455d31\") " pod="openshift-dns/dns-default-tg8b4" Sep 18 21:08:43.034209 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:43.034183 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad969dab-7207-48f2-b60e-b5d09c455d31-metrics-tls\") pod \"dns-default-tg8b4\" (UID: \"ad969dab-7207-48f2-b60e-b5d09c455d31\") " pod="openshift-dns/dns-default-tg8b4" Sep 18 21:08:43.251488 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:43.251464 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qsk7s\"" Sep 18 21:08:43.258983 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:43.258960 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tg8b4" Sep 18 21:08:43.566071 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:43.566047 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tg8b4"] Sep 18 21:08:43.568482 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:08:43.568452 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad969dab_7207_48f2_b60e_b5d09c455d31.slice/crio-e55cc0571dee30b431ae4a4b500c77b7ed99f309aac705718e560ea41ebc0c47 WatchSource:0}: Error finding container e55cc0571dee30b431ae4a4b500c77b7ed99f309aac705718e560ea41ebc0c47: Status 404 returned error can't find the container with id e55cc0571dee30b431ae4a4b500c77b7ed99f309aac705718e560ea41ebc0c47 Sep 18 21:08:44.070469 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:44.070431 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tg8b4" event={"ID":"ad969dab-7207-48f2-b60e-b5d09c455d31","Type":"ContainerStarted","Data":"e55cc0571dee30b431ae4a4b500c77b7ed99f309aac705718e560ea41ebc0c47"} Sep 18 21:08:46.085590 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:46.085508 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tg8b4" event={"ID":"ad969dab-7207-48f2-b60e-b5d09c455d31","Type":"ContainerStarted","Data":"0e253187c9ca32a07548620239ff20073cd3fcefcb4c26af69fef638c97e6fda"} Sep 18 21:08:46.085590 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:46.085564 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tg8b4" event={"ID":"ad969dab-7207-48f2-b60e-b5d09c455d31","Type":"ContainerStarted","Data":"4cdd22c915d0c71463381f41b4bc08f61eb42205a0e72f078f451870d9d08661"} Sep 18 21:08:46.086050 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:46.085614 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tg8b4" Sep 18 21:08:46.106223 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:46.106171 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tg8b4" podStartSLOduration=129.141963502 podStartE2EDuration="2m11.106127517s" totalImagesPullingTime="1.964164015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:06:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:08:46.10521675 +0000 UTC m=+165.325329140" watchObservedRunningTime="2026-09-18 21:08:46.106127517 +0000 UTC m=+165.326239907" Sep 18 21:08:56.091693 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:56.091620 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tg8b4" Sep 18 21:08:59.034610 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:59.034561 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-77d7fd98fb-hb9gs" podUID="9bf43279-386a-4526-af8d-eb9981658d54" containerName="console" containerID="cri-o://aed050a3007d596435fd719a98dcaf3617b8c3cb50724c5a9e58413dabbb95af" gracePeriod=15 Sep 18 21:08:59.267374 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:59.267348 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77d7fd98fb-hb9gs" Sep 18 21:08:59.375852 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:59.375770 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9bf43279-386a-4526-af8d-eb9981658d54-console-oauth-config\") pod \"9bf43279-386a-4526-af8d-eb9981658d54\" (UID: \"9bf43279-386a-4526-af8d-eb9981658d54\") " Sep 18 21:08:59.375852 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:59.375819 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9bf43279-386a-4526-af8d-eb9981658d54-oauth-serving-cert\") pod \"9bf43279-386a-4526-af8d-eb9981658d54\" (UID: \"9bf43279-386a-4526-af8d-eb9981658d54\") " Sep 18 21:08:59.376073 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:59.375858 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9bf43279-386a-4526-af8d-eb9981658d54-service-ca\") pod \"9bf43279-386a-4526-af8d-eb9981658d54\" (UID: \"9bf43279-386a-4526-af8d-eb9981658d54\") " Sep 18 21:08:59.376073 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:59.375885 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g54dp\" (UniqueName: \"kubernetes.io/projected/9bf43279-386a-4526-af8d-eb9981658d54-kube-api-access-g54dp\") pod \"9bf43279-386a-4526-af8d-eb9981658d54\" (UID: \"9bf43279-386a-4526-af8d-eb9981658d54\") " Sep 18 21:08:59.376073 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:59.375932 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bf43279-386a-4526-af8d-eb9981658d54-trusted-ca-bundle\") pod \"9bf43279-386a-4526-af8d-eb9981658d54\" (UID: \"9bf43279-386a-4526-af8d-eb9981658d54\") " Sep 18 21:08:59.376253 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:59.376067 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9bf43279-386a-4526-af8d-eb9981658d54-console-config\") pod \"9bf43279-386a-4526-af8d-eb9981658d54\" (UID: \"9bf43279-386a-4526-af8d-eb9981658d54\") " Sep 18 21:08:59.376253 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:59.376172 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9bf43279-386a-4526-af8d-eb9981658d54-console-serving-cert\") pod \"9bf43279-386a-4526-af8d-eb9981658d54\" (UID: \"9bf43279-386a-4526-af8d-eb9981658d54\") " Sep 18 21:08:59.376404 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:59.376377 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bf43279-386a-4526-af8d-eb9981658d54-service-ca" (OuterVolumeSpecName: "service-ca") pod "9bf43279-386a-4526-af8d-eb9981658d54" (UID: "9bf43279-386a-4526-af8d-eb9981658d54"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:08:59.376404 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:59.376384 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bf43279-386a-4526-af8d-eb9981658d54-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9bf43279-386a-4526-af8d-eb9981658d54" (UID: "9bf43279-386a-4526-af8d-eb9981658d54"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:08:59.376505 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:59.376400 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bf43279-386a-4526-af8d-eb9981658d54-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9bf43279-386a-4526-af8d-eb9981658d54" (UID: "9bf43279-386a-4526-af8d-eb9981658d54"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:08:59.376505 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:59.376459 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9bf43279-386a-4526-af8d-eb9981658d54-oauth-serving-cert\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:08:59.376505 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:59.376461 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bf43279-386a-4526-af8d-eb9981658d54-console-config" (OuterVolumeSpecName: "console-config") pod "9bf43279-386a-4526-af8d-eb9981658d54" (UID: "9bf43279-386a-4526-af8d-eb9981658d54"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:08:59.376505 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:59.376478 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9bf43279-386a-4526-af8d-eb9981658d54-service-ca\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:08:59.378366 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:59.378338 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bf43279-386a-4526-af8d-eb9981658d54-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9bf43279-386a-4526-af8d-eb9981658d54" (UID: "9bf43279-386a-4526-af8d-eb9981658d54"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:08:59.378475 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:59.378392 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bf43279-386a-4526-af8d-eb9981658d54-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9bf43279-386a-4526-af8d-eb9981658d54" (UID: "9bf43279-386a-4526-af8d-eb9981658d54"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:08:59.378475 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:59.378418 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bf43279-386a-4526-af8d-eb9981658d54-kube-api-access-g54dp" (OuterVolumeSpecName: "kube-api-access-g54dp") pod "9bf43279-386a-4526-af8d-eb9981658d54" (UID: "9bf43279-386a-4526-af8d-eb9981658d54"). InnerVolumeSpecName "kube-api-access-g54dp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 21:08:59.476957 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:59.476925 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bf43279-386a-4526-af8d-eb9981658d54-trusted-ca-bundle\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:08:59.476957 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:59.476952 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9bf43279-386a-4526-af8d-eb9981658d54-console-config\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:08:59.477213 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:59.476965 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9bf43279-386a-4526-af8d-eb9981658d54-console-serving-cert\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:08:59.477213 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:59.476977 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9bf43279-386a-4526-af8d-eb9981658d54-console-oauth-config\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:08:59.477213 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:08:59.476989 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g54dp\" (UniqueName: \"kubernetes.io/projected/9bf43279-386a-4526-af8d-eb9981658d54-kube-api-access-g54dp\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:09:00.138081 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:00.138050 2581 generic.go:356] "Generic (PLEG): container finished" podID="9bf43279-386a-4526-af8d-eb9981658d54" containerID="aed050a3007d596435fd719a98dcaf3617b8c3cb50724c5a9e58413dabbb95af" exitCode=0 Sep 18 21:09:00.138492 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:00.138095 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77d7fd98fb-hb9gs" Sep 18 21:09:00.138492 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:00.138126 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77d7fd98fb-hb9gs" event={"ID":"9bf43279-386a-4526-af8d-eb9981658d54","Type":"ContainerDied","Data":"aed050a3007d596435fd719a98dcaf3617b8c3cb50724c5a9e58413dabbb95af"} Sep 18 21:09:00.138492 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:00.138182 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77d7fd98fb-hb9gs" event={"ID":"9bf43279-386a-4526-af8d-eb9981658d54","Type":"ContainerDied","Data":"69e09f5ab5096cff2516969c606bef3990c59326140977144388116fa1887bc5"} Sep 18 21:09:00.138492 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:00.138201 2581 scope.go:117] "RemoveContainer" containerID="aed050a3007d596435fd719a98dcaf3617b8c3cb50724c5a9e58413dabbb95af" Sep 18 21:09:00.147111 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:00.147096 2581 scope.go:117] "RemoveContainer" containerID="aed050a3007d596435fd719a98dcaf3617b8c3cb50724c5a9e58413dabbb95af" Sep 18 21:09:00.147401 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:09:00.147382 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aed050a3007d596435fd719a98dcaf3617b8c3cb50724c5a9e58413dabbb95af\": container with ID starting with aed050a3007d596435fd719a98dcaf3617b8c3cb50724c5a9e58413dabbb95af not found: ID does not exist" containerID="aed050a3007d596435fd719a98dcaf3617b8c3cb50724c5a9e58413dabbb95af" Sep 18 21:09:00.147457 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:00.147409 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aed050a3007d596435fd719a98dcaf3617b8c3cb50724c5a9e58413dabbb95af"} err="failed to get container status \"aed050a3007d596435fd719a98dcaf3617b8c3cb50724c5a9e58413dabbb95af\": rpc error: code = NotFound desc = could not find container \"aed050a3007d596435fd719a98dcaf3617b8c3cb50724c5a9e58413dabbb95af\": container with ID starting with aed050a3007d596435fd719a98dcaf3617b8c3cb50724c5a9e58413dabbb95af not found: ID does not exist" Sep 18 21:09:00.158940 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:00.158914 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77d7fd98fb-hb9gs"] Sep 18 21:09:00.166051 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:00.166032 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77d7fd98fb-hb9gs"] Sep 18 21:09:01.143760 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:01.143728 2581 generic.go:356] "Generic (PLEG): container finished" podID="38857100-523d-487d-bd52-329001743062" containerID="94e6bbbb860e3fe05900325502d21035985331a39ab7db00fa6cf4d2f6ee0496" exitCode=0 Sep 18 21:09:01.144221 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:01.143801 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-f7zlc" event={"ID":"38857100-523d-487d-bd52-329001743062","Type":"ContainerDied","Data":"94e6bbbb860e3fe05900325502d21035985331a39ab7db00fa6cf4d2f6ee0496"} Sep 18 21:09:01.144221 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:01.144190 2581 scope.go:117] "RemoveContainer" containerID="94e6bbbb860e3fe05900325502d21035985331a39ab7db00fa6cf4d2f6ee0496" Sep 18 21:09:01.269787 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:01.269760 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bf43279-386a-4526-af8d-eb9981658d54" path="/var/lib/kubelet/pods/9bf43279-386a-4526-af8d-eb9981658d54/volumes" Sep 18 21:09:02.152093 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:02.152055 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-f7zlc" event={"ID":"38857100-523d-487d-bd52-329001743062","Type":"ContainerStarted","Data":"bd5b65cd1f0a1364e713ec1a486b73e0b6cbd9c34fb5347d50b95c12847fb8fb"} Sep 18 21:09:21.754227 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:21.754186 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:21.775441 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:21.775416 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:22.245217 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:22.245182 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:35.551348 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:35.551307 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 21:09:35.551735 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:35.551636 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f8015b31-a308-44de-9299-3acb68d58104" containerName="alertmanager" containerID="cri-o://b4c96d2b8415c320f9678dbe826d3e82ec8a3115d10ef73f71892d2859b94538" gracePeriod=120 Sep 18 21:09:35.551735 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:35.551686 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f8015b31-a308-44de-9299-3acb68d58104" containerName="kube-rbac-proxy-metric" containerID="cri-o://412a09eb2fac7a007c69dd14340f72aec16394386d3c1d6c199c8d1b9d7d975f" gracePeriod=120 Sep 18 21:09:35.551841 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:35.551715 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f8015b31-a308-44de-9299-3acb68d58104" containerName="kube-rbac-proxy-web" containerID="cri-o://d2fadefbce4eeea9949ecf98a196663a4bf374e6308243496b404782c8171814" gracePeriod=120 Sep 18 21:09:35.551841 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:35.551759 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f8015b31-a308-44de-9299-3acb68d58104" containerName="prom-label-proxy" containerID="cri-o://c8bc4acd4bb6740737feda8bf40a6f87f59e30bb46da9cff0c5f1f787abdd762" gracePeriod=120 Sep 18 21:09:35.551841 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:35.551757 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f8015b31-a308-44de-9299-3acb68d58104" containerName="config-reloader" containerID="cri-o://5af81d6113408c892f71aec8f44e08313f3574e246de13643d79b16eef20776e" gracePeriod=120 Sep 18 21:09:35.551841 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:35.551715 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f8015b31-a308-44de-9299-3acb68d58104" containerName="kube-rbac-proxy" containerID="cri-o://b62ecdfad07ef8e37295c6ce49588b4dfb652e6599d61b69aa9796ebd2861711" gracePeriod=120 Sep 18 21:09:36.285109 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.285072 2581 generic.go:356] "Generic (PLEG): container finished" podID="f8015b31-a308-44de-9299-3acb68d58104" containerID="c8bc4acd4bb6740737feda8bf40a6f87f59e30bb46da9cff0c5f1f787abdd762" exitCode=0 Sep 18 21:09:36.285109 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.285098 2581 generic.go:356] "Generic (PLEG): container finished" podID="f8015b31-a308-44de-9299-3acb68d58104" containerID="b62ecdfad07ef8e37295c6ce49588b4dfb652e6599d61b69aa9796ebd2861711" exitCode=0 Sep 18 21:09:36.285109 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.285104 2581 generic.go:356] "Generic (PLEG): container finished" podID="f8015b31-a308-44de-9299-3acb68d58104" containerID="5af81d6113408c892f71aec8f44e08313f3574e246de13643d79b16eef20776e" exitCode=0 Sep 18 21:09:36.285109 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.285109 2581 generic.go:356] "Generic (PLEG): container finished" podID="f8015b31-a308-44de-9299-3acb68d58104" containerID="b4c96d2b8415c320f9678dbe826d3e82ec8a3115d10ef73f71892d2859b94538" exitCode=0 Sep 18 21:09:36.285384 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.285142 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f8015b31-a308-44de-9299-3acb68d58104","Type":"ContainerDied","Data":"c8bc4acd4bb6740737feda8bf40a6f87f59e30bb46da9cff0c5f1f787abdd762"} Sep 18 21:09:36.285384 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.285226 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f8015b31-a308-44de-9299-3acb68d58104","Type":"ContainerDied","Data":"b62ecdfad07ef8e37295c6ce49588b4dfb652e6599d61b69aa9796ebd2861711"} Sep 18 21:09:36.285384 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.285253 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f8015b31-a308-44de-9299-3acb68d58104","Type":"ContainerDied","Data":"5af81d6113408c892f71aec8f44e08313f3574e246de13643d79b16eef20776e"} Sep 18 21:09:36.285384 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.285277 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f8015b31-a308-44de-9299-3acb68d58104","Type":"ContainerDied","Data":"b4c96d2b8415c320f9678dbe826d3e82ec8a3115d10ef73f71892d2859b94538"} Sep 18 21:09:36.784046 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.784025 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:36.884476 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.884390 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-secret-alertmanager-kube-rbac-proxy\") pod \"f8015b31-a308-44de-9299-3acb68d58104\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " Sep 18 21:09:36.884476 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.884432 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-config-volume\") pod \"f8015b31-a308-44de-9299-3acb68d58104\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " Sep 18 21:09:36.884476 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.884457 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-cluster-tls-config\") pod \"f8015b31-a308-44de-9299-3acb68d58104\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " Sep 18 21:09:36.884756 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.884486 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-secret-alertmanager-kube-rbac-proxy-metric\") pod \"f8015b31-a308-44de-9299-3acb68d58104\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " Sep 18 21:09:36.884756 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.884643 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-secret-alertmanager-kube-rbac-proxy-web\") pod \"f8015b31-a308-44de-9299-3acb68d58104\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " Sep 18 21:09:36.884756 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.884723 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f8015b31-a308-44de-9299-3acb68d58104-tls-assets\") pod \"f8015b31-a308-44de-9299-3acb68d58104\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " Sep 18 21:09:36.884918 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.884762 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvch5\" (UniqueName: \"kubernetes.io/projected/f8015b31-a308-44de-9299-3acb68d58104-kube-api-access-tvch5\") pod \"f8015b31-a308-44de-9299-3acb68d58104\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " Sep 18 21:09:36.884918 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.884813 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f8015b31-a308-44de-9299-3acb68d58104-alertmanager-main-db\") pod \"f8015b31-a308-44de-9299-3acb68d58104\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " Sep 18 21:09:36.884918 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.884854 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-web-config\") pod \"f8015b31-a308-44de-9299-3acb68d58104\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " Sep 18 21:09:36.884918 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.884891 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8015b31-a308-44de-9299-3acb68d58104-alertmanager-trusted-ca-bundle\") pod \"f8015b31-a308-44de-9299-3acb68d58104\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " Sep 18 21:09:36.885300 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.884919 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f8015b31-a308-44de-9299-3acb68d58104-config-out\") pod \"f8015b31-a308-44de-9299-3acb68d58104\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " Sep 18 21:09:36.885300 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.884949 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-secret-alertmanager-main-tls\") pod \"f8015b31-a308-44de-9299-3acb68d58104\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " Sep 18 21:09:36.885300 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.884978 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8015b31-a308-44de-9299-3acb68d58104-metrics-client-ca\") pod \"f8015b31-a308-44de-9299-3acb68d58104\" (UID: \"f8015b31-a308-44de-9299-3acb68d58104\") " Sep 18 21:09:36.886337 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.886287 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8015b31-a308-44de-9299-3acb68d58104-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "f8015b31-a308-44de-9299-3acb68d58104" (UID: "f8015b31-a308-44de-9299-3acb68d58104"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:09:36.887170 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.887015 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8015b31-a308-44de-9299-3acb68d58104-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "f8015b31-a308-44de-9299-3acb68d58104" (UID: "f8015b31-a308-44de-9299-3acb68d58104"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:09:36.887483 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.887455 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "f8015b31-a308-44de-9299-3acb68d58104" (UID: "f8015b31-a308-44de-9299-3acb68d58104"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:09:36.887606 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.887581 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8015b31-a308-44de-9299-3acb68d58104-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "f8015b31-a308-44de-9299-3acb68d58104" (UID: "f8015b31-a308-44de-9299-3acb68d58104"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 21:09:36.888274 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.888245 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "f8015b31-a308-44de-9299-3acb68d58104" (UID: "f8015b31-a308-44de-9299-3acb68d58104"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:09:36.888454 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.888424 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "f8015b31-a308-44de-9299-3acb68d58104" (UID: "f8015b31-a308-44de-9299-3acb68d58104"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:09:36.888549 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.888450 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-config-volume" (OuterVolumeSpecName: "config-volume") pod "f8015b31-a308-44de-9299-3acb68d58104" (UID: "f8015b31-a308-44de-9299-3acb68d58104"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:09:36.890390 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.890338 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8015b31-a308-44de-9299-3acb68d58104-kube-api-access-tvch5" (OuterVolumeSpecName: "kube-api-access-tvch5") pod "f8015b31-a308-44de-9299-3acb68d58104" (UID: "f8015b31-a308-44de-9299-3acb68d58104"). InnerVolumeSpecName "kube-api-access-tvch5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 21:09:36.890390 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.890342 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "f8015b31-a308-44de-9299-3acb68d58104" (UID: "f8015b31-a308-44de-9299-3acb68d58104"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:09:36.890390 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.890364 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8015b31-a308-44de-9299-3acb68d58104-config-out" (OuterVolumeSpecName: "config-out") pod "f8015b31-a308-44de-9299-3acb68d58104" (UID: "f8015b31-a308-44de-9299-3acb68d58104"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 21:09:36.890390 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.890368 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8015b31-a308-44de-9299-3acb68d58104-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f8015b31-a308-44de-9299-3acb68d58104" (UID: "f8015b31-a308-44de-9299-3acb68d58104"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 21:09:36.892801 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.892657 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "f8015b31-a308-44de-9299-3acb68d58104" (UID: "f8015b31-a308-44de-9299-3acb68d58104"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:09:36.899505 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.899483 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-web-config" (OuterVolumeSpecName: "web-config") pod "f8015b31-a308-44de-9299-3acb68d58104" (UID: "f8015b31-a308-44de-9299-3acb68d58104"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:09:36.985743 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.985708 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-secret-alertmanager-main-tls\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:09:36.985743 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.985735 2581 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8015b31-a308-44de-9299-3acb68d58104-metrics-client-ca\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:09:36.985743 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.985746 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:09:36.985962 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.985756 2581 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-config-volume\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:09:36.985962 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.985765 2581 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-cluster-tls-config\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:09:36.985962 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.985773 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:09:36.985962 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.985782 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:09:36.985962 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.985790 2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f8015b31-a308-44de-9299-3acb68d58104-tls-assets\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:09:36.985962 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.985798 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvch5\" (UniqueName: \"kubernetes.io/projected/f8015b31-a308-44de-9299-3acb68d58104-kube-api-access-tvch5\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:09:36.985962 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.985806 2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f8015b31-a308-44de-9299-3acb68d58104-alertmanager-main-db\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:09:36.985962 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.985815 2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f8015b31-a308-44de-9299-3acb68d58104-web-config\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:09:36.985962 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.985822 2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8015b31-a308-44de-9299-3acb68d58104-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:09:36.985962 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:36.985830 2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f8015b31-a308-44de-9299-3acb68d58104-config-out\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:09:37.291903 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.291875 2581 generic.go:356] "Generic (PLEG): container finished" podID="f8015b31-a308-44de-9299-3acb68d58104" containerID="412a09eb2fac7a007c69dd14340f72aec16394386d3c1d6c199c8d1b9d7d975f" exitCode=0 Sep 18 21:09:37.291903 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.291896 2581 generic.go:356] "Generic (PLEG): container finished" podID="f8015b31-a308-44de-9299-3acb68d58104" containerID="d2fadefbce4eeea9949ecf98a196663a4bf374e6308243496b404782c8171814" exitCode=0 Sep 18 21:09:37.292100 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.291947 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f8015b31-a308-44de-9299-3acb68d58104","Type":"ContainerDied","Data":"412a09eb2fac7a007c69dd14340f72aec16394386d3c1d6c199c8d1b9d7d975f"} Sep 18 21:09:37.292100 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.291957 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.292100 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.292010 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f8015b31-a308-44de-9299-3acb68d58104","Type":"ContainerDied","Data":"d2fadefbce4eeea9949ecf98a196663a4bf374e6308243496b404782c8171814"} Sep 18 21:09:37.292100 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.292040 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f8015b31-a308-44de-9299-3acb68d58104","Type":"ContainerDied","Data":"ba9a17b96eeb223916e040169612a3dc760a6a763ccebdc784714cef8a3d748d"} Sep 18 21:09:37.292100 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.292071 2581 scope.go:117] "RemoveContainer" containerID="c8bc4acd4bb6740737feda8bf40a6f87f59e30bb46da9cff0c5f1f787abdd762" Sep 18 21:09:37.299799 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.299783 2581 scope.go:117] "RemoveContainer" containerID="412a09eb2fac7a007c69dd14340f72aec16394386d3c1d6c199c8d1b9d7d975f" Sep 18 21:09:37.306849 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.306830 2581 scope.go:117] "RemoveContainer" containerID="b62ecdfad07ef8e37295c6ce49588b4dfb652e6599d61b69aa9796ebd2861711" Sep 18 21:09:37.313971 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.313944 2581 scope.go:117] "RemoveContainer" containerID="d2fadefbce4eeea9949ecf98a196663a4bf374e6308243496b404782c8171814" Sep 18 21:09:37.314819 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.314801 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 21:09:37.319299 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.319274 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 21:09:37.321609 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.321594 2581 scope.go:117] "RemoveContainer" containerID="5af81d6113408c892f71aec8f44e08313f3574e246de13643d79b16eef20776e" Sep 18 21:09:37.329802 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.329787 2581 scope.go:117] "RemoveContainer" containerID="b4c96d2b8415c320f9678dbe826d3e82ec8a3115d10ef73f71892d2859b94538" Sep 18 21:09:37.336648 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.336631 2581 scope.go:117] "RemoveContainer" containerID="b4c499b1c68a81ad3106631e2ed9393f3757ece1f2f6a859c0997ac29de3858f" Sep 18 21:09:37.343948 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.343930 2581 scope.go:117] "RemoveContainer" containerID="c8bc4acd4bb6740737feda8bf40a6f87f59e30bb46da9cff0c5f1f787abdd762" Sep 18 21:09:37.344210 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:09:37.344193 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8bc4acd4bb6740737feda8bf40a6f87f59e30bb46da9cff0c5f1f787abdd762\": container with ID starting with c8bc4acd4bb6740737feda8bf40a6f87f59e30bb46da9cff0c5f1f787abdd762 not found: ID does not exist" containerID="c8bc4acd4bb6740737feda8bf40a6f87f59e30bb46da9cff0c5f1f787abdd762" Sep 18 21:09:37.344260 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.344218 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8bc4acd4bb6740737feda8bf40a6f87f59e30bb46da9cff0c5f1f787abdd762"} err="failed to get container status \"c8bc4acd4bb6740737feda8bf40a6f87f59e30bb46da9cff0c5f1f787abdd762\": rpc error: code = NotFound desc = could not find container \"c8bc4acd4bb6740737feda8bf40a6f87f59e30bb46da9cff0c5f1f787abdd762\": container with ID starting with c8bc4acd4bb6740737feda8bf40a6f87f59e30bb46da9cff0c5f1f787abdd762 not found: ID does not exist" Sep 18 21:09:37.344260 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.344238 2581 scope.go:117] "RemoveContainer" containerID="412a09eb2fac7a007c69dd14340f72aec16394386d3c1d6c199c8d1b9d7d975f" Sep 18 21:09:37.344511 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:09:37.344490 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"412a09eb2fac7a007c69dd14340f72aec16394386d3c1d6c199c8d1b9d7d975f\": container with ID starting with 412a09eb2fac7a007c69dd14340f72aec16394386d3c1d6c199c8d1b9d7d975f not found: ID does not exist" containerID="412a09eb2fac7a007c69dd14340f72aec16394386d3c1d6c199c8d1b9d7d975f" Sep 18 21:09:37.344553 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.344518 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"412a09eb2fac7a007c69dd14340f72aec16394386d3c1d6c199c8d1b9d7d975f"} err="failed to get container status \"412a09eb2fac7a007c69dd14340f72aec16394386d3c1d6c199c8d1b9d7d975f\": rpc error: code = NotFound desc = could not find container \"412a09eb2fac7a007c69dd14340f72aec16394386d3c1d6c199c8d1b9d7d975f\": container with ID starting with 412a09eb2fac7a007c69dd14340f72aec16394386d3c1d6c199c8d1b9d7d975f not found: ID does not exist" Sep 18 21:09:37.344553 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.344533 2581 scope.go:117] "RemoveContainer" containerID="b62ecdfad07ef8e37295c6ce49588b4dfb652e6599d61b69aa9796ebd2861711" Sep 18 21:09:37.344752 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:09:37.344733 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b62ecdfad07ef8e37295c6ce49588b4dfb652e6599d61b69aa9796ebd2861711\": container with ID starting with b62ecdfad07ef8e37295c6ce49588b4dfb652e6599d61b69aa9796ebd2861711 not found: ID does not exist" containerID="b62ecdfad07ef8e37295c6ce49588b4dfb652e6599d61b69aa9796ebd2861711" Sep 18 21:09:37.344790 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.344757 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b62ecdfad07ef8e37295c6ce49588b4dfb652e6599d61b69aa9796ebd2861711"} err="failed to get container status \"b62ecdfad07ef8e37295c6ce49588b4dfb652e6599d61b69aa9796ebd2861711\": rpc error: code = NotFound desc = could not find container \"b62ecdfad07ef8e37295c6ce49588b4dfb652e6599d61b69aa9796ebd2861711\": container with ID starting with b62ecdfad07ef8e37295c6ce49588b4dfb652e6599d61b69aa9796ebd2861711 not found: ID does not exist" Sep 18 21:09:37.344790 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.344771 2581 scope.go:117] "RemoveContainer" containerID="d2fadefbce4eeea9949ecf98a196663a4bf374e6308243496b404782c8171814" Sep 18 21:09:37.345010 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:09:37.344994 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2fadefbce4eeea9949ecf98a196663a4bf374e6308243496b404782c8171814\": container with ID starting with d2fadefbce4eeea9949ecf98a196663a4bf374e6308243496b404782c8171814 not found: ID does not exist" containerID="d2fadefbce4eeea9949ecf98a196663a4bf374e6308243496b404782c8171814" Sep 18 21:09:37.345049 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.345015 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2fadefbce4eeea9949ecf98a196663a4bf374e6308243496b404782c8171814"} err="failed to get container status \"d2fadefbce4eeea9949ecf98a196663a4bf374e6308243496b404782c8171814\": rpc error: code = NotFound desc = could not find container \"d2fadefbce4eeea9949ecf98a196663a4bf374e6308243496b404782c8171814\": container with ID starting with d2fadefbce4eeea9949ecf98a196663a4bf374e6308243496b404782c8171814 not found: ID does not exist" Sep 18 21:09:37.345049 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.345030 2581 scope.go:117] "RemoveContainer" containerID="5af81d6113408c892f71aec8f44e08313f3574e246de13643d79b16eef20776e" Sep 18 21:09:37.345267 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:09:37.345242 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5af81d6113408c892f71aec8f44e08313f3574e246de13643d79b16eef20776e\": container with ID starting with 5af81d6113408c892f71aec8f44e08313f3574e246de13643d79b16eef20776e not found: ID does not exist" containerID="5af81d6113408c892f71aec8f44e08313f3574e246de13643d79b16eef20776e" Sep 18 21:09:37.345313 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.345271 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5af81d6113408c892f71aec8f44e08313f3574e246de13643d79b16eef20776e"} err="failed to get container status \"5af81d6113408c892f71aec8f44e08313f3574e246de13643d79b16eef20776e\": rpc error: code = NotFound desc = could not find container \"5af81d6113408c892f71aec8f44e08313f3574e246de13643d79b16eef20776e\": container with ID starting with 5af81d6113408c892f71aec8f44e08313f3574e246de13643d79b16eef20776e not found: ID does not exist" Sep 18 21:09:37.345313 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.345284 2581 scope.go:117] "RemoveContainer" containerID="b4c96d2b8415c320f9678dbe826d3e82ec8a3115d10ef73f71892d2859b94538" Sep 18 21:09:37.345530 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:09:37.345514 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4c96d2b8415c320f9678dbe826d3e82ec8a3115d10ef73f71892d2859b94538\": container with ID starting with b4c96d2b8415c320f9678dbe826d3e82ec8a3115d10ef73f71892d2859b94538 not found: ID does not exist" containerID="b4c96d2b8415c320f9678dbe826d3e82ec8a3115d10ef73f71892d2859b94538" Sep 18 21:09:37.345577 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.345533 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4c96d2b8415c320f9678dbe826d3e82ec8a3115d10ef73f71892d2859b94538"} err="failed to get container status \"b4c96d2b8415c320f9678dbe826d3e82ec8a3115d10ef73f71892d2859b94538\": rpc error: code = NotFound desc = could not find container \"b4c96d2b8415c320f9678dbe826d3e82ec8a3115d10ef73f71892d2859b94538\": container with ID starting with b4c96d2b8415c320f9678dbe826d3e82ec8a3115d10ef73f71892d2859b94538 not found: ID does not exist" Sep 18 21:09:37.345577 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.345544 2581 scope.go:117] "RemoveContainer" containerID="b4c499b1c68a81ad3106631e2ed9393f3757ece1f2f6a859c0997ac29de3858f" Sep 18 21:09:37.345744 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:09:37.345730 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4c499b1c68a81ad3106631e2ed9393f3757ece1f2f6a859c0997ac29de3858f\": container with ID starting with b4c499b1c68a81ad3106631e2ed9393f3757ece1f2f6a859c0997ac29de3858f not found: ID does not exist" containerID="b4c499b1c68a81ad3106631e2ed9393f3757ece1f2f6a859c0997ac29de3858f" Sep 18 21:09:37.345785 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.345746 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4c499b1c68a81ad3106631e2ed9393f3757ece1f2f6a859c0997ac29de3858f"} err="failed to get container status \"b4c499b1c68a81ad3106631e2ed9393f3757ece1f2f6a859c0997ac29de3858f\": rpc error: code = NotFound desc = could not find container \"b4c499b1c68a81ad3106631e2ed9393f3757ece1f2f6a859c0997ac29de3858f\": container with ID starting with b4c499b1c68a81ad3106631e2ed9393f3757ece1f2f6a859c0997ac29de3858f not found: ID does not exist" Sep 18 21:09:37.345785 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.345757 2581 scope.go:117] "RemoveContainer" containerID="c8bc4acd4bb6740737feda8bf40a6f87f59e30bb46da9cff0c5f1f787abdd762" Sep 18 21:09:37.345982 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.345965 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8bc4acd4bb6740737feda8bf40a6f87f59e30bb46da9cff0c5f1f787abdd762"} err="failed to get container status \"c8bc4acd4bb6740737feda8bf40a6f87f59e30bb46da9cff0c5f1f787abdd762\": rpc error: code = NotFound desc = could not find container \"c8bc4acd4bb6740737feda8bf40a6f87f59e30bb46da9cff0c5f1f787abdd762\": container with ID starting with c8bc4acd4bb6740737feda8bf40a6f87f59e30bb46da9cff0c5f1f787abdd762 not found: ID does not exist" Sep 18 21:09:37.345982 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.345980 2581 scope.go:117] "RemoveContainer" containerID="412a09eb2fac7a007c69dd14340f72aec16394386d3c1d6c199c8d1b9d7d975f" Sep 18 21:09:37.346215 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.346199 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"412a09eb2fac7a007c69dd14340f72aec16394386d3c1d6c199c8d1b9d7d975f"} err="failed to get container status \"412a09eb2fac7a007c69dd14340f72aec16394386d3c1d6c199c8d1b9d7d975f\": rpc error: code = NotFound desc = could not find container \"412a09eb2fac7a007c69dd14340f72aec16394386d3c1d6c199c8d1b9d7d975f\": container with ID starting with 412a09eb2fac7a007c69dd14340f72aec16394386d3c1d6c199c8d1b9d7d975f not found: ID does not exist" Sep 18 21:09:37.346253 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.346219 2581 scope.go:117] "RemoveContainer" containerID="b62ecdfad07ef8e37295c6ce49588b4dfb652e6599d61b69aa9796ebd2861711" Sep 18 21:09:37.346436 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.346419 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b62ecdfad07ef8e37295c6ce49588b4dfb652e6599d61b69aa9796ebd2861711"} err="failed to get container status \"b62ecdfad07ef8e37295c6ce49588b4dfb652e6599d61b69aa9796ebd2861711\": rpc error: code = NotFound desc = could not find container \"b62ecdfad07ef8e37295c6ce49588b4dfb652e6599d61b69aa9796ebd2861711\": container with ID starting with b62ecdfad07ef8e37295c6ce49588b4dfb652e6599d61b69aa9796ebd2861711 not found: ID does not exist" Sep 18 21:09:37.346436 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.346435 2581 scope.go:117] "RemoveContainer" containerID="d2fadefbce4eeea9949ecf98a196663a4bf374e6308243496b404782c8171814" Sep 18 21:09:37.346631 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.346617 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2fadefbce4eeea9949ecf98a196663a4bf374e6308243496b404782c8171814"} err="failed to get container status \"d2fadefbce4eeea9949ecf98a196663a4bf374e6308243496b404782c8171814\": rpc error: code = NotFound desc = could not find container \"d2fadefbce4eeea9949ecf98a196663a4bf374e6308243496b404782c8171814\": container with ID starting with d2fadefbce4eeea9949ecf98a196663a4bf374e6308243496b404782c8171814 not found: ID does not exist" Sep 18 21:09:37.346672 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.346632 2581 scope.go:117] "RemoveContainer" containerID="5af81d6113408c892f71aec8f44e08313f3574e246de13643d79b16eef20776e" Sep 18 21:09:37.346832 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.346819 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5af81d6113408c892f71aec8f44e08313f3574e246de13643d79b16eef20776e"} err="failed to get container status \"5af81d6113408c892f71aec8f44e08313f3574e246de13643d79b16eef20776e\": rpc error: code = NotFound desc = could not find container \"5af81d6113408c892f71aec8f44e08313f3574e246de13643d79b16eef20776e\": container with ID starting with 5af81d6113408c892f71aec8f44e08313f3574e246de13643d79b16eef20776e not found: ID does not exist" Sep 18 21:09:37.346878 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.346832 2581 scope.go:117] "RemoveContainer" containerID="b4c96d2b8415c320f9678dbe826d3e82ec8a3115d10ef73f71892d2859b94538" Sep 18 21:09:37.347033 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.347018 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4c96d2b8415c320f9678dbe826d3e82ec8a3115d10ef73f71892d2859b94538"} err="failed to get container status \"b4c96d2b8415c320f9678dbe826d3e82ec8a3115d10ef73f71892d2859b94538\": rpc error: code = NotFound desc = could not find container \"b4c96d2b8415c320f9678dbe826d3e82ec8a3115d10ef73f71892d2859b94538\": container with ID starting with b4c96d2b8415c320f9678dbe826d3e82ec8a3115d10ef73f71892d2859b94538 not found: ID does not exist" Sep 18 21:09:37.347102 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.347033 2581 scope.go:117] "RemoveContainer" containerID="b4c499b1c68a81ad3106631e2ed9393f3757ece1f2f6a859c0997ac29de3858f" Sep 18 21:09:37.347274 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.347260 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4c499b1c68a81ad3106631e2ed9393f3757ece1f2f6a859c0997ac29de3858f"} err="failed to get container status \"b4c499b1c68a81ad3106631e2ed9393f3757ece1f2f6a859c0997ac29de3858f\": rpc error: code = NotFound desc = could not find container \"b4c499b1c68a81ad3106631e2ed9393f3757ece1f2f6a859c0997ac29de3858f\": container with ID starting with b4c499b1c68a81ad3106631e2ed9393f3757ece1f2f6a859c0997ac29de3858f not found: ID does not exist" Sep 18 21:09:37.349904 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.349884 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 21:09:37.350175 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.350143 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8015b31-a308-44de-9299-3acb68d58104" containerName="kube-rbac-proxy-web" Sep 18 21:09:37.350227 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.350179 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8015b31-a308-44de-9299-3acb68d58104" containerName="kube-rbac-proxy-web" Sep 18 21:09:37.350227 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.350187 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8015b31-a308-44de-9299-3acb68d58104" containerName="prom-label-proxy" Sep 18 21:09:37.350227 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.350193 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8015b31-a308-44de-9299-3acb68d58104" containerName="prom-label-proxy" Sep 18 21:09:37.350227 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.350208 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8015b31-a308-44de-9299-3acb68d58104" containerName="kube-rbac-proxy-metric" Sep 18 21:09:37.350227 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.350216 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8015b31-a308-44de-9299-3acb68d58104" containerName="kube-rbac-proxy-metric" Sep 18 21:09:37.350227 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.350225 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8015b31-a308-44de-9299-3acb68d58104" containerName="init-config-reloader" Sep 18 21:09:37.350227 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.350229 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8015b31-a308-44de-9299-3acb68d58104" containerName="init-config-reloader" Sep 18 21:09:37.350417 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.350235 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8015b31-a308-44de-9299-3acb68d58104" containerName="config-reloader" Sep 18 21:09:37.350417 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.350241 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8015b31-a308-44de-9299-3acb68d58104" containerName="config-reloader" Sep 18 21:09:37.350417 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.350246 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8015b31-a308-44de-9299-3acb68d58104" containerName="alertmanager" Sep 18 21:09:37.350417 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.350250 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8015b31-a308-44de-9299-3acb68d58104" containerName="alertmanager" Sep 18 21:09:37.350417 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.350257 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8015b31-a308-44de-9299-3acb68d58104" containerName="kube-rbac-proxy" Sep 18 21:09:37.350417 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.350261 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8015b31-a308-44de-9299-3acb68d58104" containerName="kube-rbac-proxy" Sep 18 21:09:37.350417 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.350274 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce1d3f40-3c78-4465-aa1f-e684e23455cf" containerName="registry" Sep 18 21:09:37.350417 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.350278 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce1d3f40-3c78-4465-aa1f-e684e23455cf" containerName="registry" Sep 18 21:09:37.350417 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.350284 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bf43279-386a-4526-af8d-eb9981658d54" containerName="console" Sep 18 21:09:37.350417 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.350289 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bf43279-386a-4526-af8d-eb9981658d54" containerName="console" Sep 18 21:09:37.350417 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.350335 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bf43279-386a-4526-af8d-eb9981658d54" containerName="console" Sep 18 21:09:37.350417 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.350344 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce1d3f40-3c78-4465-aa1f-e684e23455cf" containerName="registry" Sep 18 21:09:37.350417 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.350351 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8015b31-a308-44de-9299-3acb68d58104" containerName="kube-rbac-proxy-web" Sep 18 21:09:37.350417 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.350356 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8015b31-a308-44de-9299-3acb68d58104" containerName="kube-rbac-proxy" Sep 18 21:09:37.350417 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.350361 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8015b31-a308-44de-9299-3acb68d58104" containerName="prom-label-proxy" Sep 18 21:09:37.350417 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.350366 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8015b31-a308-44de-9299-3acb68d58104" containerName="config-reloader" Sep 18 21:09:37.350417 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.350372 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8015b31-a308-44de-9299-3acb68d58104" containerName="alertmanager" Sep 18 21:09:37.350417 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.350377 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8015b31-a308-44de-9299-3acb68d58104" containerName="kube-rbac-proxy-metric" Sep 18 21:09:37.353733 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.353714 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.356491 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.356470 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 18 21:09:37.356491 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.356487 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 18 21:09:37.356645 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.356500 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 18 21:09:37.356645 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.356470 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 18 21:09:37.356645 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.356594 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bq8vk\"" Sep 18 21:09:37.356787 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.356668 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 18 21:09:37.356787 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.356738 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 18 21:09:37.356860 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.356811 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 18 21:09:37.356932 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.356919 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 18 21:09:37.362641 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.362622 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 18 21:09:37.377040 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.377016 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 21:09:37.490300 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.490263 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/62530d52-82db-4274-b128-c60891ae78fc-config-volume\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.490300 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.490302 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/62530d52-82db-4274-b128-c60891ae78fc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.490536 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.490321 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62530d52-82db-4274-b128-c60891ae78fc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.490536 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.490420 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/62530d52-82db-4274-b128-c60891ae78fc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.490536 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.490474 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/62530d52-82db-4274-b128-c60891ae78fc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.490536 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.490505 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62530d52-82db-4274-b128-c60891ae78fc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.490742 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.490542 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62530d52-82db-4274-b128-c60891ae78fc-web-config\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.490742 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.490595 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62530d52-82db-4274-b128-c60891ae78fc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.490742 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.490621 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62530d52-82db-4274-b128-c60891ae78fc-config-out\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.490742 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.490639 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/62530d52-82db-4274-b128-c60891ae78fc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.490742 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.490655 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62530d52-82db-4274-b128-c60891ae78fc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.490742 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.490710 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62530d52-82db-4274-b128-c60891ae78fc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.490742 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.490741 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vszqq\" (UniqueName: \"kubernetes.io/projected/62530d52-82db-4274-b128-c60891ae78fc-kube-api-access-vszqq\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.591559 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.591481 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/62530d52-82db-4274-b128-c60891ae78fc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.591559 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.591518 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62530d52-82db-4274-b128-c60891ae78fc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.591559 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.591547 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62530d52-82db-4274-b128-c60891ae78fc-web-config\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.591805 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.591585 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62530d52-82db-4274-b128-c60891ae78fc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.591805 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.591608 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62530d52-82db-4274-b128-c60891ae78fc-config-out\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.591805 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.591631 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/62530d52-82db-4274-b128-c60891ae78fc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.591805 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.591762 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62530d52-82db-4274-b128-c60891ae78fc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.592020 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.591818 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62530d52-82db-4274-b128-c60891ae78fc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.592020 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.591847 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vszqq\" (UniqueName: \"kubernetes.io/projected/62530d52-82db-4274-b128-c60891ae78fc-kube-api-access-vszqq\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.592020 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.591890 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/62530d52-82db-4274-b128-c60891ae78fc-config-volume\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.592020 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.591915 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/62530d52-82db-4274-b128-c60891ae78fc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.592020 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.591941 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62530d52-82db-4274-b128-c60891ae78fc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.592020 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.591987 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/62530d52-82db-4274-b128-c60891ae78fc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.593253 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.592889 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62530d52-82db-4274-b128-c60891ae78fc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.594789 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.594738 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62530d52-82db-4274-b128-c60891ae78fc-config-out\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.594903 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.594786 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62530d52-82db-4274-b128-c60891ae78fc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.594903 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.594849 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62530d52-82db-4274-b128-c60891ae78fc-web-config\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.595023 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.595000 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62530d52-82db-4274-b128-c60891ae78fc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.595127 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.595111 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/62530d52-82db-4274-b128-c60891ae78fc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.595221 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.595191 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/62530d52-82db-4274-b128-c60891ae78fc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.595319 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.595295 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/62530d52-82db-4274-b128-c60891ae78fc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.595419 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.595361 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/62530d52-82db-4274-b128-c60891ae78fc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.595651 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.595635 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/62530d52-82db-4274-b128-c60891ae78fc-config-volume\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.595691 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.595678 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62530d52-82db-4274-b128-c60891ae78fc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.597047 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.597028 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62530d52-82db-4274-b128-c60891ae78fc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.604383 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.604362 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vszqq\" (UniqueName: \"kubernetes.io/projected/62530d52-82db-4274-b128-c60891ae78fc-kube-api-access-vszqq\") pod \"alertmanager-main-0\" (UID: \"62530d52-82db-4274-b128-c60891ae78fc\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.663538 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.663503 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:09:37.945892 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:37.945867 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 21:09:38.297502 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:38.297468 2581 generic.go:356] "Generic (PLEG): container finished" podID="62530d52-82db-4274-b128-c60891ae78fc" containerID="0a4bdd386a8a33a53327e914957224d7e9f14f53334679724b0da48f75e78849" exitCode=0 Sep 18 21:09:38.297640 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:38.297551 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62530d52-82db-4274-b128-c60891ae78fc","Type":"ContainerDied","Data":"0a4bdd386a8a33a53327e914957224d7e9f14f53334679724b0da48f75e78849"} Sep 18 21:09:38.297708 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:38.297648 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62530d52-82db-4274-b128-c60891ae78fc","Type":"ContainerStarted","Data":"12c2669ec9357690b8b891ab6892c4755b95edc07b32ca7c8ecfde79e8099ee4"} Sep 18 21:09:39.269106 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.269075 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8015b31-a308-44de-9299-3acb68d58104" path="/var/lib/kubelet/pods/f8015b31-a308-44de-9299-3acb68d58104/volumes" Sep 18 21:09:39.306786 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.306754 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62530d52-82db-4274-b128-c60891ae78fc","Type":"ContainerStarted","Data":"8db459b6d45cd707780870b4d15c830e5ccc12113416358d308107e1ffcf6fd8"} Sep 18 21:09:39.306938 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.306827 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62530d52-82db-4274-b128-c60891ae78fc","Type":"ContainerStarted","Data":"ff2b83e846141f394467de996d9179725bff26c2dba51d8849fc012d5f4323f7"} Sep 18 21:09:39.306938 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.306866 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62530d52-82db-4274-b128-c60891ae78fc","Type":"ContainerStarted","Data":"eec6305c6317a632c8ef238cbabd78a64e2285cc5dd2386f549769c56942f623"} Sep 18 21:09:39.306938 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.306902 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62530d52-82db-4274-b128-c60891ae78fc","Type":"ContainerStarted","Data":"0cc3a7888fb21cd450aabe8bc84bae5cc4ef687cb22ea1c5056bc7441232f816"} Sep 18 21:09:39.307085 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.306938 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62530d52-82db-4274-b128-c60891ae78fc","Type":"ContainerStarted","Data":"78fe9ae8dc27a2f001a26f6f0c97ac2ba285a5e1ed5e0b135999ba8025d3d387"} Sep 18 21:09:39.307085 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.306985 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62530d52-82db-4274-b128-c60891ae78fc","Type":"ContainerStarted","Data":"31ea65fca5de4c60936cb6b6fca1a597bdcfe0f753edf0a8c8f51aa169b8fcce"} Sep 18 21:09:39.339653 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.339587 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.3256943359999998 podStartE2EDuration="2.339567953s" totalImagesPullingTime="0s" totalInitContainerRuntime="13.873617ms" isStatefulPod=false podCreationTimestamp="2026-09-18 21:09:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:09:39.338172199 +0000 UTC m=+218.558284590" watchObservedRunningTime="2026-09-18 21:09:39.339567953 +0000 UTC m=+218.559680342" Sep 18 21:09:39.590139 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.588570 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-69d7fcfdf7-xcw2x"] Sep 18 21:09:39.591876 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.591855 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-69d7fcfdf7-xcw2x" Sep 18 21:09:39.595207 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.595178 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 18 21:09:39.595333 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.595294 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 18 21:09:39.595333 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.595181 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 18 21:09:39.595455 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.595356 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 18 21:09:39.595585 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.595569 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-45z98\"" Sep 18 21:09:39.595647 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.595636 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 18 21:09:39.605207 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.604533 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 18 21:09:39.611019 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.610993 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-69d7fcfdf7-xcw2x"] Sep 18 21:09:39.707807 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.707776 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1bb0610d-5f96-47c2-ba0a-aabfb7abf448-federate-client-tls\") pod \"telemeter-client-69d7fcfdf7-xcw2x\" (UID: \"1bb0610d-5f96-47c2-ba0a-aabfb7abf448\") " pod="openshift-monitoring/telemeter-client-69d7fcfdf7-xcw2x" Sep 18 21:09:39.707972 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.707822 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1bb0610d-5f96-47c2-ba0a-aabfb7abf448-secret-telemeter-client\") pod \"telemeter-client-69d7fcfdf7-xcw2x\" (UID: \"1bb0610d-5f96-47c2-ba0a-aabfb7abf448\") " pod="openshift-monitoring/telemeter-client-69d7fcfdf7-xcw2x" Sep 18 21:09:39.707972 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.707857 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bb0610d-5f96-47c2-ba0a-aabfb7abf448-metrics-client-ca\") pod \"telemeter-client-69d7fcfdf7-xcw2x\" (UID: \"1bb0610d-5f96-47c2-ba0a-aabfb7abf448\") " pod="openshift-monitoring/telemeter-client-69d7fcfdf7-xcw2x" Sep 18 21:09:39.707972 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.707910 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cts89\" (UniqueName: \"kubernetes.io/projected/1bb0610d-5f96-47c2-ba0a-aabfb7abf448-kube-api-access-cts89\") pod \"telemeter-client-69d7fcfdf7-xcw2x\" (UID: \"1bb0610d-5f96-47c2-ba0a-aabfb7abf448\") " pod="openshift-monitoring/telemeter-client-69d7fcfdf7-xcw2x" Sep 18 21:09:39.707972 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.707957 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb0610d-5f96-47c2-ba0a-aabfb7abf448-telemeter-trusted-ca-bundle\") pod \"telemeter-client-69d7fcfdf7-xcw2x\" (UID: \"1bb0610d-5f96-47c2-ba0a-aabfb7abf448\") " pod="openshift-monitoring/telemeter-client-69d7fcfdf7-xcw2x" Sep 18 21:09:39.708102 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.707983 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1bb0610d-5f96-47c2-ba0a-aabfb7abf448-telemeter-client-tls\") pod \"telemeter-client-69d7fcfdf7-xcw2x\" (UID: \"1bb0610d-5f96-47c2-ba0a-aabfb7abf448\") " pod="openshift-monitoring/telemeter-client-69d7fcfdf7-xcw2x" Sep 18 21:09:39.708102 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.708022 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb0610d-5f96-47c2-ba0a-aabfb7abf448-serving-certs-ca-bundle\") pod \"telemeter-client-69d7fcfdf7-xcw2x\" (UID: \"1bb0610d-5f96-47c2-ba0a-aabfb7abf448\") " pod="openshift-monitoring/telemeter-client-69d7fcfdf7-xcw2x" Sep 18 21:09:39.708102 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.708051 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1bb0610d-5f96-47c2-ba0a-aabfb7abf448-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-69d7fcfdf7-xcw2x\" (UID: \"1bb0610d-5f96-47c2-ba0a-aabfb7abf448\") " pod="openshift-monitoring/telemeter-client-69d7fcfdf7-xcw2x" Sep 18 21:09:39.808916 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.808880 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1bb0610d-5f96-47c2-ba0a-aabfb7abf448-secret-telemeter-client\") pod \"telemeter-client-69d7fcfdf7-xcw2x\" (UID: \"1bb0610d-5f96-47c2-ba0a-aabfb7abf448\") " pod="openshift-monitoring/telemeter-client-69d7fcfdf7-xcw2x" Sep 18 21:09:39.809086 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.808925 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bb0610d-5f96-47c2-ba0a-aabfb7abf448-metrics-client-ca\") pod \"telemeter-client-69d7fcfdf7-xcw2x\" (UID: \"1bb0610d-5f96-47c2-ba0a-aabfb7abf448\") " pod="openshift-monitoring/telemeter-client-69d7fcfdf7-xcw2x" Sep 18 21:09:39.809086 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.808945 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cts89\" (UniqueName: \"kubernetes.io/projected/1bb0610d-5f96-47c2-ba0a-aabfb7abf448-kube-api-access-cts89\") pod \"telemeter-client-69d7fcfdf7-xcw2x\" (UID: \"1bb0610d-5f96-47c2-ba0a-aabfb7abf448\") " pod="openshift-monitoring/telemeter-client-69d7fcfdf7-xcw2x" Sep 18 21:09:39.809086 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.808964 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb0610d-5f96-47c2-ba0a-aabfb7abf448-telemeter-trusted-ca-bundle\") pod \"telemeter-client-69d7fcfdf7-xcw2x\" (UID: \"1bb0610d-5f96-47c2-ba0a-aabfb7abf448\") " pod="openshift-monitoring/telemeter-client-69d7fcfdf7-xcw2x" Sep 18 21:09:39.809086 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.808994 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1bb0610d-5f96-47c2-ba0a-aabfb7abf448-telemeter-client-tls\") pod \"telemeter-client-69d7fcfdf7-xcw2x\" (UID: \"1bb0610d-5f96-47c2-ba0a-aabfb7abf448\") " pod="openshift-monitoring/telemeter-client-69d7fcfdf7-xcw2x" Sep 18 21:09:39.809086 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.809022 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb0610d-5f96-47c2-ba0a-aabfb7abf448-serving-certs-ca-bundle\") pod \"telemeter-client-69d7fcfdf7-xcw2x\" (UID: \"1bb0610d-5f96-47c2-ba0a-aabfb7abf448\") " pod="openshift-monitoring/telemeter-client-69d7fcfdf7-xcw2x" Sep 18 21:09:39.809086 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.809054 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1bb0610d-5f96-47c2-ba0a-aabfb7abf448-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-69d7fcfdf7-xcw2x\" (UID: \"1bb0610d-5f96-47c2-ba0a-aabfb7abf448\") " pod="openshift-monitoring/telemeter-client-69d7fcfdf7-xcw2x" Sep 18 21:09:39.809504 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.809109 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1bb0610d-5f96-47c2-ba0a-aabfb7abf448-federate-client-tls\") pod \"telemeter-client-69d7fcfdf7-xcw2x\" (UID: \"1bb0610d-5f96-47c2-ba0a-aabfb7abf448\") " pod="openshift-monitoring/telemeter-client-69d7fcfdf7-xcw2x" Sep 18 21:09:39.809830 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.809801 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb0610d-5f96-47c2-ba0a-aabfb7abf448-serving-certs-ca-bundle\") pod \"telemeter-client-69d7fcfdf7-xcw2x\" (UID: \"1bb0610d-5f96-47c2-ba0a-aabfb7abf448\") " pod="openshift-monitoring/telemeter-client-69d7fcfdf7-xcw2x" Sep 18 21:09:39.809943 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.809853 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb0610d-5f96-47c2-ba0a-aabfb7abf448-telemeter-trusted-ca-bundle\") pod \"telemeter-client-69d7fcfdf7-xcw2x\" (UID: \"1bb0610d-5f96-47c2-ba0a-aabfb7abf448\") " pod="openshift-monitoring/telemeter-client-69d7fcfdf7-xcw2x" Sep 18 21:09:39.809943 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.809882 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bb0610d-5f96-47c2-ba0a-aabfb7abf448-metrics-client-ca\") pod \"telemeter-client-69d7fcfdf7-xcw2x\" (UID: \"1bb0610d-5f96-47c2-ba0a-aabfb7abf448\") " pod="openshift-monitoring/telemeter-client-69d7fcfdf7-xcw2x" Sep 18 21:09:39.811743 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.811717 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1bb0610d-5f96-47c2-ba0a-aabfb7abf448-secret-telemeter-client\") pod \"telemeter-client-69d7fcfdf7-xcw2x\" (UID: \"1bb0610d-5f96-47c2-ba0a-aabfb7abf448\") " pod="openshift-monitoring/telemeter-client-69d7fcfdf7-xcw2x" Sep 18 21:09:39.812136 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.812110 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1bb0610d-5f96-47c2-ba0a-aabfb7abf448-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-69d7fcfdf7-xcw2x\" (UID: \"1bb0610d-5f96-47c2-ba0a-aabfb7abf448\") " pod="openshift-monitoring/telemeter-client-69d7fcfdf7-xcw2x" Sep 18 21:09:39.812252 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.812217 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1bb0610d-5f96-47c2-ba0a-aabfb7abf448-federate-client-tls\") pod \"telemeter-client-69d7fcfdf7-xcw2x\" (UID: \"1bb0610d-5f96-47c2-ba0a-aabfb7abf448\") " pod="openshift-monitoring/telemeter-client-69d7fcfdf7-xcw2x" Sep 18 21:09:39.812320 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.812304 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1bb0610d-5f96-47c2-ba0a-aabfb7abf448-telemeter-client-tls\") pod \"telemeter-client-69d7fcfdf7-xcw2x\" (UID: \"1bb0610d-5f96-47c2-ba0a-aabfb7abf448\") " pod="openshift-monitoring/telemeter-client-69d7fcfdf7-xcw2x" Sep 18 21:09:39.818242 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.818221 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cts89\" (UniqueName: \"kubernetes.io/projected/1bb0610d-5f96-47c2-ba0a-aabfb7abf448-kube-api-access-cts89\") pod \"telemeter-client-69d7fcfdf7-xcw2x\" (UID: \"1bb0610d-5f96-47c2-ba0a-aabfb7abf448\") " pod="openshift-monitoring/telemeter-client-69d7fcfdf7-xcw2x" Sep 18 21:09:39.890473 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.890399 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 21:09:39.890947 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.890719 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e71cae21-8003-4168-b058-02c885648c5c" containerName="prometheus" containerID="cri-o://e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32" gracePeriod=600 Sep 18 21:09:39.890947 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.890755 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e71cae21-8003-4168-b058-02c885648c5c" containerName="thanos-sidecar" containerID="cri-o://d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52" gracePeriod=600 Sep 18 21:09:39.890947 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.890762 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e71cae21-8003-4168-b058-02c885648c5c" containerName="config-reloader" containerID="cri-o://34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276" gracePeriod=600 Sep 18 21:09:39.890947 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.890813 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e71cae21-8003-4168-b058-02c885648c5c" containerName="kube-rbac-proxy-thanos" containerID="cri-o://7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de" gracePeriod=600 Sep 18 21:09:39.890947 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.890725 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e71cae21-8003-4168-b058-02c885648c5c" containerName="kube-rbac-proxy" containerID="cri-o://c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8" gracePeriod=600 Sep 18 21:09:39.890947 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.890734 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e71cae21-8003-4168-b058-02c885648c5c" containerName="kube-rbac-proxy-web" containerID="cri-o://a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95" gracePeriod=600 Sep 18 21:09:39.906351 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:39.906327 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-69d7fcfdf7-xcw2x" Sep 18 21:09:40.136516 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.136363 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.213934 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.212615 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e71cae21-8003-4168-b058-02c885648c5c-config-out\") pod \"e71cae21-8003-4168-b058-02c885648c5c\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " Sep 18 21:09:40.213934 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.212662 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"e71cae21-8003-4168-b058-02c885648c5c\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " Sep 18 21:09:40.213934 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.212712 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-thanos-prometheus-http-client-file\") pod \"e71cae21-8003-4168-b058-02c885648c5c\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " Sep 18 21:09:40.213934 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.212753 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e71cae21-8003-4168-b058-02c885648c5c-tls-assets\") pod \"e71cae21-8003-4168-b058-02c885648c5c\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " Sep 18 21:09:40.213934 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.212788 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e71cae21-8003-4168-b058-02c885648c5c-prometheus-k8s-db\") pod \"e71cae21-8003-4168-b058-02c885648c5c\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " Sep 18 21:09:40.213934 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.212822 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-secret-kube-rbac-proxy\") pod \"e71cae21-8003-4168-b058-02c885648c5c\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " Sep 18 21:09:40.213934 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.212849 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"e71cae21-8003-4168-b058-02c885648c5c\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " Sep 18 21:09:40.213934 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.212883 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-prometheus-k8s-rulefiles-0\") pod \"e71cae21-8003-4168-b058-02c885648c5c\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " Sep 18 21:09:40.213934 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.212907 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48vkp\" (UniqueName: \"kubernetes.io/projected/e71cae21-8003-4168-b058-02c885648c5c-kube-api-access-48vkp\") pod \"e71cae21-8003-4168-b058-02c885648c5c\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " Sep 18 21:09:40.213934 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.212944 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-configmap-metrics-client-ca\") pod \"e71cae21-8003-4168-b058-02c885648c5c\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " Sep 18 21:09:40.213934 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.212968 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-prometheus-k8s-rulefiles-1\") pod \"e71cae21-8003-4168-b058-02c885648c5c\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " Sep 18 21:09:40.213934 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.213002 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-secret-prometheus-k8s-tls\") pod \"e71cae21-8003-4168-b058-02c885648c5c\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " Sep 18 21:09:40.213934 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.213035 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-prometheus-trusted-ca-bundle\") pod \"e71cae21-8003-4168-b058-02c885648c5c\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " Sep 18 21:09:40.213934 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.213066 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-config\") pod \"e71cae21-8003-4168-b058-02c885648c5c\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " Sep 18 21:09:40.213934 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.213112 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-secret-grpc-tls\") pod \"e71cae21-8003-4168-b058-02c885648c5c\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " Sep 18 21:09:40.213934 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.213137 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-configmap-kubelet-serving-ca-bundle\") pod \"e71cae21-8003-4168-b058-02c885648c5c\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " Sep 18 21:09:40.213934 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.213196 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-web-config\") pod \"e71cae21-8003-4168-b058-02c885648c5c\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " Sep 18 21:09:40.213934 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.213226 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-configmap-serving-certs-ca-bundle\") pod \"e71cae21-8003-4168-b058-02c885648c5c\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " Sep 18 21:09:40.214872 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.213249 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-secret-metrics-client-certs\") pod \"e71cae21-8003-4168-b058-02c885648c5c\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " Sep 18 21:09:40.214872 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.213279 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-prometheus-k8s-rulefiles-2\") pod \"e71cae21-8003-4168-b058-02c885648c5c\" (UID: \"e71cae21-8003-4168-b058-02c885648c5c\") " Sep 18 21:09:40.214872 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.213741 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "e71cae21-8003-4168-b058-02c885648c5c" (UID: "e71cae21-8003-4168-b058-02c885648c5c"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:09:40.214872 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.213775 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "e71cae21-8003-4168-b058-02c885648c5c" (UID: "e71cae21-8003-4168-b058-02c885648c5c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:09:40.216466 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.216049 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "e71cae21-8003-4168-b058-02c885648c5c" (UID: "e71cae21-8003-4168-b058-02c885648c5c"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:09:40.218069 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.217974 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "e71cae21-8003-4168-b058-02c885648c5c" (UID: "e71cae21-8003-4168-b058-02c885648c5c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:09:40.218212 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.218180 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "e71cae21-8003-4168-b058-02c885648c5c" (UID: "e71cae21-8003-4168-b058-02c885648c5c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:09:40.218818 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.218699 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e71cae21-8003-4168-b058-02c885648c5c-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "e71cae21-8003-4168-b058-02c885648c5c" (UID: "e71cae21-8003-4168-b058-02c885648c5c"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 21:09:40.219218 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.219180 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "e71cae21-8003-4168-b058-02c885648c5c" (UID: "e71cae21-8003-4168-b058-02c885648c5c"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:09:40.219553 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.219519 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e71cae21-8003-4168-b058-02c885648c5c-config-out" (OuterVolumeSpecName: "config-out") pod "e71cae21-8003-4168-b058-02c885648c5c" (UID: "e71cae21-8003-4168-b058-02c885648c5c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 21:09:40.219752 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.219711 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "e71cae21-8003-4168-b058-02c885648c5c" (UID: "e71cae21-8003-4168-b058-02c885648c5c"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:09:40.219859 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.219829 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e71cae21-8003-4168-b058-02c885648c5c-kube-api-access-48vkp" (OuterVolumeSpecName: "kube-api-access-48vkp") pod "e71cae21-8003-4168-b058-02c885648c5c" (UID: "e71cae21-8003-4168-b058-02c885648c5c"). InnerVolumeSpecName "kube-api-access-48vkp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 21:09:40.220284 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.220247 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "e71cae21-8003-4168-b058-02c885648c5c" (UID: "e71cae21-8003-4168-b058-02c885648c5c"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:09:40.221053 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.220929 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "e71cae21-8003-4168-b058-02c885648c5c" (UID: "e71cae21-8003-4168-b058-02c885648c5c"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:09:40.221053 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.221017 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "e71cae21-8003-4168-b058-02c885648c5c" (UID: "e71cae21-8003-4168-b058-02c885648c5c"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:09:40.221350 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.221315 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-config" (OuterVolumeSpecName: "config") pod "e71cae21-8003-4168-b058-02c885648c5c" (UID: "e71cae21-8003-4168-b058-02c885648c5c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:09:40.221350 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.221318 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e71cae21-8003-4168-b058-02c885648c5c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e71cae21-8003-4168-b058-02c885648c5c" (UID: "e71cae21-8003-4168-b058-02c885648c5c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 21:09:40.221643 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.221619 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "e71cae21-8003-4168-b058-02c885648c5c" (UID: "e71cae21-8003-4168-b058-02c885648c5c"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:09:40.222945 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.222881 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "e71cae21-8003-4168-b058-02c885648c5c" (UID: "e71cae21-8003-4168-b058-02c885648c5c"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:09:40.223040 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.222964 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "e71cae21-8003-4168-b058-02c885648c5c" (UID: "e71cae21-8003-4168-b058-02c885648c5c"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:09:40.223402 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.223374 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "e71cae21-8003-4168-b058-02c885648c5c" (UID: "e71cae21-8003-4168-b058-02c885648c5c"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:09:40.233083 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.233059 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-69d7fcfdf7-xcw2x"] Sep 18 21:09:40.237671 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:09:40.237636 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bb0610d_5f96_47c2_ba0a_aabfb7abf448.slice/crio-073e02d69c3d464db37dfa78229b974e9ae75683aaefc97ff82fa3e019f02545 WatchSource:0}: Error finding container 073e02d69c3d464db37dfa78229b974e9ae75683aaefc97ff82fa3e019f02545: Status 404 returned error can't find the container with id 073e02d69c3d464db37dfa78229b974e9ae75683aaefc97ff82fa3e019f02545 Sep 18 21:09:40.238118 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.238091 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-web-config" (OuterVolumeSpecName: "web-config") pod "e71cae21-8003-4168-b058-02c885648c5c" (UID: "e71cae21-8003-4168-b058-02c885648c5c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:09:40.311784 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.311747 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-69d7fcfdf7-xcw2x" event={"ID":"1bb0610d-5f96-47c2-ba0a-aabfb7abf448","Type":"ContainerStarted","Data":"073e02d69c3d464db37dfa78229b974e9ae75683aaefc97ff82fa3e019f02545"} Sep 18 21:09:40.313933 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.313909 2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e71cae21-8003-4168-b058-02c885648c5c-tls-assets\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:09:40.314068 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.313934 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e71cae21-8003-4168-b058-02c885648c5c-prometheus-k8s-db\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:09:40.314068 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.313952 2581 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-secret-kube-rbac-proxy\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:09:40.314068 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.313969 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:09:40.314068 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.313985 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:09:40.314068 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.313998 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48vkp\" (UniqueName: \"kubernetes.io/projected/e71cae21-8003-4168-b058-02c885648c5c-kube-api-access-48vkp\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:09:40.314068 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.314006 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-configmap-metrics-client-ca\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:09:40.314068 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.314016 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:09:40.314068 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.314025 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:09:40.314068 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.314034 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:09:40.314068 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.314042 2581 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-config\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:09:40.314068 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.314050 2581 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-secret-grpc-tls\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:09:40.314068 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.314066 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:09:40.314068 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.314073 2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-web-config\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:09:40.314536 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.314081 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:09:40.314536 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.314089 2581 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-secret-metrics-client-certs\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:09:40.314536 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.314097 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e71cae21-8003-4168-b058-02c885648c5c-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:09:40.314536 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.314106 2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e71cae21-8003-4168-b058-02c885648c5c-config-out\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:09:40.314536 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.314114 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:09:40.314536 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.314122 2581 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e71cae21-8003-4168-b058-02c885648c5c-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-26.ec2.internal\" DevicePath \"\"" Sep 18 21:09:40.315055 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.315029 2581 generic.go:356] "Generic (PLEG): container finished" podID="e71cae21-8003-4168-b058-02c885648c5c" containerID="7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de" exitCode=0 Sep 18 21:09:40.315055 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.315054 2581 generic.go:356] "Generic (PLEG): container finished" podID="e71cae21-8003-4168-b058-02c885648c5c" containerID="c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8" exitCode=0 Sep 18 21:09:40.315213 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.315063 2581 generic.go:356] "Generic (PLEG): container finished" podID="e71cae21-8003-4168-b058-02c885648c5c" containerID="a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95" exitCode=0 Sep 18 21:09:40.315213 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.315071 2581 generic.go:356] "Generic (PLEG): container finished" podID="e71cae21-8003-4168-b058-02c885648c5c" containerID="d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52" exitCode=0 Sep 18 21:09:40.315213 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.315078 2581 generic.go:356] "Generic (PLEG): container finished" podID="e71cae21-8003-4168-b058-02c885648c5c" containerID="34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276" exitCode=0 Sep 18 21:09:40.315213 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.315086 2581 generic.go:356] "Generic (PLEG): container finished" podID="e71cae21-8003-4168-b058-02c885648c5c" containerID="e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32" exitCode=0 Sep 18 21:09:40.315213 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.315113 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e71cae21-8003-4168-b058-02c885648c5c","Type":"ContainerDied","Data":"7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de"} Sep 18 21:09:40.315213 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.315126 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.315213 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.315212 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e71cae21-8003-4168-b058-02c885648c5c","Type":"ContainerDied","Data":"c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8"} Sep 18 21:09:40.315551 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.315260 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e71cae21-8003-4168-b058-02c885648c5c","Type":"ContainerDied","Data":"a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95"} Sep 18 21:09:40.315551 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.315299 2581 scope.go:117] "RemoveContainer" containerID="7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de" Sep 18 21:09:40.315551 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.315337 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e71cae21-8003-4168-b058-02c885648c5c","Type":"ContainerDied","Data":"d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52"} Sep 18 21:09:40.315551 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.315379 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e71cae21-8003-4168-b058-02c885648c5c","Type":"ContainerDied","Data":"34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276"} Sep 18 21:09:40.315551 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.315420 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e71cae21-8003-4168-b058-02c885648c5c","Type":"ContainerDied","Data":"e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32"} Sep 18 21:09:40.315551 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.315462 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e71cae21-8003-4168-b058-02c885648c5c","Type":"ContainerDied","Data":"82cdb1a3eb76a074214c3019c06ae636415e2c5256d7fa0673f9494d8613c944"} Sep 18 21:09:40.324891 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.324871 2581 scope.go:117] "RemoveContainer" containerID="c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8" Sep 18 21:09:40.331932 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.331913 2581 scope.go:117] "RemoveContainer" containerID="a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95" Sep 18 21:09:40.338785 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.338765 2581 scope.go:117] "RemoveContainer" containerID="d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52" Sep 18 21:09:40.341601 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.341579 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 21:09:40.347210 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.347189 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 21:09:40.347700 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.347684 2581 scope.go:117] "RemoveContainer" containerID="34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276" Sep 18 21:09:40.354526 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.354504 2581 scope.go:117] "RemoveContainer" containerID="e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32" Sep 18 21:09:40.361719 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.361702 2581 scope.go:117] "RemoveContainer" containerID="e423a47e7154d05dc76fbeb791868389b88bbb847bfffdf864f0f02fe88bee34" Sep 18 21:09:40.368296 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.368281 2581 scope.go:117] "RemoveContainer" containerID="7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de" Sep 18 21:09:40.368609 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:09:40.368585 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de\": container with ID starting with 7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de not found: ID does not exist" containerID="7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de" Sep 18 21:09:40.368652 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.368631 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de"} err="failed to get container status \"7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de\": rpc error: code = NotFound desc = could not find container \"7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de\": container with ID starting with 7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de not found: ID does not exist" Sep 18 21:09:40.368699 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.368656 2581 scope.go:117] "RemoveContainer" containerID="c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8" Sep 18 21:09:40.368947 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:09:40.368928 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8\": container with ID starting with c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8 not found: ID does not exist" containerID="c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8" Sep 18 21:09:40.369016 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.368956 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8"} err="failed to get container status \"c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8\": rpc error: code = NotFound desc = could not find container \"c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8\": container with ID starting with c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8 not found: ID does not exist" Sep 18 21:09:40.369016 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.368980 2581 scope.go:117] "RemoveContainer" containerID="a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95" Sep 18 21:09:40.369250 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:09:40.369232 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95\": container with ID starting with a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95 not found: ID does not exist" containerID="a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95" Sep 18 21:09:40.369300 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.369256 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95"} err="failed to get container status \"a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95\": rpc error: code = NotFound desc = could not find container \"a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95\": container with ID starting with a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95 not found: ID does not exist" Sep 18 21:09:40.369300 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.369270 2581 scope.go:117] "RemoveContainer" containerID="d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52" Sep 18 21:09:40.369477 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:09:40.369463 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52\": container with ID starting with d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52 not found: ID does not exist" containerID="d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52" Sep 18 21:09:40.369521 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.369480 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52"} err="failed to get container status \"d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52\": rpc error: code = NotFound desc = could not find container \"d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52\": container with ID starting with d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52 not found: ID does not exist" Sep 18 21:09:40.369521 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.369492 2581 scope.go:117] "RemoveContainer" containerID="34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276" Sep 18 21:09:40.369703 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:09:40.369687 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276\": container with ID starting with 34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276 not found: ID does not exist" containerID="34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276" Sep 18 21:09:40.369744 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.369709 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276"} err="failed to get container status \"34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276\": rpc error: code = NotFound desc = could not find container \"34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276\": container with ID starting with 34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276 not found: ID does not exist" Sep 18 21:09:40.369744 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.369724 2581 scope.go:117] "RemoveContainer" containerID="e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32" Sep 18 21:09:40.369928 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:09:40.369913 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32\": container with ID starting with e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32 not found: ID does not exist" containerID="e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32" Sep 18 21:09:40.369973 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.369931 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32"} err="failed to get container status \"e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32\": rpc error: code = NotFound desc = could not find container \"e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32\": container with ID starting with e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32 not found: ID does not exist" Sep 18 21:09:40.369973 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.369943 2581 scope.go:117] "RemoveContainer" containerID="e423a47e7154d05dc76fbeb791868389b88bbb847bfffdf864f0f02fe88bee34" Sep 18 21:09:40.370146 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:09:40.370129 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e423a47e7154d05dc76fbeb791868389b88bbb847bfffdf864f0f02fe88bee34\": container with ID starting with e423a47e7154d05dc76fbeb791868389b88bbb847bfffdf864f0f02fe88bee34 not found: ID does not exist" containerID="e423a47e7154d05dc76fbeb791868389b88bbb847bfffdf864f0f02fe88bee34" Sep 18 21:09:40.370206 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.370164 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e423a47e7154d05dc76fbeb791868389b88bbb847bfffdf864f0f02fe88bee34"} err="failed to get container status \"e423a47e7154d05dc76fbeb791868389b88bbb847bfffdf864f0f02fe88bee34\": rpc error: code = NotFound desc = could not find container \"e423a47e7154d05dc76fbeb791868389b88bbb847bfffdf864f0f02fe88bee34\": container with ID starting with e423a47e7154d05dc76fbeb791868389b88bbb847bfffdf864f0f02fe88bee34 not found: ID does not exist" Sep 18 21:09:40.370206 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.370184 2581 scope.go:117] "RemoveContainer" containerID="7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de" Sep 18 21:09:40.370376 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.370360 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de"} err="failed to get container status \"7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de\": rpc error: code = NotFound desc = could not find container \"7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de\": container with ID starting with 7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de not found: ID does not exist" Sep 18 21:09:40.370422 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.370377 2581 scope.go:117] "RemoveContainer" containerID="c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8" Sep 18 21:09:40.370565 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.370550 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8"} err="failed to get container status \"c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8\": rpc error: code = NotFound desc = could not find container \"c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8\": container with ID starting with c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8 not found: ID does not exist" Sep 18 21:09:40.370603 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.370565 2581 scope.go:117] "RemoveContainer" containerID="a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95" Sep 18 21:09:40.370788 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.370772 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95"} err="failed to get container status \"a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95\": rpc error: code = NotFound desc = could not find container \"a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95\": container with ID starting with a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95 not found: ID does not exist" Sep 18 21:09:40.370834 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.370790 2581 scope.go:117] "RemoveContainer" containerID="d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52" Sep 18 21:09:40.370999 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.370981 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52"} err="failed to get container status \"d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52\": rpc error: code = NotFound desc = could not find container \"d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52\": container with ID starting with d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52 not found: ID does not exist" Sep 18 21:09:40.371063 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.371001 2581 scope.go:117] "RemoveContainer" containerID="34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276" Sep 18 21:09:40.371257 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.371239 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276"} err="failed to get container status \"34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276\": rpc error: code = NotFound desc = could not find container \"34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276\": container with ID starting with 34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276 not found: ID does not exist" Sep 18 21:09:40.371305 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.371257 2581 scope.go:117] "RemoveContainer" containerID="e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32" Sep 18 21:09:40.371471 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.371453 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32"} err="failed to get container status \"e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32\": rpc error: code = NotFound desc = could not find container \"e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32\": container with ID starting with e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32 not found: ID does not exist" Sep 18 21:09:40.371531 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.371472 2581 scope.go:117] "RemoveContainer" containerID="e423a47e7154d05dc76fbeb791868389b88bbb847bfffdf864f0f02fe88bee34" Sep 18 21:09:40.371706 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.371690 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e423a47e7154d05dc76fbeb791868389b88bbb847bfffdf864f0f02fe88bee34"} err="failed to get container status \"e423a47e7154d05dc76fbeb791868389b88bbb847bfffdf864f0f02fe88bee34\": rpc error: code = NotFound desc = could not find container \"e423a47e7154d05dc76fbeb791868389b88bbb847bfffdf864f0f02fe88bee34\": container with ID starting with e423a47e7154d05dc76fbeb791868389b88bbb847bfffdf864f0f02fe88bee34 not found: ID does not exist" Sep 18 21:09:40.371706 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.371706 2581 scope.go:117] "RemoveContainer" containerID="7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de" Sep 18 21:09:40.371912 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.371892 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de"} err="failed to get container status \"7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de\": rpc error: code = NotFound desc = could not find container \"7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de\": container with ID starting with 7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de not found: ID does not exist" Sep 18 21:09:40.371972 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.371913 2581 scope.go:117] "RemoveContainer" containerID="c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8" Sep 18 21:09:40.372167 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.372136 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8"} err="failed to get container status \"c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8\": rpc error: code = NotFound desc = could not find container \"c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8\": container with ID starting with c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8 not found: ID does not exist" Sep 18 21:09:40.372227 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.372169 2581 scope.go:117] "RemoveContainer" containerID="a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95" Sep 18 21:09:40.372445 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.372426 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95"} err="failed to get container status \"a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95\": rpc error: code = NotFound desc = could not find container \"a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95\": container with ID starting with a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95 not found: ID does not exist" Sep 18 21:09:40.372487 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.372446 2581 scope.go:117] "RemoveContainer" containerID="d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52" Sep 18 21:09:40.372704 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.372686 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52"} err="failed to get container status \"d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52\": rpc error: code = NotFound desc = could not find container \"d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52\": container with ID starting with d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52 not found: ID does not exist" Sep 18 21:09:40.372749 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.372704 2581 scope.go:117] "RemoveContainer" containerID="34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276" Sep 18 21:09:40.372920 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.372903 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276"} err="failed to get container status \"34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276\": rpc error: code = NotFound desc = could not find container \"34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276\": container with ID starting with 34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276 not found: ID does not exist" Sep 18 21:09:40.372986 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.372921 2581 scope.go:117] "RemoveContainer" containerID="e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32" Sep 18 21:09:40.373123 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.373107 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32"} err="failed to get container status \"e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32\": rpc error: code = NotFound desc = could not find container \"e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32\": container with ID starting with e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32 not found: ID does not exist" Sep 18 21:09:40.373216 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.373126 2581 scope.go:117] "RemoveContainer" containerID="e423a47e7154d05dc76fbeb791868389b88bbb847bfffdf864f0f02fe88bee34" Sep 18 21:09:40.373401 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.373385 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e423a47e7154d05dc76fbeb791868389b88bbb847bfffdf864f0f02fe88bee34"} err="failed to get container status \"e423a47e7154d05dc76fbeb791868389b88bbb847bfffdf864f0f02fe88bee34\": rpc error: code = NotFound desc = could not find container \"e423a47e7154d05dc76fbeb791868389b88bbb847bfffdf864f0f02fe88bee34\": container with ID starting with e423a47e7154d05dc76fbeb791868389b88bbb847bfffdf864f0f02fe88bee34 not found: ID does not exist" Sep 18 21:09:40.373450 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.373401 2581 scope.go:117] "RemoveContainer" containerID="7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de" Sep 18 21:09:40.373626 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.373609 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de"} err="failed to get container status \"7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de\": rpc error: code = NotFound desc = could not find container \"7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de\": container with ID starting with 7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de not found: ID does not exist" Sep 18 21:09:40.373712 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.373627 2581 scope.go:117] "RemoveContainer" containerID="c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8" Sep 18 21:09:40.374036 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.374011 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8"} err="failed to get container status \"c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8\": rpc error: code = NotFound desc = could not find container \"c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8\": container with ID starting with c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8 not found: ID does not exist" Sep 18 21:09:40.374185 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.374039 2581 scope.go:117] "RemoveContainer" containerID="a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95" Sep 18 21:09:40.374375 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.374356 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95"} err="failed to get container status \"a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95\": rpc error: code = NotFound desc = could not find container \"a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95\": container with ID starting with a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95 not found: ID does not exist" Sep 18 21:09:40.374640 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.374376 2581 scope.go:117] "RemoveContainer" containerID="d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52" Sep 18 21:09:40.374787 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.374760 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52"} err="failed to get container status \"d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52\": rpc error: code = NotFound desc = could not find container \"d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52\": container with ID starting with d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52 not found: ID does not exist" Sep 18 21:09:40.374787 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.374787 2581 scope.go:117] "RemoveContainer" containerID="34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276" Sep 18 21:09:40.375046 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.375027 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276"} err="failed to get container status \"34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276\": rpc error: code = NotFound desc = could not find container \"34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276\": container with ID starting with 34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276 not found: ID does not exist" Sep 18 21:09:40.375116 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.375048 2581 scope.go:117] "RemoveContainer" containerID="e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32" Sep 18 21:09:40.375385 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.375362 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32"} err="failed to get container status \"e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32\": rpc error: code = NotFound desc = could not find container \"e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32\": container with ID starting with e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32 not found: ID does not exist" Sep 18 21:09:40.375442 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.375388 2581 scope.go:117] "RemoveContainer" containerID="e423a47e7154d05dc76fbeb791868389b88bbb847bfffdf864f0f02fe88bee34" Sep 18 21:09:40.375638 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.375619 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e423a47e7154d05dc76fbeb791868389b88bbb847bfffdf864f0f02fe88bee34"} err="failed to get container status \"e423a47e7154d05dc76fbeb791868389b88bbb847bfffdf864f0f02fe88bee34\": rpc error: code = NotFound desc = could not find container \"e423a47e7154d05dc76fbeb791868389b88bbb847bfffdf864f0f02fe88bee34\": container with ID starting with e423a47e7154d05dc76fbeb791868389b88bbb847bfffdf864f0f02fe88bee34 not found: ID does not exist" Sep 18 21:09:40.375681 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.375639 2581 scope.go:117] "RemoveContainer" containerID="7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de" Sep 18 21:09:40.375896 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.375873 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de"} err="failed to get container status \"7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de\": rpc error: code = NotFound desc = could not find container \"7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de\": container with ID starting with 7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de not found: ID does not exist" Sep 18 21:09:40.375945 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.375897 2581 scope.go:117] "RemoveContainer" containerID="c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8" Sep 18 21:09:40.376078 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.376061 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 21:09:40.376182 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.376115 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8"} err="failed to get container status \"c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8\": rpc error: code = NotFound desc = could not find container \"c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8\": container with ID starting with c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8 not found: ID does not exist" Sep 18 21:09:40.376182 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.376129 2581 scope.go:117] "RemoveContainer" containerID="a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95" Sep 18 21:09:40.376426 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.376409 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e71cae21-8003-4168-b058-02c885648c5c" containerName="prometheus" Sep 18 21:09:40.376463 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.376406 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95"} err="failed to get container status \"a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95\": rpc error: code = NotFound desc = could not find container \"a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95\": container with ID starting with a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95 not found: ID does not exist" Sep 18 21:09:40.376463 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.376430 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e71cae21-8003-4168-b058-02c885648c5c" containerName="prometheus" Sep 18 21:09:40.376463 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.376437 2581 scope.go:117] "RemoveContainer" containerID="d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52" Sep 18 21:09:40.376463 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.376447 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e71cae21-8003-4168-b058-02c885648c5c" containerName="init-config-reloader" Sep 18 21:09:40.376463 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.376456 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e71cae21-8003-4168-b058-02c885648c5c" containerName="init-config-reloader" Sep 18 21:09:40.376629 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.376467 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e71cae21-8003-4168-b058-02c885648c5c" containerName="thanos-sidecar" Sep 18 21:09:40.376629 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.376475 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e71cae21-8003-4168-b058-02c885648c5c" containerName="thanos-sidecar" Sep 18 21:09:40.376629 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.376485 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e71cae21-8003-4168-b058-02c885648c5c" containerName="config-reloader" Sep 18 21:09:40.376629 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.376492 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e71cae21-8003-4168-b058-02c885648c5c" containerName="config-reloader" Sep 18 21:09:40.376629 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.376502 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e71cae21-8003-4168-b058-02c885648c5c" containerName="kube-rbac-proxy-web" Sep 18 21:09:40.376629 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.376510 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e71cae21-8003-4168-b058-02c885648c5c" containerName="kube-rbac-proxy-web" Sep 18 21:09:40.376629 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.376521 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e71cae21-8003-4168-b058-02c885648c5c" containerName="kube-rbac-proxy-thanos" Sep 18 21:09:40.376629 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.376525 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e71cae21-8003-4168-b058-02c885648c5c" containerName="kube-rbac-proxy-thanos" Sep 18 21:09:40.376629 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.376532 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e71cae21-8003-4168-b058-02c885648c5c" containerName="kube-rbac-proxy" Sep 18 21:09:40.376629 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.376537 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e71cae21-8003-4168-b058-02c885648c5c" containerName="kube-rbac-proxy" Sep 18 21:09:40.376629 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.376589 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e71cae21-8003-4168-b058-02c885648c5c" containerName="kube-rbac-proxy-thanos" Sep 18 21:09:40.376629 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.376601 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e71cae21-8003-4168-b058-02c885648c5c" containerName="prometheus" Sep 18 21:09:40.376629 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.376612 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e71cae21-8003-4168-b058-02c885648c5c" containerName="config-reloader" Sep 18 21:09:40.376629 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.376618 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e71cae21-8003-4168-b058-02c885648c5c" containerName="kube-rbac-proxy-web" Sep 18 21:09:40.376629 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.376623 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e71cae21-8003-4168-b058-02c885648c5c" containerName="thanos-sidecar" Sep 18 21:09:40.376629 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.376628 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e71cae21-8003-4168-b058-02c885648c5c" containerName="kube-rbac-proxy" Sep 18 21:09:40.377132 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.376683 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52"} err="failed to get container status \"d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52\": rpc error: code = NotFound desc = could not find container \"d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52\": container with ID starting with d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52 not found: ID does not exist" Sep 18 21:09:40.377132 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.376698 2581 scope.go:117] "RemoveContainer" containerID="34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276" Sep 18 21:09:40.377132 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.376946 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276"} err="failed to get container status \"34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276\": rpc error: code = NotFound desc = could not find container \"34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276\": container with ID starting with 34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276 not found: ID does not exist" Sep 18 21:09:40.377132 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.376964 2581 scope.go:117] "RemoveContainer" containerID="e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32" Sep 18 21:09:40.377277 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.377215 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32"} err="failed to get container status \"e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32\": rpc error: code = NotFound desc = could not find container \"e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32\": container with ID starting with e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32 not found: ID does not exist" Sep 18 21:09:40.377277 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.377230 2581 scope.go:117] "RemoveContainer" containerID="e423a47e7154d05dc76fbeb791868389b88bbb847bfffdf864f0f02fe88bee34" Sep 18 21:09:40.377477 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.377457 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e423a47e7154d05dc76fbeb791868389b88bbb847bfffdf864f0f02fe88bee34"} err="failed to get container status \"e423a47e7154d05dc76fbeb791868389b88bbb847bfffdf864f0f02fe88bee34\": rpc error: code = NotFound desc = could not find container \"e423a47e7154d05dc76fbeb791868389b88bbb847bfffdf864f0f02fe88bee34\": container with ID starting with e423a47e7154d05dc76fbeb791868389b88bbb847bfffdf864f0f02fe88bee34 not found: ID does not exist" Sep 18 21:09:40.377520 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.377480 2581 scope.go:117] "RemoveContainer" containerID="7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de" Sep 18 21:09:40.377726 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.377709 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de"} err="failed to get container status \"7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de\": rpc error: code = NotFound desc = could not find container \"7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de\": container with ID starting with 7292782e07b16803b5e795b275c68342890e6d8a9f5b1c7e6bcc14a0834b94de not found: ID does not exist" Sep 18 21:09:40.377764 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.377727 2581 scope.go:117] "RemoveContainer" containerID="c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8" Sep 18 21:09:40.377962 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.377944 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8"} err="failed to get container status \"c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8\": rpc error: code = NotFound desc = could not find container \"c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8\": container with ID starting with c7bc81c4b5d274707b2763291e6a7734ca2a9e0715a6546c3f73657c2b70d9d8 not found: ID does not exist" Sep 18 21:09:40.378010 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.377963 2581 scope.go:117] "RemoveContainer" containerID="a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95" Sep 18 21:09:40.378218 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.378201 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95"} err="failed to get container status \"a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95\": rpc error: code = NotFound desc = could not find container \"a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95\": container with ID starting with a264dd8a5d0231f90e5630f452f99fee33dde1af0366de81fff02c7d5ee26a95 not found: ID does not exist" Sep 18 21:09:40.378269 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.378220 2581 scope.go:117] "RemoveContainer" containerID="d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52" Sep 18 21:09:40.378431 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.378414 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52"} err="failed to get container status \"d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52\": rpc error: code = NotFound desc = could not find container \"d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52\": container with ID starting with d667c3960a748a82363976aaeb7c4263ea20ee072384b640f195fb4116661b52 not found: ID does not exist" Sep 18 21:09:40.378476 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.378432 2581 scope.go:117] "RemoveContainer" containerID="34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276" Sep 18 21:09:40.378659 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.378639 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276"} err="failed to get container status \"34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276\": rpc error: code = NotFound desc = could not find container \"34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276\": container with ID starting with 34fcf2d32b5d0865db0aff28e084f5ff2b0c83e9c4a44b5e83e52aa9ac1ac276 not found: ID does not exist" Sep 18 21:09:40.378711 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.378661 2581 scope.go:117] "RemoveContainer" containerID="e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32" Sep 18 21:09:40.378903 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.378886 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32"} err="failed to get container status \"e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32\": rpc error: code = NotFound desc = could not find container \"e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32\": container with ID starting with e431c75f9843b51e5e4747a8e1e1ca923c53c756b93f1bf7773a4e7866070b32 not found: ID does not exist" Sep 18 21:09:40.378903 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.378904 2581 scope.go:117] "RemoveContainer" containerID="e423a47e7154d05dc76fbeb791868389b88bbb847bfffdf864f0f02fe88bee34" Sep 18 21:09:40.379133 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.379117 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e423a47e7154d05dc76fbeb791868389b88bbb847bfffdf864f0f02fe88bee34"} err="failed to get container status \"e423a47e7154d05dc76fbeb791868389b88bbb847bfffdf864f0f02fe88bee34\": rpc error: code = NotFound desc = could not find container \"e423a47e7154d05dc76fbeb791868389b88bbb847bfffdf864f0f02fe88bee34\": container with ID starting with e423a47e7154d05dc76fbeb791868389b88bbb847bfffdf864f0f02fe88bee34 not found: ID does not exist" Sep 18 21:09:40.380553 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.380540 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.384029 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.384006 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 18 21:09:40.384116 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.384039 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 18 21:09:40.384116 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.384095 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 18 21:09:40.384346 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.384331 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 18 21:09:40.384412 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.384357 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 18 21:09:40.384466 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.384410 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 18 21:09:40.384654 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.384616 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 18 21:09:40.384654 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.384625 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 18 21:09:40.384654 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.384625 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 18 21:09:40.384932 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.384661 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 18 21:09:40.384932 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.384670 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xlwkw\"" Sep 18 21:09:40.384932 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.384619 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 18 21:09:40.384932 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.384624 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 18 21:09:40.385116 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.385021 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 18 21:09:40.385684 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.385666 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2nt1kfmc6s3t0\"" Sep 18 21:09:40.389438 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.389418 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 18 21:09:40.394131 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.394114 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 18 21:09:40.402358 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.402120 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 21:09:40.516208 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.516177 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.516352 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.516211 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-config\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.516352 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.516229 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-config-out\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.516352 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.516309 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.516470 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.516368 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.516470 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.516392 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.516470 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.516424 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5h2n\" (UniqueName: \"kubernetes.io/projected/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-kube-api-access-z5h2n\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.516470 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.516441 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-web-config\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.516617 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.516468 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.516617 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.516487 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.516617 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.516509 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.516617 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.516526 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.516617 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.516545 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.516617 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.516574 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.516617 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.516592 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.516617 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.516607 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.516866 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.516628 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.516866 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.516642 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.516866 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.516659 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.516866 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.516685 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.617616 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.617583 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.617616 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.617616 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.617843 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.617633 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.617843 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.617653 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5h2n\" (UniqueName: \"kubernetes.io/projected/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-kube-api-access-z5h2n\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.617843 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.617668 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-web-config\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.617843 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.617687 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.617843 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.617745 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.617843 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.617775 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.617843 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.617800 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.617843 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.617821 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.617843 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.617845 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.618363 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.617862 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.618363 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.617905 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.618363 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.617941 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.618363 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.617956 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.618363 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.617975 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.618363 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.617990 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.618363 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.618014 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.618363 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.618038 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-config\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.618363 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.618054 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-config-out\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.618363 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.618354 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.618848 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.618478 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.620643 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.620611 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.620796 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.620764 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-config-out\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.621248 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.621227 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-web-config\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.621343 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.621258 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.621511 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.621490 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.621581 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.621518 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.622048 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.621837 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.622048 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.621897 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.622048 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.621927 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.622048 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.622003 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.622311 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.622068 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.622551 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.622433 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.622872 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.622853 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.623494 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.623469 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.623820 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.623796 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.624036 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.624020 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-config\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.624547 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.624529 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.626661 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.626642 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5h2n\" (UniqueName: \"kubernetes.io/projected/f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c-kube-api-access-z5h2n\") pod \"prometheus-k8s-0\" (UID: \"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.690962 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.690935 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:09:40.983769 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:40.983739 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 21:09:40.986674 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:09:40.986645 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf54db0d1_c254_4b1c_a0f7_232dfbbeaf6c.slice/crio-68c3870facb0927582ee37d9010afcbf7857f7cf6c30f57a2a6c27617bd43832 WatchSource:0}: Error finding container 68c3870facb0927582ee37d9010afcbf7857f7cf6c30f57a2a6c27617bd43832: Status 404 returned error can't find the container with id 68c3870facb0927582ee37d9010afcbf7857f7cf6c30f57a2a6c27617bd43832 Sep 18 21:09:41.269065 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:41.269033 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e71cae21-8003-4168-b058-02c885648c5c" path="/var/lib/kubelet/pods/e71cae21-8003-4168-b058-02c885648c5c/volumes" Sep 18 21:09:41.320735 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:41.320700 2581 generic.go:356] "Generic (PLEG): container finished" podID="f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c" containerID="f5cb78f6842b1bfba5563588ab719f81c3b8e01f1f34df7aaa58fd34820cc14e" exitCode=0 Sep 18 21:09:41.321173 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:41.320786 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c","Type":"ContainerDied","Data":"f5cb78f6842b1bfba5563588ab719f81c3b8e01f1f34df7aaa58fd34820cc14e"} Sep 18 21:09:41.321173 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:41.320851 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c","Type":"ContainerStarted","Data":"68c3870facb0927582ee37d9010afcbf7857f7cf6c30f57a2a6c27617bd43832"} Sep 18 21:09:42.329309 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:42.329281 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c","Type":"ContainerStarted","Data":"55e4944295611b2aa9458e635db3e4d691d89c0faa6a10c4f6c51669444f354d"} Sep 18 21:09:42.329672 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:42.329359 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c","Type":"ContainerStarted","Data":"976192205dda536a0c433bb13b450f3cbcf24f2e15c80e05ac73d42a56350f56"} Sep 18 21:09:42.329672 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:42.329405 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c","Type":"ContainerStarted","Data":"f498a46635b299ef556df4dd4a2fd6519741f8f9ee2e7defb84b36874d06585c"} Sep 18 21:09:42.329672 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:42.329448 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c","Type":"ContainerStarted","Data":"b1db71173d122960e2ac7888cb92332a088443445061bca9d1f27ae8286861ad"} Sep 18 21:09:42.329672 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:42.329488 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c","Type":"ContainerStarted","Data":"df0d1efb84e74c9e4fe871951de2bd2a1081cedc322b083d619eb88108e0d53f"} Sep 18 21:09:42.329672 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:42.329528 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c","Type":"ContainerStarted","Data":"8afe90c69669ce7f5e46d5834a1f56357b2c331a7c30499be30661ef45b5abaa"} Sep 18 21:09:42.330862 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:42.330839 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-69d7fcfdf7-xcw2x" event={"ID":"1bb0610d-5f96-47c2-ba0a-aabfb7abf448","Type":"ContainerStarted","Data":"1fbe643369e4708ec231c209241e9118ea2a165cc320b50926316ab132dd0395"} Sep 18 21:09:42.364207 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:42.364140 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.346021696 podStartE2EDuration="2.364122503s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.100807ms" isStatefulPod=false podCreationTimestamp="2026-09-18 21:09:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:09:42.361877439 +0000 UTC m=+221.581989840" watchObservedRunningTime="2026-09-18 21:09:42.364122503 +0000 UTC m=+221.584234930" Sep 18 21:09:43.337115 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:43.337070 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-69d7fcfdf7-xcw2x" event={"ID":"1bb0610d-5f96-47c2-ba0a-aabfb7abf448","Type":"ContainerStarted","Data":"28dc4d2accf6c609dbefffad742e7b12cd7933a64eaff761a39937c3943e4097"} Sep 18 21:09:43.337492 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:43.337140 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-69d7fcfdf7-xcw2x" event={"ID":"1bb0610d-5f96-47c2-ba0a-aabfb7abf448","Type":"ContainerStarted","Data":"fe131ab675000f9cdf6e9b73325153b9e6a576983802f78edcc522307f5c4df6"} Sep 18 21:09:43.363465 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:43.363411 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-69d7fcfdf7-xcw2x" podStartSLOduration=2.382388488 podStartE2EDuration="4.363395767s" totalImagesPullingTime="1.981007279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:09:43.361840526 +0000 UTC m=+222.581952913" watchObservedRunningTime="2026-09-18 21:09:43.363395767 +0000 UTC m=+222.583508155" Sep 18 21:09:45.691245 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:09:45.691209 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:10:40.691875 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:10:40.691837 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:10:40.707880 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:10:40.707856 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:10:41.568850 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:10:41.568817 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:11:01.181965 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:11:01.181938 2581 kubelet.go:1648] "Image garbage collection succeeded" Sep 18 21:12:41.072145 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:12:41.072110 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb"] Sep 18 21:12:41.075422 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:12:41.075404 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb" Sep 18 21:12:41.082174 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:12:41.081779 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 18 21:12:41.082174 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:12:41.081946 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 18 21:12:41.082174 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:12:41.082078 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rz5vx\"" Sep 18 21:12:41.082174 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:12:41.082087 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 18 21:12:41.082450 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:12:41.082435 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 18 21:12:41.107513 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:12:41.107490 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb"] Sep 18 21:12:41.215738 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:12:41.215710 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb\" (UID: \"9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb" Sep 18 21:12:41.215738 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:12:41.215741 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b-tmp\") pod \"opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb\" (UID: \"9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb" Sep 18 21:12:41.215984 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:12:41.215767 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b-manifests\") pod \"opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb\" (UID: \"9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb" Sep 18 21:12:41.215984 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:12:41.215793 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd5k8\" (UniqueName: \"kubernetes.io/projected/9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b-kube-api-access-hd5k8\") pod \"opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb\" (UID: \"9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb" Sep 18 21:12:41.215984 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:12:41.215882 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb\" (UID: \"9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb" Sep 18 21:12:41.317275 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:12:41.317244 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb\" (UID: \"9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb" Sep 18 21:12:41.317442 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:12:41.317325 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb\" (UID: \"9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb" Sep 18 21:12:41.317442 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:12:41.317351 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b-tmp\") pod \"opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb\" (UID: \"9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb" Sep 18 21:12:41.317442 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:12:41.317379 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b-manifests\") pod \"opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb\" (UID: \"9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb" Sep 18 21:12:41.317442 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:12:41.317410 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd5k8\" (UniqueName: \"kubernetes.io/projected/9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b-kube-api-access-hd5k8\") pod \"opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb\" (UID: \"9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb" Sep 18 21:12:41.317844 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:12:41.317814 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b-manifests\") pod \"opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb\" (UID: \"9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb" Sep 18 21:12:41.319836 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:12:41.319806 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b-tmp\") pod \"opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb\" (UID: \"9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb" Sep 18 21:12:41.319929 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:12:41.319886 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb\" (UID: \"9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb" Sep 18 21:12:41.319968 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:12:41.319932 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb\" (UID: \"9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb" Sep 18 21:12:41.326830 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:12:41.326766 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd5k8\" (UniqueName: \"kubernetes.io/projected/9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b-kube-api-access-hd5k8\") pod \"opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb\" (UID: \"9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb" Sep 18 21:12:41.385839 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:12:41.385809 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb" Sep 18 21:12:41.689812 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:12:41.689792 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb"] Sep 18 21:12:41.693053 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:12:41.693026 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9743a4ba_d064_47a0_a44a_8e3eb5b9dd0b.slice/crio-784e273787cbb04bceee936f47f380c6cf02212ccbae8d0fb2448cb7cafd177d WatchSource:0}: Error finding container 784e273787cbb04bceee936f47f380c6cf02212ccbae8d0fb2448cb7cafd177d: Status 404 returned error can't find the container with id 784e273787cbb04bceee936f47f380c6cf02212ccbae8d0fb2448cb7cafd177d Sep 18 21:12:41.694911 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:12:41.694896 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 21:12:42.009399 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:12:42.009368 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb" event={"ID":"9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b","Type":"ContainerStarted","Data":"784e273787cbb04bceee936f47f380c6cf02212ccbae8d0fb2448cb7cafd177d"} Sep 18 21:12:45.025926 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:12:45.025884 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb" event={"ID":"9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b","Type":"ContainerStarted","Data":"520baec2612c71bd05c69aa4fa7d052890a9186413067450e976efdb6055461c"} Sep 18 21:12:46.031903 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:12:46.031869 2581 generic.go:356] "Generic (PLEG): container finished" podID="9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b" containerID="520baec2612c71bd05c69aa4fa7d052890a9186413067450e976efdb6055461c" exitCode=0 Sep 18 21:12:46.032412 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:12:46.031926 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb" event={"ID":"9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b","Type":"ContainerDied","Data":"520baec2612c71bd05c69aa4fa7d052890a9186413067450e976efdb6055461c"} Sep 18 21:12:47.038547 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:12:47.038513 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb" event={"ID":"9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b","Type":"ContainerStarted","Data":"e53d2240f3ce1d3f4db2ababe699e57b85999087141f5e2442f2d6ae466d353b"} Sep 18 21:12:47.038933 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:12:47.038616 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb" Sep 18 21:12:47.092957 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:12:47.092891 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb" podStartSLOduration=1.817359274 podStartE2EDuration="6.092868347s" totalImagesPullingTime="3.256893789s" totalInitContainerRuntime="1.018615284s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:12:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:12:47.091794158 +0000 UTC m=+406.311906546" watchObservedRunningTime="2026-09-18 21:12:47.092868347 +0000 UTC m=+406.312980736" Sep 18 21:12:58.044725 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:12:58.044698 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb" Sep 18 21:13:11.193913 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:11.193868 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9pj4s"] Sep 18 21:13:11.204304 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:11.204263 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9pj4s" Sep 18 21:13:11.207312 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:11.207030 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-6xxbx\"" Sep 18 21:13:11.208189 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:11.208142 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9pj4s"] Sep 18 21:13:11.208948 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:11.208924 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Sep 18 21:13:11.257072 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:11.257037 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d30f2ad-3695-442d-906e-bbdf5d214a57-cert\") pod \"odh-model-controller-7998c67dc4-9pj4s\" (UID: \"9d30f2ad-3695-442d-906e-bbdf5d214a57\") " pod="opendatahub/odh-model-controller-7998c67dc4-9pj4s" Sep 18 21:13:11.257256 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:11.257076 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-957nm\" (UniqueName: \"kubernetes.io/projected/9d30f2ad-3695-442d-906e-bbdf5d214a57-kube-api-access-957nm\") pod \"odh-model-controller-7998c67dc4-9pj4s\" (UID: \"9d30f2ad-3695-442d-906e-bbdf5d214a57\") " pod="opendatahub/odh-model-controller-7998c67dc4-9pj4s" Sep 18 21:13:11.358324 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:11.358293 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-957nm\" (UniqueName: \"kubernetes.io/projected/9d30f2ad-3695-442d-906e-bbdf5d214a57-kube-api-access-957nm\") pod \"odh-model-controller-7998c67dc4-9pj4s\" (UID: \"9d30f2ad-3695-442d-906e-bbdf5d214a57\") " pod="opendatahub/odh-model-controller-7998c67dc4-9pj4s" Sep 18 21:13:11.358534 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:11.358383 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d30f2ad-3695-442d-906e-bbdf5d214a57-cert\") pod \"odh-model-controller-7998c67dc4-9pj4s\" (UID: \"9d30f2ad-3695-442d-906e-bbdf5d214a57\") " pod="opendatahub/odh-model-controller-7998c67dc4-9pj4s" Sep 18 21:13:11.358534 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:13:11.358473 2581 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Sep 18 21:13:11.358534 ip-10-0-141-26 kubenswrapper[2581]: E0918 21:13:11.358519 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d30f2ad-3695-442d-906e-bbdf5d214a57-cert podName:9d30f2ad-3695-442d-906e-bbdf5d214a57 nodeName:}" failed. No retries permitted until 2026-09-18 21:13:11.858502897 +0000 UTC m=+431.078615276 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9d30f2ad-3695-442d-906e-bbdf5d214a57-cert") pod "odh-model-controller-7998c67dc4-9pj4s" (UID: "9d30f2ad-3695-442d-906e-bbdf5d214a57") : secret "odh-model-controller-webhook-cert" not found Sep 18 21:13:11.366766 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:11.366740 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-957nm\" (UniqueName: \"kubernetes.io/projected/9d30f2ad-3695-442d-906e-bbdf5d214a57-kube-api-access-957nm\") pod \"odh-model-controller-7998c67dc4-9pj4s\" (UID: \"9d30f2ad-3695-442d-906e-bbdf5d214a57\") " pod="opendatahub/odh-model-controller-7998c67dc4-9pj4s" Sep 18 21:13:11.851126 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:11.851093 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-68752"] Sep 18 21:13:11.854465 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:11.854450 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-68752" Sep 18 21:13:11.857040 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:11.857007 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-qznch\"" Sep 18 21:13:11.857040 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:11.857020 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Sep 18 21:13:11.863165 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:11.863124 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d30f2ad-3695-442d-906e-bbdf5d214a57-cert\") pod \"odh-model-controller-7998c67dc4-9pj4s\" (UID: \"9d30f2ad-3695-442d-906e-bbdf5d214a57\") " pod="opendatahub/odh-model-controller-7998c67dc4-9pj4s" Sep 18 21:13:11.865576 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:11.865556 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d30f2ad-3695-442d-906e-bbdf5d214a57-cert\") pod \"odh-model-controller-7998c67dc4-9pj4s\" (UID: \"9d30f2ad-3695-442d-906e-bbdf5d214a57\") " pod="opendatahub/odh-model-controller-7998c67dc4-9pj4s" Sep 18 21:13:11.872956 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:11.872934 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-68752"] Sep 18 21:13:11.964356 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:11.964322 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/389bcd0d-01b7-486e-9622-dc94b662b0db-tls-certs\") pod \"model-serving-api-54d89bd5fc-68752\" (UID: \"389bcd0d-01b7-486e-9622-dc94b662b0db\") " pod="opendatahub/model-serving-api-54d89bd5fc-68752" Sep 18 21:13:11.964540 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:11.964393 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg6j6\" (UniqueName: \"kubernetes.io/projected/389bcd0d-01b7-486e-9622-dc94b662b0db-kube-api-access-fg6j6\") pod \"model-serving-api-54d89bd5fc-68752\" (UID: \"389bcd0d-01b7-486e-9622-dc94b662b0db\") " pod="opendatahub/model-serving-api-54d89bd5fc-68752" Sep 18 21:13:12.065059 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:12.065021 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/389bcd0d-01b7-486e-9622-dc94b662b0db-tls-certs\") pod \"model-serving-api-54d89bd5fc-68752\" (UID: \"389bcd0d-01b7-486e-9622-dc94b662b0db\") " pod="opendatahub/model-serving-api-54d89bd5fc-68752" Sep 18 21:13:12.065298 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:12.065089 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg6j6\" (UniqueName: \"kubernetes.io/projected/389bcd0d-01b7-486e-9622-dc94b662b0db-kube-api-access-fg6j6\") pod \"model-serving-api-54d89bd5fc-68752\" (UID: \"389bcd0d-01b7-486e-9622-dc94b662b0db\") " pod="opendatahub/model-serving-api-54d89bd5fc-68752" Sep 18 21:13:12.067601 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:12.067579 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/389bcd0d-01b7-486e-9622-dc94b662b0db-tls-certs\") pod \"model-serving-api-54d89bd5fc-68752\" (UID: \"389bcd0d-01b7-486e-9622-dc94b662b0db\") " pod="opendatahub/model-serving-api-54d89bd5fc-68752" Sep 18 21:13:12.076230 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:12.076209 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg6j6\" (UniqueName: \"kubernetes.io/projected/389bcd0d-01b7-486e-9622-dc94b662b0db-kube-api-access-fg6j6\") pod \"model-serving-api-54d89bd5fc-68752\" (UID: \"389bcd0d-01b7-486e-9622-dc94b662b0db\") " pod="opendatahub/model-serving-api-54d89bd5fc-68752" Sep 18 21:13:12.118327 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:12.118242 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9pj4s" Sep 18 21:13:12.164698 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:12.164671 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-68752" Sep 18 21:13:12.417922 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:12.417896 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9pj4s"] Sep 18 21:13:12.419992 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:13:12.419962 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d30f2ad_3695_442d_906e_bbdf5d214a57.slice/crio-45ca03f1a4fb7b93803dafe4caf11d49c8338fd18a4e44299a4d6fcce887b2b5 WatchSource:0}: Error finding container 45ca03f1a4fb7b93803dafe4caf11d49c8338fd18a4e44299a4d6fcce887b2b5: Status 404 returned error can't find the container with id 45ca03f1a4fb7b93803dafe4caf11d49c8338fd18a4e44299a4d6fcce887b2b5 Sep 18 21:13:12.470938 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:12.470911 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-68752"] Sep 18 21:13:12.473300 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:13:12.473277 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod389bcd0d_01b7_486e_9622_dc94b662b0db.slice/crio-44960cc68c8b7bc254dd2ed33c7fc01fef65296601eff9ac80922f0151a42722 WatchSource:0}: Error finding container 44960cc68c8b7bc254dd2ed33c7fc01fef65296601eff9ac80922f0151a42722: Status 404 returned error can't find the container with id 44960cc68c8b7bc254dd2ed33c7fc01fef65296601eff9ac80922f0151a42722 Sep 18 21:13:12.886726 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:12.886692 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5"] Sep 18 21:13:12.890602 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:12.890578 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" Sep 18 21:13:12.895267 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:12.895062 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 18 21:13:12.895267 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:12.895177 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 18 21:13:12.895267 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:12.895229 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 18 21:13:12.895537 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:12.895318 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-n69ct\"" Sep 18 21:13:12.910752 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:12.910683 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5"] Sep 18 21:13:12.974165 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:12.974111 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5\" (UID: \"c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" Sep 18 21:13:12.974347 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:12.974190 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5\" (UID: \"c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" Sep 18 21:13:12.974347 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:12.974222 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5\" (UID: \"c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" Sep 18 21:13:12.974347 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:12.974245 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5\" (UID: \"c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" Sep 18 21:13:12.974347 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:12.974282 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhrrk\" (UniqueName: \"kubernetes.io/projected/c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb-kube-api-access-qhrrk\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5\" (UID: \"c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" Sep 18 21:13:12.974564 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:12.974350 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5\" (UID: \"c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" Sep 18 21:13:12.974564 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:12.974421 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5\" (UID: \"c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" Sep 18 21:13:12.974564 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:12.974470 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5\" (UID: \"c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" Sep 18 21:13:12.974564 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:12.974507 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5\" (UID: \"c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" Sep 18 21:13:13.075238 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:13.075200 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5\" (UID: \"c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" Sep 18 21:13:13.075417 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:13.075271 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5\" (UID: \"c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" Sep 18 21:13:13.075417 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:13.075319 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5\" (UID: \"c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" Sep 18 21:13:13.075417 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:13.075352 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5\" (UID: \"c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" Sep 18 21:13:13.075417 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:13.075403 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5\" (UID: \"c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" Sep 18 21:13:13.075638 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:13.075487 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5\" (UID: \"c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" Sep 18 21:13:13.075638 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:13.075580 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5\" (UID: \"c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" Sep 18 21:13:13.075638 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:13.075606 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5\" (UID: \"c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" Sep 18 21:13:13.075794 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:13.075648 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhrrk\" (UniqueName: \"kubernetes.io/projected/c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb-kube-api-access-qhrrk\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5\" (UID: \"c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" Sep 18 21:13:13.077084 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:13.077055 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5\" (UID: \"c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" Sep 18 21:13:13.077366 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:13.077344 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5\" (UID: \"c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" Sep 18 21:13:13.077946 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:13.077567 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5\" (UID: \"c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" Sep 18 21:13:13.079189 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:13.079019 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5\" (UID: \"c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" Sep 18 21:13:13.079690 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:13.079291 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5\" (UID: \"c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" Sep 18 21:13:13.084118 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:13.084028 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5\" (UID: \"c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" Sep 18 21:13:13.085929 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:13.085906 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhrrk\" (UniqueName: \"kubernetes.io/projected/c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb-kube-api-access-qhrrk\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5\" (UID: \"c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" Sep 18 21:13:13.086636 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:13.086597 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5\" (UID: \"c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" Sep 18 21:13:13.087677 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:13.087628 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5\" (UID: \"c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" Sep 18 21:13:13.154341 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:13.154219 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-68752" event={"ID":"389bcd0d-01b7-486e-9622-dc94b662b0db","Type":"ContainerStarted","Data":"44960cc68c8b7bc254dd2ed33c7fc01fef65296601eff9ac80922f0151a42722"} Sep 18 21:13:13.156733 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:13.156666 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9pj4s" event={"ID":"9d30f2ad-3695-442d-906e-bbdf5d214a57","Type":"ContainerStarted","Data":"45ca03f1a4fb7b93803dafe4caf11d49c8338fd18a4e44299a4d6fcce887b2b5"} Sep 18 21:13:13.208235 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:13.207788 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" Sep 18 21:13:13.516885 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:13.516857 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5"] Sep 18 21:13:13.521666 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:13:13.519746 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0f4f9b0_f0d0_425d_8708_7b1aa96f6dbb.slice/crio-a46611547a8790fa4cd063e8d5fc6d3d0658a37084c3fd9b271a6b3883bf546a WatchSource:0}: Error finding container a46611547a8790fa4cd063e8d5fc6d3d0658a37084c3fd9b271a6b3883bf546a: Status 404 returned error can't find the container with id a46611547a8790fa4cd063e8d5fc6d3d0658a37084c3fd9b271a6b3883bf546a Sep 18 21:13:14.163827 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:14.163752 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" event={"ID":"c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb","Type":"ContainerStarted","Data":"a46611547a8790fa4cd063e8d5fc6d3d0658a37084c3fd9b271a6b3883bf546a"} Sep 18 21:13:17.803757 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:17.803709 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"} Sep 18 21:13:17.804078 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:17.803811 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"} Sep 18 21:13:17.804078 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:17.803852 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"} Sep 18 21:13:18.187361 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:18.187265 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-68752" event={"ID":"389bcd0d-01b7-486e-9622-dc94b662b0db","Type":"ContainerStarted","Data":"d8caace38ba4dbdbfe4a1741a23137ea36905e0231ae80b92fc3e3e5d8b13e55"} Sep 18 21:13:18.187552 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:18.187397 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-68752" Sep 18 21:13:18.189299 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:18.189273 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9pj4s" event={"ID":"9d30f2ad-3695-442d-906e-bbdf5d214a57","Type":"ContainerStarted","Data":"4542e49d2982512a78a7693df4e09591e334192d21a89871f3e28866ab4888ed"} Sep 18 21:13:18.189413 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:18.189324 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-9pj4s" Sep 18 21:13:18.190891 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:18.190867 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" event={"ID":"c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb","Type":"ContainerStarted","Data":"ecbf03c75a9a414c561396b03acbb7ba91ad2276dcd13289bc9f16c677f5bc0b"} Sep 18 21:13:18.209341 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:18.209315 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" Sep 18 21:13:18.210718 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:18.210690 2581 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Sep 18 21:13:18.210829 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:18.210745 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" podUID="c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Sep 18 21:13:18.233749 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:18.233695 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-68752" podStartSLOduration=1.968670614 podStartE2EDuration="7.233683023s" totalImagesPullingTime="5.265012409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:13:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:13:18.231558366 +0000 UTC m=+437.451670755" watchObservedRunningTime="2026-09-18 21:13:18.233683023 +0000 UTC m=+437.453795409" Sep 18 21:13:18.272860 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:18.272784 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-9pj4s" podStartSLOduration=1.944535621 podStartE2EDuration="7.272767287s" totalImagesPullingTime="5.328231666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:13:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:13:18.271536965 +0000 UTC m=+437.491649350" watchObservedRunningTime="2026-09-18 21:13:18.272767287 +0000 UTC m=+437.492879681" Sep 18 21:13:18.307193 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:18.307123 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" podStartSLOduration=2.02945686 podStartE2EDuration="6.307105262s" totalImagesPullingTime="4.277648402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:13:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:13:18.306200079 +0000 UTC m=+437.526312468" watchObservedRunningTime="2026-09-18 21:13:18.307105262 +0000 UTC m=+437.527217650" Sep 18 21:13:19.212862 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:19.212832 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" Sep 18 21:13:19.911336 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:19.911299 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-vzt74"] Sep 18 21:13:19.914956 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:19.914939 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vzt74" Sep 18 21:13:19.923682 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:19.923659 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vrp54\"" Sep 18 21:13:19.923682 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:19.923677 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 18 21:13:19.923869 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:19.923678 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 18 21:13:19.924687 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:19.924673 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 18 21:13:19.958550 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:19.958513 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-vzt74"] Sep 18 21:13:20.042976 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:20.042941 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ffd6dda-dc94-4f3d-885b-e37b50967564-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-vzt74\" (UID: \"5ffd6dda-dc94-4f3d-885b-e37b50967564\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vzt74" Sep 18 21:13:20.043145 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:20.042980 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g6xc\" (UniqueName: \"kubernetes.io/projected/5ffd6dda-dc94-4f3d-885b-e37b50967564-kube-api-access-5g6xc\") pod \"istiod-openshift-gateway-5677ccb49b-vzt74\" (UID: \"5ffd6dda-dc94-4f3d-885b-e37b50967564\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vzt74" Sep 18 21:13:20.043145 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:20.043075 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5ffd6dda-dc94-4f3d-885b-e37b50967564-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-vzt74\" (UID: \"5ffd6dda-dc94-4f3d-885b-e37b50967564\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vzt74" Sep 18 21:13:20.043145 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:20.043123 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ffd6dda-dc94-4f3d-885b-e37b50967564-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-vzt74\" (UID: \"5ffd6dda-dc94-4f3d-885b-e37b50967564\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vzt74" Sep 18 21:13:20.043145 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:20.043144 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5ffd6dda-dc94-4f3d-885b-e37b50967564-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-vzt74\" (UID: \"5ffd6dda-dc94-4f3d-885b-e37b50967564\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vzt74" Sep 18 21:13:20.043333 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:20.043194 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5ffd6dda-dc94-4f3d-885b-e37b50967564-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-vzt74\" (UID: \"5ffd6dda-dc94-4f3d-885b-e37b50967564\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vzt74" Sep 18 21:13:20.043333 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:20.043225 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5ffd6dda-dc94-4f3d-885b-e37b50967564-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-vzt74\" (UID: \"5ffd6dda-dc94-4f3d-885b-e37b50967564\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vzt74" Sep 18 21:13:20.143827 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:20.143788 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ffd6dda-dc94-4f3d-885b-e37b50967564-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-vzt74\" (UID: \"5ffd6dda-dc94-4f3d-885b-e37b50967564\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vzt74" Sep 18 21:13:20.143827 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:20.143824 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5ffd6dda-dc94-4f3d-885b-e37b50967564-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-vzt74\" (UID: \"5ffd6dda-dc94-4f3d-885b-e37b50967564\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vzt74" Sep 18 21:13:20.144074 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:20.143845 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5ffd6dda-dc94-4f3d-885b-e37b50967564-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-vzt74\" (UID: \"5ffd6dda-dc94-4f3d-885b-e37b50967564\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vzt74" Sep 18 21:13:20.144074 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:20.143888 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5ffd6dda-dc94-4f3d-885b-e37b50967564-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-vzt74\" (UID: \"5ffd6dda-dc94-4f3d-885b-e37b50967564\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vzt74" Sep 18 21:13:20.144074 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:20.143933 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ffd6dda-dc94-4f3d-885b-e37b50967564-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-vzt74\" (UID: \"5ffd6dda-dc94-4f3d-885b-e37b50967564\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vzt74" Sep 18 21:13:20.144074 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:20.143957 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g6xc\" (UniqueName: \"kubernetes.io/projected/5ffd6dda-dc94-4f3d-885b-e37b50967564-kube-api-access-5g6xc\") pod \"istiod-openshift-gateway-5677ccb49b-vzt74\" (UID: \"5ffd6dda-dc94-4f3d-885b-e37b50967564\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vzt74" Sep 18 21:13:20.144074 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:20.144020 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5ffd6dda-dc94-4f3d-885b-e37b50967564-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-vzt74\" (UID: \"5ffd6dda-dc94-4f3d-885b-e37b50967564\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vzt74" Sep 18 21:13:20.144700 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:20.144672 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5ffd6dda-dc94-4f3d-885b-e37b50967564-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-vzt74\" (UID: \"5ffd6dda-dc94-4f3d-885b-e37b50967564\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vzt74" Sep 18 21:13:20.146526 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:20.146507 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5ffd6dda-dc94-4f3d-885b-e37b50967564-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-vzt74\" (UID: \"5ffd6dda-dc94-4f3d-885b-e37b50967564\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vzt74" Sep 18 21:13:20.146526 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:20.146533 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5ffd6dda-dc94-4f3d-885b-e37b50967564-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-vzt74\" (UID: \"5ffd6dda-dc94-4f3d-885b-e37b50967564\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vzt74" Sep 18 21:13:20.146906 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:20.146889 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ffd6dda-dc94-4f3d-885b-e37b50967564-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-vzt74\" (UID: \"5ffd6dda-dc94-4f3d-885b-e37b50967564\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vzt74" Sep 18 21:13:20.147107 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:20.147087 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5ffd6dda-dc94-4f3d-885b-e37b50967564-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-vzt74\" (UID: \"5ffd6dda-dc94-4f3d-885b-e37b50967564\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vzt74" Sep 18 21:13:20.174918 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:20.174833 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ffd6dda-dc94-4f3d-885b-e37b50967564-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-vzt74\" (UID: \"5ffd6dda-dc94-4f3d-885b-e37b50967564\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vzt74" Sep 18 21:13:20.175047 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:20.174923 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g6xc\" (UniqueName: \"kubernetes.io/projected/5ffd6dda-dc94-4f3d-885b-e37b50967564-kube-api-access-5g6xc\") pod \"istiod-openshift-gateway-5677ccb49b-vzt74\" (UID: \"5ffd6dda-dc94-4f3d-885b-e37b50967564\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vzt74" Sep 18 21:13:20.201688 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:20.201659 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" Sep 18 21:13:20.202719 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:20.202688 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5" Sep 18 21:13:20.224037 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:20.224004 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vzt74" Sep 18 21:13:20.514561 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:20.514524 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-vzt74"] Sep 18 21:13:20.517912 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:13:20.517887 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ffd6dda_dc94_4f3d_885b_e37b50967564.slice/crio-2c1cb2a10d07b017b097363aea8fb3a36f46111f635c6487b5d56fa5f45dbf33 WatchSource:0}: Error finding container 2c1cb2a10d07b017b097363aea8fb3a36f46111f635c6487b5d56fa5f45dbf33: Status 404 returned error can't find the container with id 2c1cb2a10d07b017b097363aea8fb3a36f46111f635c6487b5d56fa5f45dbf33 Sep 18 21:13:21.207023 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:21.206990 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vzt74" event={"ID":"5ffd6dda-dc94-4f3d-885b-e37b50967564","Type":"ContainerStarted","Data":"2c1cb2a10d07b017b097363aea8fb3a36f46111f635c6487b5d56fa5f45dbf33"} Sep 18 21:13:22.171242 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:22.170364 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b5fc9cc4d-kdv7m"] Sep 18 21:13:22.177538 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:22.177516 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7b5fc9cc4d-kdv7m" Sep 18 21:13:22.183466 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:22.183227 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 18 21:13:22.183466 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:22.183260 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 18 21:13:22.183466 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:22.183312 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 18 21:13:22.191599 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:22.191577 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 18 21:13:22.192054 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:22.192039 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 18 21:13:22.197499 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:22.197478 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8xkqw\"" Sep 18 21:13:22.241255 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:22.241220 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b5fc9cc4d-kdv7m"] Sep 18 21:13:22.263122 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:22.263084 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/098317da-c8c9-4d36-a7a9-58659fc39795-manager-config\") pod \"lws-controller-manager-7b5fc9cc4d-kdv7m\" (UID: \"098317da-c8c9-4d36-a7a9-58659fc39795\") " pod="openshift-lws-operator/lws-controller-manager-7b5fc9cc4d-kdv7m" Sep 18 21:13:22.263312 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:22.263139 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqswq\" (UniqueName: \"kubernetes.io/projected/098317da-c8c9-4d36-a7a9-58659fc39795-kube-api-access-hqswq\") pod \"lws-controller-manager-7b5fc9cc4d-kdv7m\" (UID: \"098317da-c8c9-4d36-a7a9-58659fc39795\") " pod="openshift-lws-operator/lws-controller-manager-7b5fc9cc4d-kdv7m" Sep 18 21:13:22.263312 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:22.263228 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/098317da-c8c9-4d36-a7a9-58659fc39795-metrics-cert\") pod \"lws-controller-manager-7b5fc9cc4d-kdv7m\" (UID: \"098317da-c8c9-4d36-a7a9-58659fc39795\") " pod="openshift-lws-operator/lws-controller-manager-7b5fc9cc4d-kdv7m" Sep 18 21:13:22.263312 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:22.263264 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/098317da-c8c9-4d36-a7a9-58659fc39795-cert\") pod \"lws-controller-manager-7b5fc9cc4d-kdv7m\" (UID: \"098317da-c8c9-4d36-a7a9-58659fc39795\") " pod="openshift-lws-operator/lws-controller-manager-7b5fc9cc4d-kdv7m" Sep 18 21:13:22.363853 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:22.363806 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/098317da-c8c9-4d36-a7a9-58659fc39795-manager-config\") pod \"lws-controller-manager-7b5fc9cc4d-kdv7m\" (UID: \"098317da-c8c9-4d36-a7a9-58659fc39795\") " pod="openshift-lws-operator/lws-controller-manager-7b5fc9cc4d-kdv7m" Sep 18 21:13:22.364049 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:22.363957 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqswq\" (UniqueName: \"kubernetes.io/projected/098317da-c8c9-4d36-a7a9-58659fc39795-kube-api-access-hqswq\") pod \"lws-controller-manager-7b5fc9cc4d-kdv7m\" (UID: \"098317da-c8c9-4d36-a7a9-58659fc39795\") " pod="openshift-lws-operator/lws-controller-manager-7b5fc9cc4d-kdv7m" Sep 18 21:13:22.364049 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:22.364002 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/098317da-c8c9-4d36-a7a9-58659fc39795-metrics-cert\") pod \"lws-controller-manager-7b5fc9cc4d-kdv7m\" (UID: \"098317da-c8c9-4d36-a7a9-58659fc39795\") " pod="openshift-lws-operator/lws-controller-manager-7b5fc9cc4d-kdv7m" Sep 18 21:13:22.364049 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:22.364046 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/098317da-c8c9-4d36-a7a9-58659fc39795-cert\") pod \"lws-controller-manager-7b5fc9cc4d-kdv7m\" (UID: \"098317da-c8c9-4d36-a7a9-58659fc39795\") " pod="openshift-lws-operator/lws-controller-manager-7b5fc9cc4d-kdv7m" Sep 18 21:13:22.364607 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:22.364575 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/098317da-c8c9-4d36-a7a9-58659fc39795-manager-config\") pod \"lws-controller-manager-7b5fc9cc4d-kdv7m\" (UID: \"098317da-c8c9-4d36-a7a9-58659fc39795\") " pod="openshift-lws-operator/lws-controller-manager-7b5fc9cc4d-kdv7m" Sep 18 21:13:22.367353 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:22.367306 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/098317da-c8c9-4d36-a7a9-58659fc39795-metrics-cert\") pod \"lws-controller-manager-7b5fc9cc4d-kdv7m\" (UID: \"098317da-c8c9-4d36-a7a9-58659fc39795\") " pod="openshift-lws-operator/lws-controller-manager-7b5fc9cc4d-kdv7m" Sep 18 21:13:22.368012 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:22.367987 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/098317da-c8c9-4d36-a7a9-58659fc39795-cert\") pod \"lws-controller-manager-7b5fc9cc4d-kdv7m\" (UID: \"098317da-c8c9-4d36-a7a9-58659fc39795\") " pod="openshift-lws-operator/lws-controller-manager-7b5fc9cc4d-kdv7m" Sep 18 21:13:22.376040 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:22.376015 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqswq\" (UniqueName: \"kubernetes.io/projected/098317da-c8c9-4d36-a7a9-58659fc39795-kube-api-access-hqswq\") pod \"lws-controller-manager-7b5fc9cc4d-kdv7m\" (UID: \"098317da-c8c9-4d36-a7a9-58659fc39795\") " pod="openshift-lws-operator/lws-controller-manager-7b5fc9cc4d-kdv7m" Sep 18 21:13:22.489373 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:22.489331 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7b5fc9cc4d-kdv7m" Sep 18 21:13:23.008105 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:23.008058 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"} Sep 18 21:13:23.008225 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:23.008138 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"} Sep 18 21:13:23.218908 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:23.218875 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vzt74" event={"ID":"5ffd6dda-dc94-4f3d-885b-e37b50967564","Type":"ContainerStarted","Data":"044c51392059388bfff521b079791a332507fd04790a59fe68f0a913c1278484"} Sep 18 21:13:23.219382 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:23.219056 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vzt74" Sep 18 21:13:23.270711 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:23.270688 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b5fc9cc4d-kdv7m"] Sep 18 21:13:23.271458 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:13:23.271436 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod098317da_c8c9_4d36_a7a9_58659fc39795.slice/crio-c29e5b556c0107fcd8cecc7072ecb7dae22e4b41c0e4639833b0bd4636575a9a WatchSource:0}: Error finding container c29e5b556c0107fcd8cecc7072ecb7dae22e4b41c0e4639833b0bd4636575a9a: Status 404 returned error can't find the container with id c29e5b556c0107fcd8cecc7072ecb7dae22e4b41c0e4639833b0bd4636575a9a Sep 18 21:13:23.353335 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:23.353269 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vzt74" podStartSLOduration=1.865482418 podStartE2EDuration="4.353245121s" totalImagesPullingTime="2.487762703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:13:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:13:23.346662306 +0000 UTC m=+442.566774695" watchObservedRunningTime="2026-09-18 21:13:23.353245121 +0000 UTC m=+442.573357511" Sep 18 21:13:24.234341 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:24.232648 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7b5fc9cc4d-kdv7m" event={"ID":"098317da-c8c9-4d36-a7a9-58659fc39795","Type":"ContainerStarted","Data":"c29e5b556c0107fcd8cecc7072ecb7dae22e4b41c0e4639833b0bd4636575a9a"} Sep 18 21:13:24.238218 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:24.234836 2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-vzt74 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 18 21:13:24.238218 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:24.234933 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vzt74" podUID="5ffd6dda-dc94-4f3d-885b-e37b50967564" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 21:13:26.244386 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:26.244309 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7b5fc9cc4d-kdv7m" event={"ID":"098317da-c8c9-4d36-a7a9-58659fc39795","Type":"ContainerStarted","Data":"f14453ccef7421509747faa9e1501ef5cb80534ba8a42065b7dfed2a3e2e758a"} Sep 18 21:13:26.244758 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:26.244449 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7b5fc9cc4d-kdv7m" Sep 18 21:13:26.334710 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:26.334660 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7b5fc9cc4d-kdv7m" podStartSLOduration=1.6325332540000002 podStartE2EDuration="4.334647729s" totalImagesPullingTime="2.702114475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:13:26.328827956 +0000 UTC m=+445.548940347" watchObservedRunningTime="2026-09-18 21:13:26.334647729 +0000 UTC m=+445.554760116" Sep 18 21:13:27.234130 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:27.234099 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vzt74" Sep 18 21:13:29.198111 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:29.198080 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-9pj4s" Sep 18 21:13:29.200005 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:29.199984 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-68752" Sep 18 21:13:37.251421 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:13:37.251381 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7b5fc9cc4d-kdv7m" Sep 18 21:15:31.942564 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:31.942484 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd"] Sep 18 21:15:31.945043 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:31.945023 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:15:31.948021 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:31.948001 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-fjsvg\"" Sep 18 21:15:31.963253 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:31.963230 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd"] Sep 18 21:15:32.029299 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:32.029264 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/677b182b-96c5-45cf-90b3-be4084ab243f-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-74zwd\" (UID: \"677b182b-96c5-45cf-90b3-be4084ab243f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:15:32.029477 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:32.029322 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/677b182b-96c5-45cf-90b3-be4084ab243f-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-74zwd\" (UID: \"677b182b-96c5-45cf-90b3-be4084ab243f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:15:32.029477 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:32.029369 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/677b182b-96c5-45cf-90b3-be4084ab243f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-74zwd\" (UID: \"677b182b-96c5-45cf-90b3-be4084ab243f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:15:32.029477 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:32.029390 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4swsr\" (UniqueName: \"kubernetes.io/projected/677b182b-96c5-45cf-90b3-be4084ab243f-kube-api-access-4swsr\") pod \"maas-default-gateway-openshift-default-78bb78ff78-74zwd\" (UID: \"677b182b-96c5-45cf-90b3-be4084ab243f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:15:32.029477 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:32.029413 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/677b182b-96c5-45cf-90b3-be4084ab243f-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-74zwd\" (UID: \"677b182b-96c5-45cf-90b3-be4084ab243f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:15:32.029477 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:32.029429 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/677b182b-96c5-45cf-90b3-be4084ab243f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-74zwd\" (UID: \"677b182b-96c5-45cf-90b3-be4084ab243f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:15:32.029710 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:32.029565 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/677b182b-96c5-45cf-90b3-be4084ab243f-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-74zwd\" (UID: \"677b182b-96c5-45cf-90b3-be4084ab243f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:15:32.029710 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:32.029603 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/677b182b-96c5-45cf-90b3-be4084ab243f-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-74zwd\" (UID: \"677b182b-96c5-45cf-90b3-be4084ab243f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:15:32.029710 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:32.029646 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/677b182b-96c5-45cf-90b3-be4084ab243f-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-74zwd\" (UID: \"677b182b-96c5-45cf-90b3-be4084ab243f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:15:32.130086 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:32.130040 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/677b182b-96c5-45cf-90b3-be4084ab243f-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-74zwd\" (UID: \"677b182b-96c5-45cf-90b3-be4084ab243f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:15:32.130086 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:32.130089 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/677b182b-96c5-45cf-90b3-be4084ab243f-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-74zwd\" (UID: \"677b182b-96c5-45cf-90b3-be4084ab243f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:15:32.130343 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:32.130108 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/677b182b-96c5-45cf-90b3-be4084ab243f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-74zwd\" (UID: \"677b182b-96c5-45cf-90b3-be4084ab243f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:15:32.130343 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:32.130126 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4swsr\" (UniqueName: \"kubernetes.io/projected/677b182b-96c5-45cf-90b3-be4084ab243f-kube-api-access-4swsr\") pod \"maas-default-gateway-openshift-default-78bb78ff78-74zwd\" (UID: \"677b182b-96c5-45cf-90b3-be4084ab243f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:15:32.130343 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:32.130173 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/677b182b-96c5-45cf-90b3-be4084ab243f-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-74zwd\" (UID: \"677b182b-96c5-45cf-90b3-be4084ab243f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:15:32.130343 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:32.130197 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/677b182b-96c5-45cf-90b3-be4084ab243f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-74zwd\" (UID: \"677b182b-96c5-45cf-90b3-be4084ab243f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:15:32.130343 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:32.130254 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/677b182b-96c5-45cf-90b3-be4084ab243f-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-74zwd\" (UID: \"677b182b-96c5-45cf-90b3-be4084ab243f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:15:32.130343 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:32.130279 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/677b182b-96c5-45cf-90b3-be4084ab243f-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-74zwd\" (UID: \"677b182b-96c5-45cf-90b3-be4084ab243f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:15:32.130343 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:32.130328 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/677b182b-96c5-45cf-90b3-be4084ab243f-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-74zwd\" (UID: \"677b182b-96c5-45cf-90b3-be4084ab243f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:15:32.130672 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:32.130645 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/677b182b-96c5-45cf-90b3-be4084ab243f-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-74zwd\" (UID: \"677b182b-96c5-45cf-90b3-be4084ab243f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:15:32.130729 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:32.130689 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/677b182b-96c5-45cf-90b3-be4084ab243f-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-74zwd\" (UID: \"677b182b-96c5-45cf-90b3-be4084ab243f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:15:32.130817 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:32.130788 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/677b182b-96c5-45cf-90b3-be4084ab243f-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-74zwd\" (UID: \"677b182b-96c5-45cf-90b3-be4084ab243f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:15:32.130875 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:32.130795 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/677b182b-96c5-45cf-90b3-be4084ab243f-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-74zwd\" (UID: \"677b182b-96c5-45cf-90b3-be4084ab243f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:15:32.131268 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:32.131247 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/677b182b-96c5-45cf-90b3-be4084ab243f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-74zwd\" (UID: \"677b182b-96c5-45cf-90b3-be4084ab243f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:15:32.132605 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:32.132583 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/677b182b-96c5-45cf-90b3-be4084ab243f-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-74zwd\" (UID: \"677b182b-96c5-45cf-90b3-be4084ab243f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:15:32.132816 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:32.132799 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/677b182b-96c5-45cf-90b3-be4084ab243f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-74zwd\" (UID: \"677b182b-96c5-45cf-90b3-be4084ab243f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:15:32.139368 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:32.139351 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4swsr\" (UniqueName: \"kubernetes.io/projected/677b182b-96c5-45cf-90b3-be4084ab243f-kube-api-access-4swsr\") pod \"maas-default-gateway-openshift-default-78bb78ff78-74zwd\" (UID: \"677b182b-96c5-45cf-90b3-be4084ab243f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:15:32.139622 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:32.139597 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/677b182b-96c5-45cf-90b3-be4084ab243f-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-74zwd\" (UID: \"677b182b-96c5-45cf-90b3-be4084ab243f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:15:32.255415 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:32.255371 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:15:32.557607 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:15:32.556784 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod677b182b_96c5_45cf_90b3_be4084ab243f.slice/crio-25515e479e53f4986890fdcf9d745a62d1ec67de68fa8e868ffe12a3ff3402a4 WatchSource:0}: Error finding container 25515e479e53f4986890fdcf9d745a62d1ec67de68fa8e868ffe12a3ff3402a4: Status 404 returned error can't find the container with id 25515e479e53f4986890fdcf9d745a62d1ec67de68fa8e868ffe12a3ff3402a4 Sep 18 21:15:32.557607 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:32.556820 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd"] Sep 18 21:15:32.563199 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:32.563165 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"} Sep 18 21:15:32.563317 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:32.563241 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"} Sep 18 21:15:32.563317 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:32.563281 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"} Sep 18 21:15:32.808140 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:32.808040 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" event={"ID":"677b182b-96c5-45cf-90b3-be4084ab243f","Type":"ContainerStarted","Data":"f7b767bd04c1f0743a827f60baa525d0a6d9c432b917a11741ffa5ccb208f507"} Sep 18 21:15:32.808140 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:32.808092 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" event={"ID":"677b182b-96c5-45cf-90b3-be4084ab243f","Type":"ContainerStarted","Data":"25515e479e53f4986890fdcf9d745a62d1ec67de68fa8e868ffe12a3ff3402a4"} Sep 18 21:15:32.839932 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:32.839870 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" podStartSLOduration=1.839847143 podStartE2EDuration="1.839847143s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:15:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:15:32.838354065 +0000 UTC m=+572.058466455" watchObservedRunningTime="2026-09-18 21:15:32.839847143 +0000 UTC m=+572.059959533" Sep 18 21:15:33.256085 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:33.256049 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:15:33.261133 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:33.261114 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:15:33.812427 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:33.812397 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:15:33.813383 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:33.813366 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:15:34.369008 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:34.368976 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-97zwt"] Sep 18 21:15:34.371581 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:34.371560 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-97zwt" Sep 18 21:15:34.377076 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:34.377045 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 18 21:15:34.377220 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:34.377200 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gt9tr\"" Sep 18 21:15:34.377673 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:34.377656 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 18 21:15:34.377962 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:34.377936 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 18 21:15:34.393306 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:34.393279 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-97zwt"] Sep 18 21:15:34.445183 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:34.445137 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-97zwt"] Sep 18 21:15:34.451866 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:34.451844 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfs2g\" (UniqueName: \"kubernetes.io/projected/e43516fe-3b7c-4e23-91f6-dca6dc8b798c-kube-api-access-lfs2g\") pod \"limitador-limitador-84994f7ffc-97zwt\" (UID: \"e43516fe-3b7c-4e23-91f6-dca6dc8b798c\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-97zwt" Sep 18 21:15:34.451926 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:34.451892 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e43516fe-3b7c-4e23-91f6-dca6dc8b798c-config-file\") pod \"limitador-limitador-84994f7ffc-97zwt\" (UID: \"e43516fe-3b7c-4e23-91f6-dca6dc8b798c\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-97zwt" Sep 18 21:15:34.552720 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:34.552687 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfs2g\" (UniqueName: \"kubernetes.io/projected/e43516fe-3b7c-4e23-91f6-dca6dc8b798c-kube-api-access-lfs2g\") pod \"limitador-limitador-84994f7ffc-97zwt\" (UID: \"e43516fe-3b7c-4e23-91f6-dca6dc8b798c\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-97zwt" Sep 18 21:15:34.552872 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:34.552734 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e43516fe-3b7c-4e23-91f6-dca6dc8b798c-config-file\") pod \"limitador-limitador-84994f7ffc-97zwt\" (UID: \"e43516fe-3b7c-4e23-91f6-dca6dc8b798c\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-97zwt" Sep 18 21:15:34.553377 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:34.553359 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e43516fe-3b7c-4e23-91f6-dca6dc8b798c-config-file\") pod \"limitador-limitador-84994f7ffc-97zwt\" (UID: \"e43516fe-3b7c-4e23-91f6-dca6dc8b798c\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-97zwt" Sep 18 21:15:34.587214 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:34.587177 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfs2g\" (UniqueName: \"kubernetes.io/projected/e43516fe-3b7c-4e23-91f6-dca6dc8b798c-kube-api-access-lfs2g\") pod \"limitador-limitador-84994f7ffc-97zwt\" (UID: \"e43516fe-3b7c-4e23-91f6-dca6dc8b798c\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-97zwt" Sep 18 21:15:34.681991 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:34.681911 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-97zwt" Sep 18 21:15:34.989591 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:34.989567 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-97zwt"] Sep 18 21:15:34.992170 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:15:34.992131 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode43516fe_3b7c_4e23_91f6_dca6dc8b798c.slice/crio-041b660f81757d988f7ac0950a3ee3fcae9372c4beaf121acb17005e91d1a8e4 WatchSource:0}: Error finding container 041b660f81757d988f7ac0950a3ee3fcae9372c4beaf121acb17005e91d1a8e4: Status 404 returned error can't find the container with id 041b660f81757d988f7ac0950a3ee3fcae9372c4beaf121acb17005e91d1a8e4 Sep 18 21:15:35.824018 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:35.823978 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-97zwt" event={"ID":"e43516fe-3b7c-4e23-91f6-dca6dc8b798c","Type":"ContainerStarted","Data":"041b660f81757d988f7ac0950a3ee3fcae9372c4beaf121acb17005e91d1a8e4"} Sep 18 21:15:37.835133 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:37.835093 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-97zwt" event={"ID":"e43516fe-3b7c-4e23-91f6-dca6dc8b798c","Type":"ContainerStarted","Data":"9baaa79f5fb2a8feeced60df0a607f44518c7c5e267197bbbfed5aaf9f06809c"} Sep 18 21:15:37.835535 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:37.835230 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-97zwt" Sep 18 21:15:37.865526 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:37.865484 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-97zwt" podStartSLOduration=1.748271838 podStartE2EDuration="3.865472016s" totalImagesPullingTime="2.117200178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:15:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:15:37.864268479 +0000 UTC m=+577.084380863" watchObservedRunningTime="2026-09-18 21:15:37.865472016 +0000 UTC m=+577.085584404" Sep 18 21:15:48.841444 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:15:48.841411 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-97zwt" Sep 18 21:16:53.319367 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:16:53.319336 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-97zwt"] Sep 18 21:17:02.235647 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:17:02.235561 2581 generic.go:356] "Generic (PLEG): container finished" podID="677b182b-96c5-45cf-90b3-be4084ab243f" containerID="f7b767bd04c1f0743a827f60baa525d0a6d9c432b917a11741ffa5ccb208f507" exitCode=0 Sep 18 21:17:02.235647 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:17:02.235633 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" event={"ID":"677b182b-96c5-45cf-90b3-be4084ab243f","Type":"ContainerDied","Data":"f7b767bd04c1f0743a827f60baa525d0a6d9c432b917a11741ffa5ccb208f507"} Sep 18 21:17:02.236173 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:17:02.236004 2581 scope.go:117] "RemoveContainer" containerID="f7b767bd04c1f0743a827f60baa525d0a6d9c432b917a11741ffa5ccb208f507" Sep 18 21:17:02.237074 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:17:02.237043 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"} Sep 18 21:17:02.237146 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:17:02.237129 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"} Sep 18 21:17:02.237218 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:17:02.237200 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"} Sep 18 21:17:03.241875 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:17:03.241839 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" event={"ID":"677b182b-96c5-45cf-90b3-be4084ab243f","Type":"ContainerStarted","Data":"8ab67239a0c971f5dd984a8d87a92727fb0e3ae582a12cd0cb1348bc4ea78f6f"} Sep 18 21:17:03.256509 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:17:03.256477 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:17:03.257544 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:17:03.257517 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-74zwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Sep 18 21:17:03.257635 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:17:03.257585 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" podUID="677b182b-96c5-45cf-90b3-be4084ab243f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Sep 18 21:17:03.813127 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:17:03.813094 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:17:04.256139 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:17:04.256106 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-74zwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Sep 18 21:17:04.256546 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:17:04.256188 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" podUID="677b182b-96c5-45cf-90b3-be4084ab243f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Sep 18 21:17:05.255743 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:17:05.255710 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-74zwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Sep 18 21:17:05.255913 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:17:05.255769 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" podUID="677b182b-96c5-45cf-90b3-be4084ab243f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Sep 18 21:17:06.256691 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:17:06.256657 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-74zwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Sep 18 21:17:06.257087 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:17:06.256708 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" podUID="677b182b-96c5-45cf-90b3-be4084ab243f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Sep 18 21:17:07.256311 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:17:07.256279 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-74zwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Sep 18 21:17:07.256486 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:17:07.256330 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" podUID="677b182b-96c5-45cf-90b3-be4084ab243f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Sep 18 21:17:08.256676 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:17:08.256639 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-74zwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Sep 18 21:17:08.257064 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:17:08.256708 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" podUID="677b182b-96c5-45cf-90b3-be4084ab243f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Sep 18 21:17:09.259644 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:17:09.259614 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:17:09.260519 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:17:09.260500 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-74zwd" Sep 18 21:17:11.487069 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:17:11.487037 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-97zwt"] Sep 18 21:17:35.250617 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:17:35.250579 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-97zwt"] Sep 18 21:17:52.421068 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:17:52.421024 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-97zwt"] Sep 18 21:18:19.548391 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:19.548360 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-97zwt"] Sep 18 21:18:22.749644 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:22.749609 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g"] Sep 18 21:18:22.752173 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:22.752140 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g" Sep 18 21:18:22.756948 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:22.756927 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9nbxk\"" Sep 18 21:18:22.757648 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:22.757631 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 18 21:18:22.757738 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:22.757692 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 18 21:18:22.757738 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:22.757697 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Sep 18 21:18:22.797998 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:22.797969 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g"] Sep 18 21:18:22.848870 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:22.848831 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq2nh\" (UniqueName: \"kubernetes.io/projected/818dca14-9732-434d-8953-9dee468ed57e-kube-api-access-rq2nh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g\" (UID: \"818dca14-9732-434d-8953-9dee468ed57e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g" Sep 18 21:18:22.849036 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:22.848888 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/818dca14-9732-434d-8953-9dee468ed57e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g\" (UID: \"818dca14-9732-434d-8953-9dee468ed57e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g" Sep 18 21:18:22.849036 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:22.848944 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/818dca14-9732-434d-8953-9dee468ed57e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g\" (UID: \"818dca14-9732-434d-8953-9dee468ed57e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g" Sep 18 21:18:22.849036 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:22.848999 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/818dca14-9732-434d-8953-9dee468ed57e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g\" (UID: \"818dca14-9732-434d-8953-9dee468ed57e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g" Sep 18 21:18:22.849138 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:22.849049 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/818dca14-9732-434d-8953-9dee468ed57e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g\" (UID: \"818dca14-9732-434d-8953-9dee468ed57e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g" Sep 18 21:18:22.849138 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:22.849077 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/818dca14-9732-434d-8953-9dee468ed57e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g\" (UID: \"818dca14-9732-434d-8953-9dee468ed57e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g" Sep 18 21:18:22.950273 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:22.950242 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/818dca14-9732-434d-8953-9dee468ed57e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g\" (UID: \"818dca14-9732-434d-8953-9dee468ed57e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g" Sep 18 21:18:22.950273 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:22.950274 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/818dca14-9732-434d-8953-9dee468ed57e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g\" (UID: \"818dca14-9732-434d-8953-9dee468ed57e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g" Sep 18 21:18:22.950479 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:22.950301 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/818dca14-9732-434d-8953-9dee468ed57e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g\" (UID: \"818dca14-9732-434d-8953-9dee468ed57e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g" Sep 18 21:18:22.950479 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:22.950342 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/818dca14-9732-434d-8953-9dee468ed57e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g\" (UID: \"818dca14-9732-434d-8953-9dee468ed57e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g" Sep 18 21:18:22.950479 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:22.950360 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/818dca14-9732-434d-8953-9dee468ed57e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g\" (UID: \"818dca14-9732-434d-8953-9dee468ed57e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g" Sep 18 21:18:22.950479 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:22.950406 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq2nh\" (UniqueName: \"kubernetes.io/projected/818dca14-9732-434d-8953-9dee468ed57e-kube-api-access-rq2nh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g\" (UID: \"818dca14-9732-434d-8953-9dee468ed57e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g" Sep 18 21:18:22.950687 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:22.950638 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/818dca14-9732-434d-8953-9dee468ed57e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g\" (UID: \"818dca14-9732-434d-8953-9dee468ed57e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g" Sep 18 21:18:22.950774 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:22.950748 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/818dca14-9732-434d-8953-9dee468ed57e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g\" (UID: \"818dca14-9732-434d-8953-9dee468ed57e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g" Sep 18 21:18:22.950825 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:22.950787 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/818dca14-9732-434d-8953-9dee468ed57e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g\" (UID: \"818dca14-9732-434d-8953-9dee468ed57e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g" Sep 18 21:18:22.952558 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:22.952540 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/818dca14-9732-434d-8953-9dee468ed57e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g\" (UID: \"818dca14-9732-434d-8953-9dee468ed57e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g" Sep 18 21:18:22.952851 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:22.952835 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/818dca14-9732-434d-8953-9dee468ed57e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g\" (UID: \"818dca14-9732-434d-8953-9dee468ed57e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g" Sep 18 21:18:22.963068 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:22.963042 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq2nh\" (UniqueName: \"kubernetes.io/projected/818dca14-9732-434d-8953-9dee468ed57e-kube-api-access-rq2nh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g\" (UID: \"818dca14-9732-434d-8953-9dee468ed57e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g" Sep 18 21:18:23.062239 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:23.062169 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g" Sep 18 21:18:23.395985 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:18:23.395956 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod818dca14_9732_434d_8953_9dee468ed57e.slice/crio-b14ca8fe3eb8cf92d95c01b2e49053b012753e2968f4cfdd3e52dbbefa4fd3d7 WatchSource:0}: Error finding container b14ca8fe3eb8cf92d95c01b2e49053b012753e2968f4cfdd3e52dbbefa4fd3d7: Status 404 returned error can't find the container with id b14ca8fe3eb8cf92d95c01b2e49053b012753e2968f4cfdd3e52dbbefa4fd3d7 Sep 18 21:18:23.397466 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:23.397446 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 21:18:23.416461 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:23.416440 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g"] Sep 18 21:18:23.612542 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:23.612502 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g" event={"ID":"818dca14-9732-434d-8953-9dee468ed57e","Type":"ContainerStarted","Data":"b14ca8fe3eb8cf92d95c01b2e49053b012753e2968f4cfdd3e52dbbefa4fd3d7"} Sep 18 21:18:24.067213 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:24.067174 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-97zwt"] Sep 18 21:18:24.620474 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:24.620383 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g" event={"ID":"818dca14-9732-434d-8953-9dee468ed57e","Type":"ContainerStarted","Data":"da4a34a211a7443fad506162d3b45103d6be8fcb7f5c794994a7ea2033ad80a2"} Sep 18 21:18:24.645436 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:24.645381 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g" podStartSLOduration=1.7009643159999999 podStartE2EDuration="2.645364878s" totalImagesPullingTime="944.400562ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:18:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:18:24.643757143 +0000 UTC m=+743.863869532" watchObservedRunningTime="2026-09-18 21:18:24.645364878 +0000 UTC m=+743.865477265" Sep 18 21:18:32.124494 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:32.124463 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-97zwt"] Sep 18 21:18:33.063215 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:33.063142 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g" Sep 18 21:18:33.063436 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:33.063238 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g" Sep 18 21:18:33.082678 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:33.082647 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g" Sep 18 21:18:33.673279 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:33.673248 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv8b4g" Sep 18 21:18:39.760351 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:18:39.760317 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-97zwt"] Sep 18 21:27:45.977225 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:45.977199 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5mdk8_1fc73b59-e444-4f69-b4cc-1950297674cc/global-pull-secret-syncer/0.log" Sep 18 21:27:46.226021 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:46.225989 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wdmzv_2846cc57-5ea3-48e0-a5ea-67f3407e5da0/konnectivity-agent/0.log" Sep 18 21:27:46.281098 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:46.280999 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-26.ec2.internal_6087d6c1490414fda05efa5f1a508a01/haproxy/0.log" Sep 18 21:27:50.409782 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:50.409756 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-97zwt_e43516fe-3b7c-4e23-91f6-dca6dc8b798c/limitador/0.log" Sep 18 21:27:52.279898 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:52.279863 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_62530d52-82db-4274-b128-c60891ae78fc/alertmanager/0.log" Sep 18 21:27:52.341534 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:52.341513 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_62530d52-82db-4274-b128-c60891ae78fc/config-reloader/0.log" Sep 18 21:27:52.402376 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:52.402303 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_62530d52-82db-4274-b128-c60891ae78fc/kube-rbac-proxy-web/0.log" Sep 18 21:27:52.440142 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:52.440113 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_62530d52-82db-4274-b128-c60891ae78fc/kube-rbac-proxy/0.log" Sep 18 21:27:52.486286 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:52.486258 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_62530d52-82db-4274-b128-c60891ae78fc/kube-rbac-proxy-metric/0.log" Sep 18 21:27:52.535876 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:52.535852 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_62530d52-82db-4274-b128-c60891ae78fc/prom-label-proxy/0.log" Sep 18 21:27:52.563136 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:52.563110 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_62530d52-82db-4274-b128-c60891ae78fc/init-config-reloader/0.log" Sep 18 21:27:52.618860 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:52.618813 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-847b8bd8d7-tt5rp_6f721584-d286-4964-bb65-916774fab8db/cluster-monitoring-operator/0.log" Sep 18 21:27:52.804811 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:52.804785 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6l67p_c4b5545a-71f2-4647-ac2b-ef870aa919c4/node-exporter/0.log" Sep 18 21:27:52.829794 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:52.829773 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6l67p_c4b5545a-71f2-4647-ac2b-ef870aa919c4/kube-rbac-proxy/0.log" Sep 18 21:27:52.855517 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:52.855501 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6l67p_c4b5545a-71f2-4647-ac2b-ef870aa919c4/init-textfile/0.log" Sep 18 21:27:53.202603 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:53.202568 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c/prometheus/0.log" Sep 18 21:27:53.232719 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:53.232644 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c/config-reloader/0.log" Sep 18 21:27:53.269566 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:53.269540 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c/thanos-sidecar/0.log" Sep 18 21:27:53.298401 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:53.298364 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c/kube-rbac-proxy-web/0.log" Sep 18 21:27:53.333013 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:53.332995 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c/kube-rbac-proxy/0.log" Sep 18 21:27:53.368107 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:53.368085 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c/kube-rbac-proxy-thanos/0.log" Sep 18 21:27:53.394548 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:53.394533 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f54db0d1-c254-4b1c-a0f7-232dfbbeaf6c/init-config-reloader/0.log" Sep 18 21:27:53.444490 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:53.444456 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-2xl8t_977132de-47da-4600-bfb4-a8d90bab8408/prometheus-operator/0.log" Sep 18 21:27:53.478012 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:53.477992 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-2xl8t_977132de-47da-4600-bfb4-a8d90bab8408/kube-rbac-proxy/0.log" Sep 18 21:27:53.545508 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:53.545424 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-69d7fcfdf7-xcw2x_1bb0610d-5f96-47c2-ba0a-aabfb7abf448/telemeter-client/0.log" Sep 18 21:27:53.568753 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:53.568733 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-69d7fcfdf7-xcw2x_1bb0610d-5f96-47c2-ba0a-aabfb7abf448/reload/0.log" Sep 18 21:27:53.589360 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:53.589335 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-69d7fcfdf7-xcw2x_1bb0610d-5f96-47c2-ba0a-aabfb7abf448/kube-rbac-proxy/0.log" Sep 18 21:27:56.101097 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:56.101066 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t8gmh/perf-node-gather-daemonset-ftkrz"] Sep 18 21:27:56.104306 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:56.104291 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t8gmh/perf-node-gather-daemonset-ftkrz" Sep 18 21:27:56.111531 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:56.111509 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t8gmh\"/\"kube-root-ca.crt\"" Sep 18 21:27:56.112082 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:56.112067 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-t8gmh\"/\"default-dockercfg-7lsc7\"" Sep 18 21:27:56.112657 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:56.112641 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t8gmh\"/\"openshift-service-ca.crt\"" Sep 18 21:27:56.155068 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:56.155041 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t8gmh/perf-node-gather-daemonset-ftkrz"] Sep 18 21:27:56.190169 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:56.190126 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1210ca54-6708-430e-bb5f-e3bf24ea0a61-proc\") pod \"perf-node-gather-daemonset-ftkrz\" (UID: \"1210ca54-6708-430e-bb5f-e3bf24ea0a61\") " pod="openshift-must-gather-t8gmh/perf-node-gather-daemonset-ftkrz" Sep 18 21:27:56.190285 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:56.190178 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1210ca54-6708-430e-bb5f-e3bf24ea0a61-lib-modules\") pod \"perf-node-gather-daemonset-ftkrz\" (UID: \"1210ca54-6708-430e-bb5f-e3bf24ea0a61\") " pod="openshift-must-gather-t8gmh/perf-node-gather-daemonset-ftkrz" Sep 18 21:27:56.190285 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:56.190272 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1210ca54-6708-430e-bb5f-e3bf24ea0a61-sys\") pod \"perf-node-gather-daemonset-ftkrz\" (UID: \"1210ca54-6708-430e-bb5f-e3bf24ea0a61\") " pod="openshift-must-gather-t8gmh/perf-node-gather-daemonset-ftkrz" Sep 18 21:27:56.190386 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:56.190318 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1210ca54-6708-430e-bb5f-e3bf24ea0a61-podres\") pod \"perf-node-gather-daemonset-ftkrz\" (UID: \"1210ca54-6708-430e-bb5f-e3bf24ea0a61\") " pod="openshift-must-gather-t8gmh/perf-node-gather-daemonset-ftkrz" Sep 18 21:27:56.190386 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:56.190342 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75b7j\" (UniqueName: \"kubernetes.io/projected/1210ca54-6708-430e-bb5f-e3bf24ea0a61-kube-api-access-75b7j\") pod \"perf-node-gather-daemonset-ftkrz\" (UID: \"1210ca54-6708-430e-bb5f-e3bf24ea0a61\") " pod="openshift-must-gather-t8gmh/perf-node-gather-daemonset-ftkrz" Sep 18 21:27:56.291035 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:56.291010 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1210ca54-6708-430e-bb5f-e3bf24ea0a61-sys\") pod \"perf-node-gather-daemonset-ftkrz\" (UID: \"1210ca54-6708-430e-bb5f-e3bf24ea0a61\") " pod="openshift-must-gather-t8gmh/perf-node-gather-daemonset-ftkrz" Sep 18 21:27:56.291218 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:56.291064 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1210ca54-6708-430e-bb5f-e3bf24ea0a61-podres\") pod \"perf-node-gather-daemonset-ftkrz\" (UID: \"1210ca54-6708-430e-bb5f-e3bf24ea0a61\") " pod="openshift-must-gather-t8gmh/perf-node-gather-daemonset-ftkrz" Sep 18 21:27:56.291218 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:56.291096 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75b7j\" (UniqueName: \"kubernetes.io/projected/1210ca54-6708-430e-bb5f-e3bf24ea0a61-kube-api-access-75b7j\") pod \"perf-node-gather-daemonset-ftkrz\" (UID: \"1210ca54-6708-430e-bb5f-e3bf24ea0a61\") " pod="openshift-must-gather-t8gmh/perf-node-gather-daemonset-ftkrz" Sep 18 21:27:56.291218 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:56.291131 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1210ca54-6708-430e-bb5f-e3bf24ea0a61-sys\") pod \"perf-node-gather-daemonset-ftkrz\" (UID: \"1210ca54-6708-430e-bb5f-e3bf24ea0a61\") " pod="openshift-must-gather-t8gmh/perf-node-gather-daemonset-ftkrz" Sep 18 21:27:56.291218 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:56.291216 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1210ca54-6708-430e-bb5f-e3bf24ea0a61-proc\") pod \"perf-node-gather-daemonset-ftkrz\" (UID: \"1210ca54-6708-430e-bb5f-e3bf24ea0a61\") " pod="openshift-must-gather-t8gmh/perf-node-gather-daemonset-ftkrz" Sep 18 21:27:56.291451 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:56.291243 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1210ca54-6708-430e-bb5f-e3bf24ea0a61-lib-modules\") pod \"perf-node-gather-daemonset-ftkrz\" (UID: \"1210ca54-6708-430e-bb5f-e3bf24ea0a61\") " pod="openshift-must-gather-t8gmh/perf-node-gather-daemonset-ftkrz" Sep 18 21:27:56.291451 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:56.291277 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1210ca54-6708-430e-bb5f-e3bf24ea0a61-proc\") pod \"perf-node-gather-daemonset-ftkrz\" (UID: \"1210ca54-6708-430e-bb5f-e3bf24ea0a61\") " pod="openshift-must-gather-t8gmh/perf-node-gather-daemonset-ftkrz" Sep 18 21:27:56.291451 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:56.291278 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1210ca54-6708-430e-bb5f-e3bf24ea0a61-podres\") pod \"perf-node-gather-daemonset-ftkrz\" (UID: \"1210ca54-6708-430e-bb5f-e3bf24ea0a61\") " pod="openshift-must-gather-t8gmh/perf-node-gather-daemonset-ftkrz" Sep 18 21:27:56.291451 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:56.291405 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1210ca54-6708-430e-bb5f-e3bf24ea0a61-lib-modules\") pod \"perf-node-gather-daemonset-ftkrz\" (UID: \"1210ca54-6708-430e-bb5f-e3bf24ea0a61\") " pod="openshift-must-gather-t8gmh/perf-node-gather-daemonset-ftkrz" Sep 18 21:27:56.330687 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:56.330659 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75b7j\" (UniqueName: \"kubernetes.io/projected/1210ca54-6708-430e-bb5f-e3bf24ea0a61-kube-api-access-75b7j\") pod \"perf-node-gather-daemonset-ftkrz\" (UID: \"1210ca54-6708-430e-bb5f-e3bf24ea0a61\") " pod="openshift-must-gather-t8gmh/perf-node-gather-daemonset-ftkrz" Sep 18 21:27:56.414670 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:56.414613 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t8gmh/perf-node-gather-daemonset-ftkrz" Sep 18 21:27:56.716594 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:56.716564 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t8gmh/perf-node-gather-daemonset-ftkrz"] Sep 18 21:27:56.719541 ip-10-0-141-26 kubenswrapper[2581]: W0918 21:27:56.719514 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1210ca54_6708_430e_bb5f_e3bf24ea0a61.slice/crio-095d3ea59f2d9915a63612e3aeee4b3b0f628f6fd0efd79a73af3cc69b52fd02 WatchSource:0}: Error finding container 095d3ea59f2d9915a63612e3aeee4b3b0f628f6fd0efd79a73af3cc69b52fd02: Status 404 returned error can't find the container with id 095d3ea59f2d9915a63612e3aeee4b3b0f628f6fd0efd79a73af3cc69b52fd02 Sep 18 21:27:56.847848 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:56.847814 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6594f4c75-65mfq_dbb189f6-362a-4c49-8e96-67f01b1ff430/download-server/0.log" Sep 18 21:27:57.268855 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:57.268829 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-t8gmh/perf-node-gather-daemonset-ftkrz" Sep 18 21:27:57.269228 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:57.268874 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t8gmh/perf-node-gather-daemonset-ftkrz" event={"ID":"1210ca54-6708-430e-bb5f-e3bf24ea0a61","Type":"ContainerStarted","Data":"53f90991e2316c2e663acc3a12aff53cb50e1b8a19adf7256443896bc54729f8"} Sep 18 21:27:57.269228 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:57.268892 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t8gmh/perf-node-gather-daemonset-ftkrz" event={"ID":"1210ca54-6708-430e-bb5f-e3bf24ea0a61","Type":"ContainerStarted","Data":"095d3ea59f2d9915a63612e3aeee4b3b0f628f6fd0efd79a73af3cc69b52fd02"} Sep 18 21:27:57.297750 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:57.297709 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-t8gmh/perf-node-gather-daemonset-ftkrz" podStartSLOduration=1.2976956849999999 podStartE2EDuration="1.297695685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:27:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:27:57.296234089 +0000 UTC m=+1316.516346476" watchObservedRunningTime="2026-09-18 21:27:57.297695685 +0000 UTC m=+1316.517808069" Sep 18 21:27:57.725589 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:57.725556 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5c4db8bdf9-9n8jv_3be1e7ed-092e-42b6-9a91-b8f984a02b4f/volume-data-source-validator/0.log" Sep 18 21:27:58.941365 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:58.941338 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tg8b4_ad969dab-7207-48f2-b60e-b5d09c455d31/dns/0.log" Sep 18 21:27:58.968883 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:58.968858 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tg8b4_ad969dab-7207-48f2-b60e-b5d09c455d31/kube-rbac-proxy/0.log" Sep 18 21:27:59.189056 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:59.189024 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x968q_1cc5c883-f3d7-4313-8174-fed3d65dcf2d/dns-node-resolver/0.log" Sep 18 21:27:59.830903 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:27:59.830870 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4z79x_f656f6e8-a587-471a-87c6-43939a689aca/node-ca/0.log" Sep 18 21:28:01.021987 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:28:01.021950 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5_c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb/istio-proxy/0.log" Sep 18 21:28:01.090185 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:28:01.090141 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-vzt74_5ffd6dda-dc94-4f3d-885b-e37b50967564/discovery/0.log" Sep 18 21:28:01.184921 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:28:01.184881 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-74zwd_677b182b-96c5-45cf-90b3-be4084ab243f/istio-proxy/1.log" Sep 18 21:28:01.185396 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:28:01.185371 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-74zwd_677b182b-96c5-45cf-90b3-be4084ab243f/istio-proxy/0.log" Sep 18 21:28:01.868204 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:28:01.868139 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6r8fz_b0991a3e-79b3-4eaa-8ed4-5b95dafae484/serve-healthcheck-canary/0.log" Sep 18 21:28:02.510384 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:28:02.510355 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-f7zlc_38857100-523d-487d-bd52-329001743062/insights-operator/0.log" Sep 18 21:28:02.510881 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:28:02.510861 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-f7zlc_38857100-523d-487d-bd52-329001743062/insights-operator/1.log" Sep 18 21:28:02.885582 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:28:02.885495 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x2gp6_512251b1-b84f-4a85-990d-dfe424c05143/kube-rbac-proxy/0.log" Sep 18 21:28:02.934482 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:28:02.934456 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x2gp6_512251b1-b84f-4a85-990d-dfe424c05143/exporter/0.log" Sep 18 21:28:02.960810 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:28:02.960784 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x2gp6_512251b1-b84f-4a85-990d-dfe424c05143/extractor/0.log" Sep 18 21:28:03.281397 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:28:03.281371 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-t8gmh/perf-node-gather-daemonset-ftkrz" Sep 18 21:28:05.377929 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:28:05.377897 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-68752_389bcd0d-01b7-486e-9622-dc94b662b0db/server/0.log" Sep 18 21:28:05.459654 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:28:05.459628 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9pj4s_9d30f2ad-3695-442d-906e-bbdf5d214a57/manager/0.log" Sep 18 21:28:05.611190 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:28:05.611136 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb_9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b/manager/0.log" Sep 18 21:28:05.649974 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:28:05.649900 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fc5c55ffb-mdcnb_9743a4ba-d064-47a0-a44a-8e3eb5b9dd0b/copy-manifests/0.log" Sep 18 21:28:06.538609 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:28:06.538563 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5_c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb/istio-proxy/0.log" Sep 18 21:28:06.629200 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:28:06.629093 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-vzt74_5ffd6dda-dc94-4f3d-885b-e37b50967564/discovery/0.log" Sep 18 21:28:06.831508 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:28:06.831477 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-74zwd_677b182b-96c5-45cf-90b3-be4084ab243f/istio-proxy/1.log" Sep 18 21:28:06.831824 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:28:06.831806 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-74zwd_677b182b-96c5-45cf-90b3-be4084ab243f/istio-proxy/0.log" Sep 18 21:28:07.444942 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:28:07.444903 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7b5fc9cc4d-kdv7m_098317da-c8c9-4d36-a7a9-58659fc39795/manager/0.log" Sep 18 21:28:08.091240 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:28:08.091205 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-x75t5_c0f4f9b0-f0d0-425d-8708-7b1aa96f6dbb/istio-proxy/0.log" Sep 18 21:28:08.152329 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:28:08.152297 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-vzt74_5ffd6dda-dc94-4f3d-885b-e37b50967564/discovery/0.log" Sep 18 21:28:08.283415 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:28:08.283390 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-74zwd_677b182b-96c5-45cf-90b3-be4084ab243f/istio-proxy/1.log" Sep 18 21:28:08.283914 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:28:08.283890 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-74zwd_677b182b-96c5-45cf-90b3-be4084ab243f/istio-proxy/0.log" Sep 18 21:28:14.650249 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:28:14.650213 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-65jch_5cfef91b-197c-451c-bb28-5c8b7dd3c991/kube-multus/0.log" Sep 18 21:28:14.734784 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:28:14.734755 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4mmzf_43ea9d10-49c4-48c3-837a-e475e2dc87b5/kube-multus-additional-cni-plugins/0.log" Sep 18 21:28:14.759815 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:28:14.759790 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4mmzf_43ea9d10-49c4-48c3-837a-e475e2dc87b5/egress-router-binary-copy/0.log" Sep 18 21:28:14.782328 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:28:14.782305 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4mmzf_43ea9d10-49c4-48c3-837a-e475e2dc87b5/cni-plugins/0.log" Sep 18 21:28:14.803813 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:28:14.803790 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4mmzf_43ea9d10-49c4-48c3-837a-e475e2dc87b5/bond-cni-plugin/0.log" Sep 18 21:28:14.831252 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:28:14.831223 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4mmzf_43ea9d10-49c4-48c3-837a-e475e2dc87b5/routeoverride-cni/0.log" Sep 18 21:28:14.857657 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:28:14.857634 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4mmzf_43ea9d10-49c4-48c3-837a-e475e2dc87b5/whereabouts-cni-bincopy/0.log" Sep 18 21:28:14.881842 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:28:14.881820 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4mmzf_43ea9d10-49c4-48c3-837a-e475e2dc87b5/whereabouts-cni/0.log" Sep 18 21:28:15.395797 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:28:15.395766 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hxmc5_1b7697c4-d541-409e-8863-71a4142610e7/network-metrics-daemon/0.log" Sep 18 21:28:15.418565 ip-10-0-141-26 kubenswrapper[2581]: I0918 21:28:15.418543 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hxmc5_1b7697c4-d541-409e-8863-71a4142610e7/kube-rbac-proxy/0.log"