Sep 17 15:37:13.104230 ip-10-0-132-207 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 17 15:37:13.104244 ip-10-0-132-207 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 17 15:37:13.104254 ip-10-0-132-207 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 17 15:37:13.104593 ip-10-0-132-207 systemd[1]: Failed to start Kubernetes Kubelet. Sep 17 15:37:23.353538 ip-10-0-132-207 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 17 15:37:23.353557 ip-10-0-132-207 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 7707e2ccabb643099adc8f5d066d043d -- Sep 17 15:39:03.214437 ip-10-0-132-207 systemd[1]: Starting Kubernetes Kubelet... Sep 17 15:39:03.643477 ip-10-0-132-207 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 15:39:03.643477 ip-10-0-132-207 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 17 15:39:03.643477 ip-10-0-132-207 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 15:39:03.643477 ip-10-0-132-207 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 17 15:39:03.643477 ip-10-0-132-207 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 15:39:03.644219 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.643543 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 17 15:39:03.648575 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648555 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 15:39:03.648575 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648575 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 15:39:03.648644 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648579 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 15:39:03.648644 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648582 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 15:39:03.648644 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648585 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 15:39:03.648644 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648589 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 15:39:03.648644 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648592 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 15:39:03.648644 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648595 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 15:39:03.648644 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648598 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 15:39:03.648644 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648601 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 15:39:03.648644 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648604 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 15:39:03.648644 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648606 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 15:39:03.648644 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648611 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 15:39:03.648644 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648613 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 15:39:03.648644 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648616 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 15:39:03.648644 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648618 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 15:39:03.648644 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648622 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 15:39:03.648644 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648624 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 15:39:03.648644 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648627 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 15:39:03.648644 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648629 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 15:39:03.648644 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648632 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 15:39:03.648644 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648634 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 15:39:03.649111 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648637 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 15:39:03.649111 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648640 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 15:39:03.649111 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648642 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 15:39:03.649111 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648645 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 15:39:03.649111 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648648 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 15:39:03.649111 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648650 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 15:39:03.649111 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648653 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 15:39:03.649111 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648656 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 15:39:03.649111 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648661 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 15:39:03.649111 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648664 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 15:39:03.649111 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648667 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 15:39:03.649111 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648670 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 15:39:03.649111 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648673 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 15:39:03.649111 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648675 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 15:39:03.649111 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648678 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 17 15:39:03.649111 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648681 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 15:39:03.649111 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648684 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 15:39:03.649111 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648686 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 15:39:03.649111 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648689 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 15:39:03.649111 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648692 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 15:39:03.649659 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648695 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 15:39:03.649659 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648697 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 15:39:03.649659 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648701 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 15:39:03.649659 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648703 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 15:39:03.649659 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648706 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 15:39:03.649659 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648708 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 15:39:03.649659 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648711 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 15:39:03.649659 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648713 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 15:39:03.649659 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648715 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 15:39:03.649659 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648718 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 15:39:03.649659 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648720 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 15:39:03.649659 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648723 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 15:39:03.649659 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648725 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 15:39:03.649659 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648729 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 15:39:03.649659 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648732 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 15:39:03.649659 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648734 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 15:39:03.649659 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648737 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 15:39:03.649659 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648740 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 15:39:03.649659 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648742 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 15:39:03.650109 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648745 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 15:39:03.650109 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648747 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 15:39:03.650109 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648750 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 15:39:03.650109 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648754 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 15:39:03.650109 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648758 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 15:39:03.650109 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648761 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 15:39:03.650109 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648764 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 15:39:03.650109 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648767 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 15:39:03.650109 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648770 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 15:39:03.650109 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648772 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 15:39:03.650109 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648775 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 15:39:03.650109 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648777 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 15:39:03.650109 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648779 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 15:39:03.650109 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648782 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 15:39:03.650109 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648785 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 15:39:03.650109 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648787 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 15:39:03.650109 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648790 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 15:39:03.650109 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648793 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 15:39:03.650109 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648795 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 15:39:03.650109 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648798 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 15:39:03.650589 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648800 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 15:39:03.650589 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648803 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 15:39:03.650589 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648805 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 15:39:03.650589 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648808 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 15:39:03.650589 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648810 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 15:39:03.650589 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648813 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 15:39:03.650589 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648817 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 15:39:03.650589 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648819 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 15:39:03.650589 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648822 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 15:39:03.650589 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648825 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 15:39:03.650589 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648827 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 15:39:03.650589 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648830 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 15:39:03.650589 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648832 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 15:39:03.650589 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648835 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 15:39:03.650589 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648837 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 15:39:03.650589 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648840 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 15:39:03.650589 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648842 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 15:39:03.650589 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.648845 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 15:39:03.651439 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651425 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 15:39:03.651439 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651438 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 15:39:03.651502 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651442 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 15:39:03.651502 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651445 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 15:39:03.651502 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651448 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 15:39:03.651502 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651451 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 15:39:03.651502 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651453 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 15:39:03.651502 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651456 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 15:39:03.651502 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651460 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 15:39:03.651502 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651464 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 15:39:03.651502 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651467 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 15:39:03.651502 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651471 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 15:39:03.651502 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651474 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 15:39:03.651502 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651476 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 15:39:03.651502 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651479 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 15:39:03.651502 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651482 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 15:39:03.651502 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651485 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 15:39:03.651502 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651488 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 15:39:03.651502 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651491 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 15:39:03.651502 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651494 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 15:39:03.651502 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651497 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 15:39:03.651502 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651500 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 15:39:03.651992 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651503 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 15:39:03.651992 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651506 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 15:39:03.651992 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651509 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 15:39:03.651992 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651512 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 15:39:03.651992 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651514 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 15:39:03.651992 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651517 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 17 15:39:03.651992 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651520 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 15:39:03.651992 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651522 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 15:39:03.651992 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651525 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 15:39:03.651992 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651527 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 15:39:03.651992 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651530 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 15:39:03.651992 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651533 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 15:39:03.651992 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651536 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 15:39:03.651992 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651538 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 15:39:03.651992 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651541 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 15:39:03.651992 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651543 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 15:39:03.651992 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651546 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 15:39:03.651992 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651548 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 15:39:03.651992 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651550 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 15:39:03.651992 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651553 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 15:39:03.652532 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651555 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 15:39:03.652532 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651558 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 15:39:03.652532 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651561 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 15:39:03.652532 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651563 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 15:39:03.652532 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651566 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 15:39:03.652532 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651568 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 15:39:03.652532 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651571 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 15:39:03.652532 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651574 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 15:39:03.652532 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651576 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 15:39:03.652532 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651579 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 15:39:03.652532 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651581 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 15:39:03.652532 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651584 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 15:39:03.652532 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651586 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 15:39:03.652532 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651590 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 15:39:03.652532 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651593 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 15:39:03.652532 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651595 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 15:39:03.652532 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651597 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 15:39:03.652532 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651600 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 15:39:03.652532 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651602 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 15:39:03.652532 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651605 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 15:39:03.653016 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651608 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 15:39:03.653016 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651610 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 15:39:03.653016 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651612 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 15:39:03.653016 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651615 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 15:39:03.653016 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651617 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 15:39:03.653016 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651620 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 15:39:03.653016 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651622 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 15:39:03.653016 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651625 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 15:39:03.653016 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651627 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 15:39:03.653016 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651630 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 15:39:03.653016 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651632 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 15:39:03.653016 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651634 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 15:39:03.653016 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651637 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 15:39:03.653016 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651639 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 15:39:03.653016 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651641 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 15:39:03.653016 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651647 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 15:39:03.653016 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651650 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 15:39:03.653016 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651655 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 15:39:03.653578 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651658 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 15:39:03.653578 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651661 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 15:39:03.653578 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651664 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 15:39:03.653578 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651666 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 15:39:03.653578 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651669 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 15:39:03.653578 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651672 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 15:39:03.653578 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651674 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 15:39:03.653578 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651677 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 15:39:03.653578 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651680 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 15:39:03.653578 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651682 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 15:39:03.653578 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651684 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 15:39:03.653578 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651687 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 15:39:03.653578 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651689 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 15:39:03.653578 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651692 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 15:39:03.653578 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651694 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 15:39:03.653578 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651697 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 15:39:03.653578 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651700 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 15:39:03.653578 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651702 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 15:39:03.653578 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.651705 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 15:39:03.653578 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652091 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 15:39:03.654065 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652096 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 15:39:03.654065 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652099 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 15:39:03.654065 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652101 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 15:39:03.654065 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652104 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 15:39:03.654065 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652107 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 15:39:03.654065 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652109 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 15:39:03.654065 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652132 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 15:39:03.654065 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652135 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 15:39:03.654065 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652138 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 15:39:03.654065 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652141 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 15:39:03.654065 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652144 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 15:39:03.654065 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652147 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 15:39:03.654065 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652149 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 15:39:03.654065 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652152 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 15:39:03.654065 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652154 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 15:39:03.654065 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652157 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 15:39:03.654065 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652160 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 15:39:03.654065 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652163 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 15:39:03.654065 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652166 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 15:39:03.654065 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652169 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 15:39:03.654560 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652172 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 15:39:03.654560 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652174 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 15:39:03.654560 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652177 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 15:39:03.654560 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652180 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 17 15:39:03.654560 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652182 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 15:39:03.654560 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652185 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 15:39:03.654560 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652188 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 15:39:03.654560 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652190 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 15:39:03.654560 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652193 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 15:39:03.654560 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652195 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 15:39:03.654560 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652198 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 15:39:03.654560 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652200 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 15:39:03.654560 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652203 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 15:39:03.654560 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652205 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 15:39:03.654560 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652208 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 15:39:03.654560 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652210 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 15:39:03.654560 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652213 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 15:39:03.654560 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652215 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 15:39:03.654560 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652217 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 15:39:03.654560 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652220 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 15:39:03.655045 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652222 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 15:39:03.655045 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652227 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 15:39:03.655045 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652231 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 15:39:03.655045 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652234 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 15:39:03.655045 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652236 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 15:39:03.655045 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652239 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 15:39:03.655045 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652241 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 15:39:03.655045 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652244 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 15:39:03.655045 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652247 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 15:39:03.655045 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652250 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 15:39:03.655045 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652253 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 15:39:03.655045 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652255 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 15:39:03.655045 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652258 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 15:39:03.655045 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652262 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 15:39:03.655045 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652265 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 15:39:03.655045 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652268 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 15:39:03.655045 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652272 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 15:39:03.655045 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652275 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 15:39:03.655045 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652278 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 15:39:03.655045 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652280 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 15:39:03.655556 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652283 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 15:39:03.655556 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652286 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 15:39:03.655556 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652289 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 15:39:03.655556 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652291 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 15:39:03.655556 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652295 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 15:39:03.655556 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652298 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 15:39:03.655556 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652301 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 15:39:03.655556 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652304 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 15:39:03.655556 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652307 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 15:39:03.655556 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652309 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 15:39:03.655556 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652312 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 15:39:03.655556 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652315 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 15:39:03.655556 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652317 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 15:39:03.655556 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652320 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 15:39:03.655556 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652323 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 15:39:03.655556 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652326 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 15:39:03.655556 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652328 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 15:39:03.655556 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652331 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 15:39:03.655556 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652333 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 15:39:03.656022 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652336 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 15:39:03.656022 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652338 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 15:39:03.656022 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652341 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 15:39:03.656022 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652344 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 15:39:03.656022 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652349 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 15:39:03.656022 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652352 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 15:39:03.656022 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652354 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 15:39:03.656022 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652357 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 15:39:03.656022 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652359 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 15:39:03.656022 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652362 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 15:39:03.656022 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652365 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 15:39:03.656022 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652367 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 15:39:03.656022 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652369 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 15:39:03.656022 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652372 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 15:39:03.656022 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652374 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 15:39:03.656022 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652377 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 15:39:03.656022 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652380 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 15:39:03.656022 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652382 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 15:39:03.656022 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.652386 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 15:39:03.656022 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652464 2581 flags.go:64] FLAG: --address="0.0.0.0" Sep 17 15:39:03.656526 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652511 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 17 15:39:03.656526 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652519 2581 flags.go:64] FLAG: --anonymous-auth="true" Sep 17 15:39:03.656526 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652523 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 17 15:39:03.656526 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652527 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 17 15:39:03.656526 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652531 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 17 15:39:03.656526 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652535 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 17 15:39:03.656526 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652540 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 17 15:39:03.656526 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652543 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 17 15:39:03.656526 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652546 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 17 15:39:03.656526 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652550 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 17 15:39:03.656526 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652553 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 17 15:39:03.656526 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652557 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 17 15:39:03.656526 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652560 2581 flags.go:64] FLAG: --cgroup-root="" Sep 17 15:39:03.656526 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652562 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 17 15:39:03.656526 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652566 2581 flags.go:64] FLAG: --client-ca-file="" Sep 17 15:39:03.656526 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652568 2581 flags.go:64] FLAG: --cloud-provider="external" Sep 17 15:39:03.656526 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652572 2581 flags.go:64] FLAG: --cluster-dns="[]" Sep 17 15:39:03.656526 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652576 2581 flags.go:64] FLAG: --cluster-domain="" Sep 17 15:39:03.656526 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652579 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 17 15:39:03.656526 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652582 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 17 15:39:03.656526 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652585 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 17 15:39:03.656526 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652589 2581 flags.go:64] FLAG: --container-log-max-files="5" Sep 17 15:39:03.656526 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652592 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 17 15:39:03.656526 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652596 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 17 15:39:03.657093 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652599 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 17 15:39:03.657093 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652602 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 17 15:39:03.657093 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652606 2581 flags.go:64] FLAG: --contention-profiling="false" Sep 17 15:39:03.657093 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652609 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 17 15:39:03.657093 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652612 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 17 15:39:03.657093 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652615 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 17 15:39:03.657093 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652618 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 17 15:39:03.657093 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652623 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 17 15:39:03.657093 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652626 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 17 15:39:03.657093 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652629 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 17 15:39:03.657093 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652632 2581 flags.go:64] FLAG: --enable-load-reader="false" Sep 17 15:39:03.657093 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652635 2581 flags.go:64] FLAG: --enable-server="true" Sep 17 15:39:03.657093 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652638 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 17 15:39:03.657093 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652642 2581 flags.go:64] FLAG: --event-burst="100" Sep 17 15:39:03.657093 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652645 2581 flags.go:64] FLAG: --event-qps="50" Sep 17 15:39:03.657093 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652648 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 17 15:39:03.657093 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652651 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 17 15:39:03.657093 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652653 2581 flags.go:64] FLAG: --eviction-hard="" Sep 17 15:39:03.657093 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652658 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 17 15:39:03.657093 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652661 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 17 15:39:03.657093 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652664 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 17 15:39:03.657093 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652666 2581 flags.go:64] FLAG: --eviction-soft="" Sep 17 15:39:03.657093 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652669 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 17 15:39:03.657093 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652672 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 17 15:39:03.657093 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652675 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 17 15:39:03.657774 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652678 2581 flags.go:64] FLAG: --experimental-mounter-path="" Sep 17 15:39:03.657774 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652681 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 17 15:39:03.657774 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652684 2581 flags.go:64] FLAG: --fail-swap-on="true" Sep 17 15:39:03.657774 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652686 2581 flags.go:64] FLAG: --feature-gates="" Sep 17 15:39:03.657774 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652691 2581 flags.go:64] FLAG: --file-check-frequency="20s" Sep 17 15:39:03.657774 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652694 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 17 15:39:03.657774 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652697 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 17 15:39:03.657774 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652700 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 17 15:39:03.657774 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652702 2581 flags.go:64] FLAG: --healthz-port="10248" Sep 17 15:39:03.657774 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652706 2581 flags.go:64] FLAG: --help="false" Sep 17 15:39:03.657774 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652709 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-132-207.ec2.internal" Sep 17 15:39:03.657774 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652712 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 17 15:39:03.657774 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652715 2581 flags.go:64] FLAG: --http-check-frequency="20s" Sep 17 15:39:03.657774 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652717 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 17 15:39:03.657774 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652721 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 17 15:39:03.657774 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652724 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 17 15:39:03.657774 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652727 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 17 15:39:03.657774 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652730 2581 flags.go:64] FLAG: --image-service-endpoint="" Sep 17 15:39:03.657774 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652732 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 17 15:39:03.657774 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652735 2581 flags.go:64] FLAG: --kube-api-burst="100" Sep 17 15:39:03.657774 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652738 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 17 15:39:03.657774 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652741 2581 flags.go:64] FLAG: --kube-api-qps="50" Sep 17 15:39:03.657774 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652744 2581 flags.go:64] FLAG: --kube-reserved="" Sep 17 15:39:03.657774 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652747 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 17 15:39:03.658372 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652750 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 17 15:39:03.658372 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652753 2581 flags.go:64] FLAG: --kubelet-cgroups="" Sep 17 15:39:03.658372 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652756 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 17 15:39:03.658372 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652759 2581 flags.go:64] FLAG: --lock-file="" Sep 17 15:39:03.658372 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652761 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 17 15:39:03.658372 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652765 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 17 15:39:03.658372 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652768 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 17 15:39:03.658372 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652774 2581 flags.go:64] FLAG: --log-json-split-stream="false" Sep 17 15:39:03.658372 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652777 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 17 15:39:03.658372 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652780 2581 flags.go:64] FLAG: --log-text-split-stream="false" Sep 17 15:39:03.658372 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652783 2581 flags.go:64] FLAG: --logging-format="text" Sep 17 15:39:03.658372 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652786 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 17 15:39:03.658372 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652789 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 17 15:39:03.658372 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652792 2581 flags.go:64] FLAG: --manifest-url="" Sep 17 15:39:03.658372 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652794 2581 flags.go:64] FLAG: --manifest-url-header="" Sep 17 15:39:03.658372 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652799 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 17 15:39:03.658372 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652802 2581 flags.go:64] FLAG: --max-open-files="1000000" Sep 17 15:39:03.658372 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652806 2581 flags.go:64] FLAG: --max-pods="110" Sep 17 15:39:03.658372 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652809 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 17 15:39:03.658372 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652812 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 17 15:39:03.658372 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652815 2581 flags.go:64] FLAG: --memory-manager-policy="None" Sep 17 15:39:03.658372 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652818 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 17 15:39:03.658372 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652821 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 17 15:39:03.658372 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652824 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 17 15:39:03.658372 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652826 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 17 15:39:03.658993 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652835 2581 flags.go:64] FLAG: --node-status-max-images="50" Sep 17 15:39:03.658993 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652837 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 17 15:39:03.658993 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652840 2581 flags.go:64] FLAG: --oom-score-adj="-999" Sep 17 15:39:03.658993 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652843 2581 flags.go:64] FLAG: --pod-cidr="" Sep 17 15:39:03.658993 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652846 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 17 15:39:03.658993 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652852 2581 flags.go:64] FLAG: --pod-manifest-path="" Sep 17 15:39:03.658993 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652855 2581 flags.go:64] FLAG: --pod-max-pids="-1" Sep 17 15:39:03.658993 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652858 2581 flags.go:64] FLAG: --pods-per-core="0" Sep 17 15:39:03.658993 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652860 2581 flags.go:64] FLAG: --port="10250" Sep 17 15:39:03.658993 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652863 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 17 15:39:03.658993 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652867 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-075ccb916ac500985" Sep 17 15:39:03.658993 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652870 2581 flags.go:64] FLAG: --qos-reserved="" Sep 17 15:39:03.658993 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652873 2581 flags.go:64] FLAG: --read-only-port="10255" Sep 17 15:39:03.658993 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652876 2581 flags.go:64] FLAG: --register-node="true" Sep 17 15:39:03.658993 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652879 2581 flags.go:64] FLAG: --register-with-taints="" Sep 17 15:39:03.658993 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652883 2581 flags.go:64] FLAG: --registry-burst="10" Sep 17 15:39:03.658993 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652886 2581 flags.go:64] FLAG: --registry-qps="5" Sep 17 15:39:03.658993 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652888 2581 flags.go:64] FLAG: --reserved-cpus="" Sep 17 15:39:03.658993 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652891 2581 flags.go:64] FLAG: --reserved-memory="" Sep 17 15:39:03.658993 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652895 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 17 15:39:03.658993 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652898 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 17 15:39:03.658993 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652901 2581 flags.go:64] FLAG: --rotate-certificates="false" Sep 17 15:39:03.658993 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652904 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 17 15:39:03.658993 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652906 2581 flags.go:64] FLAG: --runonce="false" Sep 17 15:39:03.658993 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652909 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 17 15:39:03.659618 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652913 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 17 15:39:03.659618 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652915 2581 flags.go:64] FLAG: --seccomp-default="false" Sep 17 15:39:03.659618 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652919 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 17 15:39:03.659618 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652922 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 17 15:39:03.659618 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652925 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 17 15:39:03.659618 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652928 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 17 15:39:03.659618 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652931 2581 flags.go:64] FLAG: --storage-driver-password="root" Sep 17 15:39:03.659618 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652934 2581 flags.go:64] FLAG: --storage-driver-secure="false" Sep 17 15:39:03.659618 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652937 2581 flags.go:64] FLAG: --storage-driver-table="stats" Sep 17 15:39:03.659618 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652940 2581 flags.go:64] FLAG: --storage-driver-user="root" Sep 17 15:39:03.659618 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652942 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 17 15:39:03.659618 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652945 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 17 15:39:03.659618 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652948 2581 flags.go:64] FLAG: --system-cgroups="" Sep 17 15:39:03.659618 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652951 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 17 15:39:03.659618 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652957 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 17 15:39:03.659618 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652959 2581 flags.go:64] FLAG: --tls-cert-file="" Sep 17 15:39:03.659618 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652962 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 17 15:39:03.659618 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652966 2581 flags.go:64] FLAG: --tls-min-version="" Sep 17 15:39:03.659618 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652970 2581 flags.go:64] FLAG: --tls-private-key-file="" Sep 17 15:39:03.659618 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652972 2581 flags.go:64] FLAG: --topology-manager-policy="none" Sep 17 15:39:03.659618 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652975 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 17 15:39:03.659618 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652980 2581 flags.go:64] FLAG: --topology-manager-scope="container" Sep 17 15:39:03.659618 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652983 2581 flags.go:64] FLAG: --v="2" Sep 17 15:39:03.659618 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652987 2581 flags.go:64] FLAG: --version="false" Sep 17 15:39:03.659618 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652991 2581 flags.go:64] FLAG: --vmodule="" Sep 17 15:39:03.660226 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652995 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 17 15:39:03.660226 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.652998 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 17 15:39:03.660226 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653129 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 15:39:03.660226 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653134 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 15:39:03.660226 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653137 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 15:39:03.660226 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653140 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 15:39:03.660226 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653144 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 15:39:03.660226 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653149 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 15:39:03.660226 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653152 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 15:39:03.660226 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653156 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 15:39:03.660226 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653159 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 15:39:03.660226 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653161 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 15:39:03.660226 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653164 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 15:39:03.660226 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653167 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 15:39:03.660226 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653169 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 15:39:03.660226 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653172 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 15:39:03.660226 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653175 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 15:39:03.660226 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653177 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 15:39:03.660226 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653180 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 15:39:03.660226 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653182 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 15:39:03.660719 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653185 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 15:39:03.660719 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653188 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 15:39:03.660719 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653190 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 15:39:03.660719 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653193 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 15:39:03.660719 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653196 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 15:39:03.660719 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653199 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 15:39:03.660719 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653202 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 17 15:39:03.660719 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653205 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 15:39:03.660719 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653209 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 15:39:03.660719 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653211 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 15:39:03.660719 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653214 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 15:39:03.660719 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653216 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 15:39:03.660719 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653219 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 15:39:03.660719 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653222 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 15:39:03.660719 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653224 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 15:39:03.660719 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653227 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 15:39:03.660719 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653229 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 15:39:03.660719 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653232 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 15:39:03.660719 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653234 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 15:39:03.660719 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653238 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 15:39:03.661274 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653241 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 15:39:03.661274 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653243 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 15:39:03.661274 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653247 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 15:39:03.661274 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653251 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 15:39:03.661274 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653255 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 15:39:03.661274 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653259 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 15:39:03.661274 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653261 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 15:39:03.661274 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653264 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 15:39:03.661274 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653267 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 15:39:03.661274 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653269 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 15:39:03.661274 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653272 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 15:39:03.661274 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653275 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 15:39:03.661274 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653277 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 15:39:03.661274 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653281 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 15:39:03.661274 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653284 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 15:39:03.661274 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653286 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 15:39:03.661274 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653289 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 15:39:03.661274 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653292 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 15:39:03.661274 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653294 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 15:39:03.661790 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653298 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 15:39:03.661790 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653302 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 15:39:03.661790 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653305 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 15:39:03.661790 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653307 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 15:39:03.661790 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653310 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 15:39:03.661790 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653312 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 15:39:03.661790 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653315 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 15:39:03.661790 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653318 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 15:39:03.661790 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653320 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 15:39:03.661790 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653323 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 15:39:03.661790 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653325 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 15:39:03.661790 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653328 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 15:39:03.661790 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653332 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 15:39:03.661790 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653334 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 15:39:03.661790 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653337 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 15:39:03.661790 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653340 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 15:39:03.661790 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653342 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 15:39:03.661790 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653345 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 15:39:03.661790 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653348 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 15:39:03.662565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653350 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 15:39:03.662565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653353 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 15:39:03.662565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653355 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 15:39:03.662565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653358 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 15:39:03.662565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653361 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 15:39:03.662565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653363 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 15:39:03.662565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653366 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 15:39:03.662565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653368 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 15:39:03.662565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653371 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 15:39:03.662565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653374 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 15:39:03.662565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653377 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 15:39:03.662565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653379 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 15:39:03.662565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653382 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 15:39:03.662565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653384 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 15:39:03.662565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653389 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 15:39:03.662565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653391 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 15:39:03.662565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653394 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 15:39:03.662565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653397 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 15:39:03.662565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653399 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 15:39:03.662565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653402 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 15:39:03.663172 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653405 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 15:39:03.663172 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653407 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 15:39:03.663172 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.653410 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 15:39:03.663172 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.654791 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 15:39:03.663754 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.663733 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 17 15:39:03.663754 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.663754 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 17 15:39:03.663815 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.663772 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 17 15:39:03.663815 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.663778 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 17 15:39:03.663869 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663839 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 15:39:03.663869 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663843 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 15:39:03.663869 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663847 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 17 15:39:03.663869 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663850 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 15:39:03.663869 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663854 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 15:39:03.663869 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663857 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 15:39:03.663869 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663860 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 15:39:03.663869 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663863 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 15:39:03.663869 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663866 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 15:39:03.663869 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663868 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 15:39:03.663869 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663871 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 15:39:03.663869 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663874 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 15:39:03.664185 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663877 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 15:39:03.664185 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663880 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 15:39:03.664185 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663883 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 15:39:03.664185 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663885 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 15:39:03.664185 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663889 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 15:39:03.664185 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663893 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 15:39:03.664185 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663895 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 15:39:03.664185 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663898 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 15:39:03.664185 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663900 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 15:39:03.664185 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663903 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 15:39:03.664185 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663906 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 15:39:03.664185 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663909 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 15:39:03.664185 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663911 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 15:39:03.664185 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663914 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 15:39:03.664185 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663916 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 15:39:03.664185 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663919 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 15:39:03.664185 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663921 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 15:39:03.664185 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663924 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 15:39:03.664185 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663926 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 15:39:03.664643 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663929 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 15:39:03.664643 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663932 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 15:39:03.664643 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663934 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 15:39:03.664643 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663937 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 15:39:03.664643 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663939 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 15:39:03.664643 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663942 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 15:39:03.664643 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663944 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 15:39:03.664643 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663947 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 15:39:03.664643 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663950 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 15:39:03.664643 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663952 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 15:39:03.664643 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663955 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 15:39:03.664643 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663957 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 15:39:03.664643 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663960 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 15:39:03.664643 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663962 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 15:39:03.664643 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663966 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 15:39:03.664643 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663968 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 15:39:03.664643 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663971 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 15:39:03.664643 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663974 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 15:39:03.664643 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663976 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 15:39:03.664643 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663979 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 15:39:03.665270 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663981 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 15:39:03.665270 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663984 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 15:39:03.665270 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663988 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 15:39:03.665270 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663992 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 15:39:03.665270 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663994 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 15:39:03.665270 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.663997 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 15:39:03.665270 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664000 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 15:39:03.665270 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664003 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 15:39:03.665270 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664006 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 15:39:03.665270 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664008 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 15:39:03.665270 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664011 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 15:39:03.665270 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664014 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 15:39:03.665270 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664017 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 15:39:03.665270 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664020 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 15:39:03.665270 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664022 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 15:39:03.665270 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664024 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 15:39:03.665270 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664027 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 15:39:03.665270 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664029 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 15:39:03.665270 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664033 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 15:39:03.665776 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664036 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 15:39:03.665776 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664038 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 15:39:03.665776 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664041 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 15:39:03.665776 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664043 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 15:39:03.665776 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664046 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 15:39:03.665776 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664048 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 15:39:03.665776 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664052 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 15:39:03.665776 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664056 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 15:39:03.665776 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664059 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 15:39:03.665776 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664063 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 15:39:03.665776 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664066 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 15:39:03.665776 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664069 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 15:39:03.665776 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664072 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 15:39:03.665776 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664074 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 15:39:03.665776 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664077 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 15:39:03.665776 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664079 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 15:39:03.665776 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664082 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 15:39:03.665776 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664084 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 15:39:03.665776 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664087 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 15:39:03.666261 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664090 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 15:39:03.666261 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664092 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 15:39:03.666261 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664095 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 15:39:03.666261 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664097 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 15:39:03.666261 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664100 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 15:39:03.666261 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664103 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 15:39:03.666261 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664105 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 15:39:03.666261 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664108 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 15:39:03.666261 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664111 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 15:39:03.666261 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664131 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 15:39:03.666261 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.664137 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 15:39:03.666261 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664264 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 15:39:03.666261 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664270 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 15:39:03.666261 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664273 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 15:39:03.666261 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664276 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 15:39:03.666639 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664279 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 15:39:03.666639 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664282 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 15:39:03.666639 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664284 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 15:39:03.666639 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664287 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 15:39:03.666639 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664289 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 15:39:03.666639 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664292 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 15:39:03.666639 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664294 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 15:39:03.666639 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664297 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 15:39:03.666639 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664302 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 15:39:03.666639 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664306 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 15:39:03.666639 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664309 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 15:39:03.666639 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664312 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 15:39:03.666639 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664315 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 15:39:03.666639 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664317 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 15:39:03.666639 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664320 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 15:39:03.666639 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664322 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 15:39:03.666639 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664325 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 15:39:03.666639 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664328 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 15:39:03.666639 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664330 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 15:39:03.667100 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664333 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 15:39:03.667100 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664335 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 15:39:03.667100 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664338 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 15:39:03.667100 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664340 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 15:39:03.667100 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664342 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 15:39:03.667100 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664345 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 15:39:03.667100 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664347 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 15:39:03.667100 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664350 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 15:39:03.667100 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664352 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 15:39:03.667100 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664355 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 15:39:03.667100 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664360 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 15:39:03.667100 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664363 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 15:39:03.667100 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664365 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 15:39:03.667100 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664368 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 15:39:03.667100 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664371 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 15:39:03.667100 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664374 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 15:39:03.667100 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664377 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 15:39:03.667100 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664379 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 15:39:03.667100 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664382 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 17 15:39:03.667590 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664384 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 15:39:03.667590 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664387 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 15:39:03.667590 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664390 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 15:39:03.667590 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664393 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 15:39:03.667590 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664396 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 15:39:03.667590 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664399 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 15:39:03.667590 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664401 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 15:39:03.667590 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664404 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 15:39:03.667590 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664406 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 15:39:03.667590 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664409 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 15:39:03.667590 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664411 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 15:39:03.667590 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664414 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 15:39:03.667590 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664416 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 15:39:03.667590 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664419 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 15:39:03.667590 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664422 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 15:39:03.667590 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664424 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 15:39:03.667590 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664427 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 15:39:03.667590 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664429 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 15:39:03.667590 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664431 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 15:39:03.667590 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664434 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 15:39:03.668063 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664436 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 15:39:03.668063 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664439 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 15:39:03.668063 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664442 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 15:39:03.668063 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664444 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 15:39:03.668063 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664447 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 15:39:03.668063 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664449 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 15:39:03.668063 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664452 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 15:39:03.668063 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664454 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 15:39:03.668063 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664457 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 15:39:03.668063 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664459 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 15:39:03.668063 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664462 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 15:39:03.668063 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664464 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 15:39:03.668063 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664467 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 15:39:03.668063 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664469 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 15:39:03.668063 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664472 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 15:39:03.668063 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664474 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 15:39:03.668063 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664477 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 15:39:03.668063 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664481 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 15:39:03.668063 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664484 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 15:39:03.668063 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664487 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 15:39:03.668565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664490 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 15:39:03.668565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664492 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 15:39:03.668565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664494 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 15:39:03.668565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664497 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 15:39:03.668565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664499 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 15:39:03.668565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664502 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 15:39:03.668565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664504 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 15:39:03.668565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664507 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 15:39:03.668565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664509 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 15:39:03.668565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664511 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 15:39:03.668565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664514 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 15:39:03.668565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664516 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 15:39:03.668565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664519 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 15:39:03.668565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664521 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 15:39:03.668565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664524 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 15:39:03.668565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664527 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 15:39:03.668565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:03.664529 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 15:39:03.668967 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.664534 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 15:39:03.668967 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.664653 2581 server.go:962] "Client rotation is on, will bootstrap in background" Sep 17 15:39:03.668967 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.667349 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 17 15:39:03.668967 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.668434 2581 server.go:1019] "Starting client certificate rotation" Sep 17 15:39:03.668967 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.668534 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 15:39:03.668967 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.668568 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 15:39:03.671361 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.671348 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 15:39:03.672571 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.672554 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 15:39:03.684815 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.684795 2581 log.go:25] "Validated CRI v1 runtime API" Sep 17 15:39:03.689868 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.689851 2581 log.go:25] "Validated CRI v1 image API" Sep 17 15:39:03.690778 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.690760 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 17 15:39:03.699199 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.699167 2581 fs.go:135] Filesystem UUIDs: map[26f7704a-e07c-4d98-b248-7a12faa30e37:/dev/nvme0n1p3 53d55fbc-c65b-4e36-ae0e-eff085e1adde:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Sep 17 15:39:03.699199 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.699191 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 17 15:39:03.705987 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.705861 2581 manager.go:216] Machine: {Timestamp:2026-09-17 15:39:03.704478401 +0000 UTC m=+0.381220306 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3107581 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27b49b826724a80cc3b87da19c2ee7 SystemUUID:ec27b49b-8267-24a8-0cc3-b87da19c2ee7 BootID:7707e2cc-abb6-4309-9adc-8f5d066d043d Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:fc:af:b4:d1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:fc:af:b4:d1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:ed:17:21:b7:20 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 17 15:39:03.705987 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.705978 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 17 15:39:03.706132 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.706071 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 17 15:39:03.707446 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.707430 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 15:39:03.709910 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.709880 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 17 15:39:03.710068 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.709913 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-207.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 17 15:39:03.710808 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.710798 2581 topology_manager.go:138] "Creating topology manager with none policy" Sep 17 15:39:03.710853 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.710810 2581 container_manager_linux.go:309] "Creating device plugin manager" Sep 17 15:39:03.710853 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.710818 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 15:39:03.710853 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.710836 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 15:39:03.711968 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.711957 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 17 15:39:03.716098 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.716078 2581 state_mem.go:36] "Initialized new in-memory state store" Sep 17 15:39:03.716237 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.716227 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 17 15:39:03.716281 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.716259 2581 kubelet.go:486] "Attempting to sync node with API server" Sep 17 15:39:03.716281 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.716269 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 17 15:39:03.716353 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.716284 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 17 15:39:03.716353 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.716294 2581 kubelet.go:398] "Adding apiserver pod source" Sep 17 15:39:03.716353 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.716309 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 17 15:39:03.716753 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.716741 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 15:39:03.716792 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.716762 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 15:39:03.719364 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.719342 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 17 15:39:03.722128 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.722099 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 17 15:39:03.722208 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.722154 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 17 15:39:03.724174 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.724163 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 17 15:39:03.724211 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.724180 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 17 15:39:03.724211 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.724186 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 17 15:39:03.724211 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.724193 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 17 15:39:03.724211 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.724202 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 17 15:39:03.724211 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.724208 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 17 15:39:03.724350 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.724225 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 17 15:39:03.724350 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.724231 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 17 15:39:03.724350 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.724238 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 17 15:39:03.724350 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.724243 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 17 15:39:03.724350 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.724252 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 17 15:39:03.724350 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.724257 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 17 15:39:03.725129 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.725099 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 17 15:39:03.725169 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.725138 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 17 15:39:03.728165 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:03.728139 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 17 15:39:03.728264 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:03.728178 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-207.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 17 15:39:03.728363 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.728349 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-207.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 17 15:39:03.729560 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.729542 2581 server.go:1268] "Started kubelet" Sep 17 15:39:03.729653 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.729601 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 17 15:39:03.729714 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.729648 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 17 15:39:03.729759 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.729729 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 17 15:39:03.730542 ip-10-0-132-207 systemd[1]: Started Kubernetes Kubelet. Sep 17 15:39:03.732429 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.732413 2581 server.go:310] "Adding debug handlers to kubelet server" Sep 17 15:39:03.732860 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.732842 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hdl9c" Sep 17 15:39:03.733909 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.733892 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 17 15:39:03.734754 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:03.734738 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 17 15:39:03.739833 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.739819 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 17 15:39:03.739978 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:03.739955 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-207.ec2.internal\" not found" Sep 17 15:39:03.740109 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.740064 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 17 15:39:03.740853 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.740808 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 17 15:39:03.740853 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.740827 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 17 15:39:03.740976 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.740922 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 17 15:39:03.741700 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.741030 2581 reconstruct.go:97] "Volume reconstruction finished" Sep 17 15:39:03.741700 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.741044 2581 reconciler.go:29] "Reconciler: start to sync state" Sep 17 15:39:03.742567 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.742540 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hdl9c" Sep 17 15:39:03.743056 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:03.743032 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 17 15:39:03.743056 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:03.743038 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-207.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 17 15:39:03.743719 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.743702 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 17 15:39:03.743719 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.743720 2581 factory.go:55] Registering systemd factory Sep 17 15:39:03.743825 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.743730 2581 factory.go:223] Registration of the systemd container factory successfully Sep 17 15:39:03.743973 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:03.742780 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-207.ec2.internal.18d625df7cdf49e4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-207.ec2.internal,UID:ip-10-0-132-207.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-207.ec2.internal,},FirstTimestamp:2026-09-17 15:39:03.729293796 +0000 UTC m=+0.406035884,LastTimestamp:2026-09-17 15:39:03.729293796 +0000 UTC m=+0.406035884,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-207.ec2.internal,}" Sep 17 15:39:03.744071 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.743979 2581 factory.go:153] Registering CRI-O factory Sep 17 15:39:03.744071 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.743994 2581 factory.go:223] Registration of the crio container factory successfully Sep 17 15:39:03.744071 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.744019 2581 factory.go:103] Registering Raw factory Sep 17 15:39:03.744071 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.744034 2581 manager.go:1196] Started watching for new ooms in manager Sep 17 15:39:03.744418 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.744405 2581 manager.go:349] Starting recovery of all containers Sep 17 15:39:03.755005 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.754988 2581 manager.go:354] Recovery completed Sep 17 15:39:03.759142 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.759110 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 15:39:03.761146 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.761131 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-207.ec2.internal" event="NodeHasSufficientMemory" Sep 17 15:39:03.761206 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.761160 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-207.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 15:39:03.761206 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.761173 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-207.ec2.internal" event="NodeHasSufficientPID" Sep 17 15:39:03.761780 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.761760 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 17 15:39:03.761780 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.761778 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 15:39:03.761911 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.761778 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 17 15:39:03.761911 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.761865 2581 state_mem.go:36] "Initialized new in-memory state store" Sep 17 15:39:03.762502 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.762486 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-207.ec2.internal" event="NodeHasSufficientMemory" Sep 17 15:39:03.762568 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.762518 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-207.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 15:39:03.762568 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.762533 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-207.ec2.internal" event="NodeHasSufficientPID" Sep 17 15:39:03.762963 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.762950 2581 policy_none.go:49] "None policy: Start" Sep 17 15:39:03.763007 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.762966 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 17 15:39:03.763007 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.762976 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 17 15:39:03.763983 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.763972 2581 policy_none.go:47] "Start" Sep 17 15:39:03.807825 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.807802 2581 manager.go:337] "Starting Device Plugin manager" Sep 17 15:39:03.822097 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:03.807862 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 17 15:39:03.822097 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.807876 2581 server.go:87] "Starting device plugin registration server" Sep 17 15:39:03.822097 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.808195 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 17 15:39:03.822097 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.808209 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 17 15:39:03.822097 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.808437 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 17 15:39:03.822097 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.808519 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 17 15:39:03.822097 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.808528 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 17 15:39:03.822097 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:03.809109 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 17 15:39:03.822097 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:03.809170 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-207.ec2.internal\" not found" Sep 17 15:39:03.848836 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.848794 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 17 15:39:03.850141 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.850103 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 17 15:39:03.850214 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.850203 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 17 15:39:03.850261 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.850241 2581 kubelet.go:2448] "Starting kubelet main sync loop" Sep 17 15:39:03.850336 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:03.850288 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 17 15:39:03.852813 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.852790 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 15:39:03.908872 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.908797 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 15:39:03.909827 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.909811 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-207.ec2.internal" event="NodeHasSufficientMemory" Sep 17 15:39:03.909897 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.909843 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-207.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 15:39:03.909897 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.909854 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-207.ec2.internal" event="NodeHasSufficientPID" Sep 17 15:39:03.909897 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.909878 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-207.ec2.internal" Sep 17 15:39:03.919060 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.919039 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-207.ec2.internal" Sep 17 15:39:03.919129 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:03.919067 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-207.ec2.internal\": node \"ip-10-0-132-207.ec2.internal\" not found" Sep 17 15:39:03.937521 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:03.937494 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-207.ec2.internal\" not found" Sep 17 15:39:03.950782 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.950747 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-207.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-207.ec2.internal"] Sep 17 15:39:03.950859 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.950833 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 15:39:03.952303 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.952284 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-207.ec2.internal" event="NodeHasSufficientMemory" Sep 17 15:39:03.952377 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.952317 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-207.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 15:39:03.952377 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.952327 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-207.ec2.internal" event="NodeHasSufficientPID" Sep 17 15:39:03.953609 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.953596 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 15:39:03.953728 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.953716 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-207.ec2.internal" Sep 17 15:39:03.953761 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.953742 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 15:39:03.954329 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.954315 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-207.ec2.internal" event="NodeHasSufficientMemory" Sep 17 15:39:03.954381 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.954335 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-207.ec2.internal" event="NodeHasSufficientMemory" Sep 17 15:39:03.954381 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.954343 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-207.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 15:39:03.954381 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.954358 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-207.ec2.internal" event="NodeHasSufficientPID" Sep 17 15:39:03.954381 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.954361 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-207.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 15:39:03.954495 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.954384 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-207.ec2.internal" event="NodeHasSufficientPID" Sep 17 15:39:03.955552 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.955530 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-207.ec2.internal" Sep 17 15:39:03.955644 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.955561 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 15:39:03.956294 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.956277 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-207.ec2.internal" event="NodeHasSufficientMemory" Sep 17 15:39:03.956349 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.956311 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-207.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 15:39:03.956349 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:03.956335 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-207.ec2.internal" event="NodeHasSufficientPID" Sep 17 15:39:03.983991 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:03.983968 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-207.ec2.internal\" not found" node="ip-10-0-132-207.ec2.internal" Sep 17 15:39:03.988546 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:03.988530 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-207.ec2.internal\" not found" node="ip-10-0-132-207.ec2.internal" Sep 17 15:39:04.038087 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:04.038057 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-207.ec2.internal\" not found" Sep 17 15:39:04.043467 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.043447 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5a6855b9b6b7591a9d6ab8882157cfaa-config\") pod \"kube-apiserver-proxy-ip-10-0-132-207.ec2.internal\" (UID: \"5a6855b9b6b7591a9d6ab8882157cfaa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-207.ec2.internal" Sep 17 15:39:04.043540 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.043476 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2dda5558ac038c7e75d7be72746e233e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-207.ec2.internal\" (UID: \"2dda5558ac038c7e75d7be72746e233e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-207.ec2.internal" Sep 17 15:39:04.043540 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.043493 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2dda5558ac038c7e75d7be72746e233e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-207.ec2.internal\" (UID: \"2dda5558ac038c7e75d7be72746e233e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-207.ec2.internal" Sep 17 15:39:04.138803 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:04.138764 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-207.ec2.internal\" not found" Sep 17 15:39:04.144224 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.144187 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2dda5558ac038c7e75d7be72746e233e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-207.ec2.internal\" (UID: \"2dda5558ac038c7e75d7be72746e233e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-207.ec2.internal" Sep 17 15:39:04.144296 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.144231 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2dda5558ac038c7e75d7be72746e233e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-207.ec2.internal\" (UID: \"2dda5558ac038c7e75d7be72746e233e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-207.ec2.internal" Sep 17 15:39:04.144296 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.144252 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5a6855b9b6b7591a9d6ab8882157cfaa-config\") pod \"kube-apiserver-proxy-ip-10-0-132-207.ec2.internal\" (UID: \"5a6855b9b6b7591a9d6ab8882157cfaa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-207.ec2.internal" Sep 17 15:39:04.144296 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.144282 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5a6855b9b6b7591a9d6ab8882157cfaa-config\") pod \"kube-apiserver-proxy-ip-10-0-132-207.ec2.internal\" (UID: \"5a6855b9b6b7591a9d6ab8882157cfaa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-207.ec2.internal" Sep 17 15:39:04.144397 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.144294 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2dda5558ac038c7e75d7be72746e233e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-207.ec2.internal\" (UID: \"2dda5558ac038c7e75d7be72746e233e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-207.ec2.internal" Sep 17 15:39:04.144397 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.144283 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2dda5558ac038c7e75d7be72746e233e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-207.ec2.internal\" (UID: \"2dda5558ac038c7e75d7be72746e233e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-207.ec2.internal" Sep 17 15:39:04.239685 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:04.239606 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-207.ec2.internal\" not found" Sep 17 15:39:04.286128 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.286086 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-207.ec2.internal" Sep 17 15:39:04.290926 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.290908 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-207.ec2.internal" Sep 17 15:39:04.340605 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:04.340571 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-207.ec2.internal\" not found" Sep 17 15:39:04.441004 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:04.440956 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-207.ec2.internal\" not found" Sep 17 15:39:04.541495 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:04.541412 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-207.ec2.internal\" not found" Sep 17 15:39:04.583236 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.583210 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 15:39:04.641646 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:04.641609 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-207.ec2.internal\" not found" Sep 17 15:39:04.667697 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.667673 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 17 15:39:04.668102 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.667780 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 15:39:04.668102 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.667829 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 15:39:04.668272 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.668256 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 15:39:04.717385 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.717360 2581 apiserver.go:52] "Watching apiserver" Sep 17 15:39:04.729014 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.728982 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 17 15:39:04.729968 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.729940 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-hrgrs","openshift-multus/network-metrics-daemon-fjm5t","openshift-network-diagnostics/network-check-target-kcjnr","openshift-ovn-kubernetes/ovnkube-node-rvbm6","kube-system/global-pull-secret-syncer-jtwf7","kube-system/konnectivity-agent-qb2qz","openshift-image-registry/node-ca-6gbcs","openshift-multus/multus-additional-cni-plugins-dzqxm","openshift-multus/multus-rfcds","openshift-network-operator/iptables-alerter-qnbfv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nf6r","openshift-cluster-node-tuning-operator/tuned-kv96r"] Sep 17 15:39:04.732037 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.732014 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hrgrs" Sep 17 15:39:04.733697 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.733676 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjm5t" Sep 17 15:39:04.733799 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:04.733748 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fjm5t" podUID="87031c7d-d4f1-4a4b-8691-e93c3698118a" Sep 17 15:39:04.734252 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.734227 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 17 15:39:04.734340 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.734227 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 17 15:39:04.734340 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.734281 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mmv47\"" Sep 17 15:39:04.735325 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.735308 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcjnr" Sep 17 15:39:04.735440 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:04.735363 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kcjnr" podUID="75d806d9-420d-4e93-bb55-a30b25dcd5b9" Sep 17 15:39:04.737233 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.737213 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.739216 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.739194 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtwf7" Sep 17 15:39:04.739314 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:04.739267 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtwf7" podUID="6841aae3-9f3e-439b-bc41-685e1c15baef" Sep 17 15:39:04.739568 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.739541 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 17 15:39:04.739568 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.739564 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 17 15:39:04.739732 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.739580 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 17 15:39:04.739732 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.739595 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 17 15:39:04.739732 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.739615 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 17 15:39:04.739732 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.739563 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 17 15:39:04.739732 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.739686 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9gw5b\"" Sep 17 15:39:04.740336 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.740321 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-207.ec2.internal" Sep 17 15:39:04.740336 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.740331 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 17 15:39:04.741406 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.741387 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qb2qz" Sep 17 15:39:04.743345 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.743327 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qvsdv\"" Sep 17 15:39:04.743454 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.743419 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 17 15:39:04.743454 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.743419 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6gbcs" Sep 17 15:39:04.743556 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.743456 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 17 15:39:04.745514 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.745493 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dzqxm" Sep 17 15:39:04.745660 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.745641 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 17 15:39:04.746081 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.746055 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 17 15:39:04.746224 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.746158 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 17 15:39:04.746224 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.746208 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5pl2q\"" Sep 17 15:39:04.747193 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.747174 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf5gb\" (UniqueName: \"kubernetes.io/projected/87031c7d-d4f1-4a4b-8691-e93c3698118a-kube-api-access-rf5gb\") pod \"network-metrics-daemon-fjm5t\" (UID: \"87031c7d-d4f1-4a4b-8691-e93c3698118a\") " pod="openshift-multus/network-metrics-daemon-fjm5t" Sep 17 15:39:04.747277 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.747200 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-host-kubelet\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.747277 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.747214 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-run-ovn\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.747277 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.747267 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-host-run-netns\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.747408 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.747294 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9eb875df-5cc6-40f5-978e-f0adf0b823d5-env-overrides\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.747408 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.747316 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5j5v\" (UniqueName: \"kubernetes.io/projected/9eb875df-5cc6-40f5-978e-f0adf0b823d5-kube-api-access-v5j5v\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.747408 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.747350 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6841aae3-9f3e-439b-bc41-685e1c15baef-original-pull-secret\") pod \"global-pull-secret-syncer-jtwf7\" (UID: \"6841aae3-9f3e-439b-bc41-685e1c15baef\") " pod="kube-system/global-pull-secret-syncer-jtwf7" Sep 17 15:39:04.747408 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.747374 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-run-openvswitch\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.747540 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.747421 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-host-run-ovn-kubernetes\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.747540 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.747449 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-host-cni-netd\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.747540 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.747482 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.747540 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.747508 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6841aae3-9f3e-439b-bc41-685e1c15baef-dbus\") pod \"global-pull-secret-syncer-jtwf7\" (UID: \"6841aae3-9f3e-439b-bc41-685e1c15baef\") " pod="kube-system/global-pull-secret-syncer-jtwf7" Sep 17 15:39:04.747674 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.747547 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-node-log\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.747674 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.747521 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 15:34:05 +0000 UTC" deadline="2028-06-14 00:46:02.597576748 +0000 UTC" Sep 17 15:39:04.747674 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.747568 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15249h6m57.850012551s" Sep 17 15:39:04.747674 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.747585 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-host-cni-bin\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.747674 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.747605 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9eb875df-5cc6-40f5-978e-f0adf0b823d5-ovnkube-config\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.747674 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.747648 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9eb875df-5cc6-40f5-978e-f0adf0b823d5-ovn-node-metrics-cert\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.747937 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.747674 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-run-systemd\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.747937 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.747698 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1683b9c0-ac32-4cb2-a099-ce62182f0bce-tmp-dir\") pod \"node-resolver-hrgrs\" (UID: \"1683b9c0-ac32-4cb2-a099-ce62182f0bce\") " pod="openshift-dns/node-resolver-hrgrs" Sep 17 15:39:04.747937 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.747739 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qv2b\" (UniqueName: \"kubernetes.io/projected/75d806d9-420d-4e93-bb55-a30b25dcd5b9-kube-api-access-9qv2b\") pod \"network-check-target-kcjnr\" (UID: \"75d806d9-420d-4e93-bb55-a30b25dcd5b9\") " pod="openshift-network-diagnostics/network-check-target-kcjnr" Sep 17 15:39:04.747937 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.747773 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-etc-openvswitch\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.747937 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.747791 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 17 15:39:04.747937 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.747801 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6841aae3-9f3e-439b-bc41-685e1c15baef-kubelet-config\") pod \"global-pull-secret-syncer-jtwf7\" (UID: \"6841aae3-9f3e-439b-bc41-685e1c15baef\") " pod="kube-system/global-pull-secret-syncer-jtwf7" Sep 17 15:39:04.747937 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.747825 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-var-lib-openvswitch\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.747937 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.747867 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjxrp\" (UniqueName: \"kubernetes.io/projected/1683b9c0-ac32-4cb2-a099-ce62182f0bce-kube-api-access-rjxrp\") pod \"node-resolver-hrgrs\" (UID: \"1683b9c0-ac32-4cb2-a099-ce62182f0bce\") " pod="openshift-dns/node-resolver-hrgrs" Sep 17 15:39:04.747937 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.747890 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-systemd-units\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.747937 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.747915 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-log-socket\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.747937 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.747939 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/46f93a66-b09c-41ef-8156-73ebc20ab303-agent-certs\") pod \"konnectivity-agent-qb2qz\" (UID: \"46f93a66-b09c-41ef-8156-73ebc20ab303\") " pod="kube-system/konnectivity-agent-qb2qz" Sep 17 15:39:04.748458 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.747953 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 17 15:39:04.748458 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.747962 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/46f93a66-b09c-41ef-8156-73ebc20ab303-konnectivity-ca\") pod \"konnectivity-agent-qb2qz\" (UID: \"46f93a66-b09c-41ef-8156-73ebc20ab303\") " pod="kube-system/konnectivity-agent-qb2qz" Sep 17 15:39:04.748458 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.748000 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9eb875df-5cc6-40f5-978e-f0adf0b823d5-ovnkube-script-lib\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.748458 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.748101 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1683b9c0-ac32-4cb2-a099-ce62182f0bce-hosts-file\") pod \"node-resolver-hrgrs\" (UID: \"1683b9c0-ac32-4cb2-a099-ce62182f0bce\") " pod="openshift-dns/node-resolver-hrgrs" Sep 17 15:39:04.748458 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.748150 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 17 15:39:04.748458 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.748151 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87031c7d-d4f1-4a4b-8691-e93c3698118a-metrics-certs\") pod \"network-metrics-daemon-fjm5t\" (UID: \"87031c7d-d4f1-4a4b-8691-e93c3698118a\") " pod="openshift-multus/network-metrics-daemon-fjm5t" Sep 17 15:39:04.748458 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.748192 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-host-slash\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.748458 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.748225 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-q8wkw\"" Sep 17 15:39:04.748458 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.748289 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 17 15:39:04.748458 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.748337 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 17 15:39:04.748458 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.748442 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.750841 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.750813 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qnbfv" Sep 17 15:39:04.751537 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.751364 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 17 15:39:04.751537 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.751401 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jwjxk\"" Sep 17 15:39:04.752000 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.751977 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 15:39:04.753035 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.753015 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nf6r" Sep 17 15:39:04.753196 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.753089 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 15:39:04.753288 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.753198 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 17 15:39:04.753288 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.753208 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-207.ec2.internal" Sep 17 15:39:04.753476 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.753200 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qwmpb\"" Sep 17 15:39:04.753556 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.753536 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 17 15:39:04.753638 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.753612 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 17 15:39:04.757559 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.755602 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-207.ec2.internal"] Sep 17 15:39:04.757559 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.755739 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 17 15:39:04.757559 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.755852 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.757559 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.756055 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 17 15:39:04.757559 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.756103 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 17 15:39:04.757559 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.756351 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4fplc\"" Sep 17 15:39:04.758294 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.758276 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 17 15:39:04.758347 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.758324 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lkc9v\"" Sep 17 15:39:04.758347 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.758340 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 17 15:39:04.762435 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.762422 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-207.ec2.internal"] Sep 17 15:39:04.762529 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.762516 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 15:39:04.775716 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.775699 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gnhcl" Sep 17 15:39:04.785768 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.785751 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gnhcl" Sep 17 15:39:04.841986 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.841962 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 17 15:39:04.849360 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.849337 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-var-lib-openvswitch\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.849496 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.849372 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fde60d54-dbed-4e5e-8103-4809b3074a8c-cni-binary-copy\") pod \"multus-additional-cni-plugins-dzqxm\" (UID: \"fde60d54-dbed-4e5e-8103-4809b3074a8c\") " pod="openshift-multus/multus-additional-cni-plugins-dzqxm" Sep 17 15:39:04.849496 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.849397 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8cc3d9c6-6452-4825-9708-86a460186487-var-lib-kubelet\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.849496 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.849420 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fde60d54-dbed-4e5e-8103-4809b3074a8c-cnibin\") pod \"multus-additional-cni-plugins-dzqxm\" (UID: \"fde60d54-dbed-4e5e-8103-4809b3074a8c\") " pod="openshift-multus/multus-additional-cni-plugins-dzqxm" Sep 17 15:39:04.849496 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.849445 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-var-lib-openvswitch\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.849496 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.849443 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjxrp\" (UniqueName: \"kubernetes.io/projected/1683b9c0-ac32-4cb2-a099-ce62182f0bce-kube-api-access-rjxrp\") pod \"node-resolver-hrgrs\" (UID: \"1683b9c0-ac32-4cb2-a099-ce62182f0bce\") " pod="openshift-dns/node-resolver-hrgrs" Sep 17 15:39:04.849752 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.849503 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-systemd-units\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.849752 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.849527 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-log-socket\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.849752 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.849545 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-systemd-units\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.849752 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.849554 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-multus-socket-dir-parent\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.849752 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.849583 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-log-socket\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.849752 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.849583 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fde60d54-dbed-4e5e-8103-4809b3074a8c-system-cni-dir\") pod \"multus-additional-cni-plugins-dzqxm\" (UID: \"fde60d54-dbed-4e5e-8103-4809b3074a8c\") " pod="openshift-multus/multus-additional-cni-plugins-dzqxm" Sep 17 15:39:04.849752 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.849640 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9stp\" (UniqueName: \"kubernetes.io/projected/818bcff9-462b-4695-b59e-4585c9597a23-kube-api-access-n9stp\") pod \"iptables-alerter-qnbfv\" (UID: \"818bcff9-462b-4695-b59e-4585c9597a23\") " pod="openshift-network-operator/iptables-alerter-qnbfv" Sep 17 15:39:04.849752 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.849665 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8cc3d9c6-6452-4825-9708-86a460186487-run\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.849752 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.849690 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9eb875df-5cc6-40f5-978e-f0adf0b823d5-ovnkube-script-lib\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.849752 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.849715 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1683b9c0-ac32-4cb2-a099-ce62182f0bce-hosts-file\") pod \"node-resolver-hrgrs\" (UID: \"1683b9c0-ac32-4cb2-a099-ce62182f0bce\") " pod="openshift-dns/node-resolver-hrgrs" Sep 17 15:39:04.849752 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.849738 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-host-slash\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.849752 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.849760 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a7107e67-41ae-412b-851e-0b4c830adfd0-host\") pod \"node-ca-6gbcs\" (UID: \"a7107e67-41ae-412b-851e-0b4c830adfd0\") " pod="openshift-image-registry/node-ca-6gbcs" Sep 17 15:39:04.850252 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.849785 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-run-ovn\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.850252 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.849810 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-host-slash\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.850252 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.849810 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-multus-conf-dir\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.850252 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.849869 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dbded374-06d6-4f90-b242-6b4f51e3ae11-multus-daemon-config\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.850252 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.849875 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1683b9c0-ac32-4cb2-a099-ce62182f0bce-hosts-file\") pod \"node-resolver-hrgrs\" (UID: \"1683b9c0-ac32-4cb2-a099-ce62182f0bce\") " pod="openshift-dns/node-resolver-hrgrs" Sep 17 15:39:04.850252 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.849892 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-run-ovn\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.850252 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.849904 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fde60d54-dbed-4e5e-8103-4809b3074a8c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dzqxm\" (UID: \"fde60d54-dbed-4e5e-8103-4809b3074a8c\") " pod="openshift-multus/multus-additional-cni-plugins-dzqxm" Sep 17 15:39:04.850252 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.849924 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj5wd\" (UniqueName: \"kubernetes.io/projected/fde60d54-dbed-4e5e-8103-4809b3074a8c-kube-api-access-hj5wd\") pod \"multus-additional-cni-plugins-dzqxm\" (UID: \"fde60d54-dbed-4e5e-8103-4809b3074a8c\") " pod="openshift-multus/multus-additional-cni-plugins-dzqxm" Sep 17 15:39:04.850252 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.849943 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8cc3d9c6-6452-4825-9708-86a460186487-etc-sysconfig\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.850252 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.849968 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8cc3d9c6-6452-4825-9708-86a460186487-sys\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.850252 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850000 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6841aae3-9f3e-439b-bc41-685e1c15baef-original-pull-secret\") pod \"global-pull-secret-syncer-jtwf7\" (UID: \"6841aae3-9f3e-439b-bc41-685e1c15baef\") " pod="kube-system/global-pull-secret-syncer-jtwf7" Sep 17 15:39:04.850252 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850016 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48dhl\" (UniqueName: \"kubernetes.io/projected/a7107e67-41ae-412b-851e-0b4c830adfd0-kube-api-access-48dhl\") pod \"node-ca-6gbcs\" (UID: \"a7107e67-41ae-412b-851e-0b4c830adfd0\") " pod="openshift-image-registry/node-ca-6gbcs" Sep 17 15:39:04.850252 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850031 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-system-cni-dir\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.850252 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850045 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-multus-cni-dir\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.850252 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850077 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-run-openvswitch\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.850252 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:04.850110 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 15:39:04.850252 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850145 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-host-run-ovn-kubernetes\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.850948 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850150 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-run-openvswitch\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.850948 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:04.850208 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6841aae3-9f3e-439b-bc41-685e1c15baef-original-pull-secret podName:6841aae3-9f3e-439b-bc41-685e1c15baef nodeName:}" failed. No retries permitted until 2026-09-17 15:39:05.350193266 +0000 UTC m=+2.026935186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6841aae3-9f3e-439b-bc41-685e1c15baef-original-pull-secret") pod "global-pull-secret-syncer-jtwf7" (UID: "6841aae3-9f3e-439b-bc41-685e1c15baef") : object "kube-system"/"original-pull-secret" not registered Sep 17 15:39:04.850948 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850212 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9eb875df-5cc6-40f5-978e-f0adf0b823d5-ovnkube-script-lib\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.850948 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850233 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-host-run-ovn-kubernetes\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.850948 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850222 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6841aae3-9f3e-439b-bc41-685e1c15baef-dbus\") pod \"global-pull-secret-syncer-jtwf7\" (UID: \"6841aae3-9f3e-439b-bc41-685e1c15baef\") " pod="kube-system/global-pull-secret-syncer-jtwf7" Sep 17 15:39:04.850948 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850286 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-host-var-lib-cni-bin\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.850948 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850322 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fde60d54-dbed-4e5e-8103-4809b3074a8c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dzqxm\" (UID: \"fde60d54-dbed-4e5e-8103-4809b3074a8c\") " pod="openshift-multus/multus-additional-cni-plugins-dzqxm" Sep 17 15:39:04.850948 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850345 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bb46c9f5-faf6-4564-be34-2923e2a5e5b1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9nf6r\" (UID: \"bb46c9f5-faf6-4564-be34-2923e2a5e5b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nf6r" Sep 17 15:39:04.850948 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850368 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9eb875df-5cc6-40f5-978e-f0adf0b823d5-ovnkube-config\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.850948 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850389 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9eb875df-5cc6-40f5-978e-f0adf0b823d5-ovn-node-metrics-cert\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.850948 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850409 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-run-systemd\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.850948 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850445 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dbded374-06d6-4f90-b242-6b4f51e3ae11-cni-binary-copy\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.850948 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850458 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6841aae3-9f3e-439b-bc41-685e1c15baef-dbus\") pod \"global-pull-secret-syncer-jtwf7\" (UID: \"6841aae3-9f3e-439b-bc41-685e1c15baef\") " pod="kube-system/global-pull-secret-syncer-jtwf7" Sep 17 15:39:04.850948 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850464 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-run-systemd\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.850948 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850484 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-host-run-k8s-cni-cncf-io\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.850948 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850508 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-host-var-lib-cni-multus\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.851629 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850524 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-etc-kubernetes\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.851629 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850537 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bb46c9f5-faf6-4564-be34-2923e2a5e5b1-socket-dir\") pod \"aws-ebs-csi-driver-node-9nf6r\" (UID: \"bb46c9f5-faf6-4564-be34-2923e2a5e5b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nf6r" Sep 17 15:39:04.851629 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850569 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fde60d54-dbed-4e5e-8103-4809b3074a8c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dzqxm\" (UID: \"fde60d54-dbed-4e5e-8103-4809b3074a8c\") " pod="openshift-multus/multus-additional-cni-plugins-dzqxm" Sep 17 15:39:04.851629 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850603 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/818bcff9-462b-4695-b59e-4585c9597a23-iptables-alerter-script\") pod \"iptables-alerter-qnbfv\" (UID: \"818bcff9-462b-4695-b59e-4585c9597a23\") " pod="openshift-network-operator/iptables-alerter-qnbfv" Sep 17 15:39:04.851629 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850638 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bb46c9f5-faf6-4564-be34-2923e2a5e5b1-sys-fs\") pod \"aws-ebs-csi-driver-node-9nf6r\" (UID: \"bb46c9f5-faf6-4564-be34-2923e2a5e5b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nf6r" Sep 17 15:39:04.851629 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850669 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8cc3d9c6-6452-4825-9708-86a460186487-lib-modules\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.851629 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850691 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8cc3d9c6-6452-4825-9708-86a460186487-etc-tuned\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.851629 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850709 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 17 15:39:04.851629 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850719 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/46f93a66-b09c-41ef-8156-73ebc20ab303-agent-certs\") pod \"konnectivity-agent-qb2qz\" (UID: \"46f93a66-b09c-41ef-8156-73ebc20ab303\") " pod="kube-system/konnectivity-agent-qb2qz" Sep 17 15:39:04.851629 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850743 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/46f93a66-b09c-41ef-8156-73ebc20ab303-konnectivity-ca\") pod \"konnectivity-agent-qb2qz\" (UID: \"46f93a66-b09c-41ef-8156-73ebc20ab303\") " pod="kube-system/konnectivity-agent-qb2qz" Sep 17 15:39:04.851629 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850767 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a7107e67-41ae-412b-851e-0b4c830adfd0-serviceca\") pod \"node-ca-6gbcs\" (UID: \"a7107e67-41ae-412b-851e-0b4c830adfd0\") " pod="openshift-image-registry/node-ca-6gbcs" Sep 17 15:39:04.851629 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850808 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-cnibin\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.851629 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850831 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/818bcff9-462b-4695-b59e-4585c9597a23-host-slash\") pod \"iptables-alerter-qnbfv\" (UID: \"818bcff9-462b-4695-b59e-4585c9597a23\") " pod="openshift-network-operator/iptables-alerter-qnbfv" Sep 17 15:39:04.851629 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850855 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bb46c9f5-faf6-4564-be34-2923e2a5e5b1-registration-dir\") pod \"aws-ebs-csi-driver-node-9nf6r\" (UID: \"bb46c9f5-faf6-4564-be34-2923e2a5e5b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nf6r" Sep 17 15:39:04.851629 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850891 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8cc3d9c6-6452-4825-9708-86a460186487-etc-systemd\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.851629 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850917 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9eb875df-5cc6-40f5-978e-f0adf0b823d5-ovnkube-config\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.851629 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850941 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5z7m\" (UniqueName: \"kubernetes.io/projected/8cc3d9c6-6452-4825-9708-86a460186487-kube-api-access-z5z7m\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.852573 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850969 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87031c7d-d4f1-4a4b-8691-e93c3698118a-metrics-certs\") pod \"network-metrics-daemon-fjm5t\" (UID: \"87031c7d-d4f1-4a4b-8691-e93c3698118a\") " pod="openshift-multus/network-metrics-daemon-fjm5t" Sep 17 15:39:04.852573 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850984 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-host-var-lib-kubelet\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.852573 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.850999 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8cc3d9c6-6452-4825-9708-86a460186487-host\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.852573 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.851024 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf5gb\" (UniqueName: \"kubernetes.io/projected/87031c7d-d4f1-4a4b-8691-e93c3698118a-kube-api-access-rf5gb\") pod \"network-metrics-daemon-fjm5t\" (UID: \"87031c7d-d4f1-4a4b-8691-e93c3698118a\") " pod="openshift-multus/network-metrics-daemon-fjm5t" Sep 17 15:39:04.852573 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.851061 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-host-kubelet\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.852573 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.851087 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-host-run-netns\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.852573 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.851101 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-host-kubelet\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.852573 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:04.851063 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 15:39:04.852573 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.851139 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9eb875df-5cc6-40f5-978e-f0adf0b823d5-env-overrides\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.852573 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.851165 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5j5v\" (UniqueName: \"kubernetes.io/projected/9eb875df-5cc6-40f5-978e-f0adf0b823d5-kube-api-access-v5j5v\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.852573 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.851165 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-host-run-netns\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.852573 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:04.851181 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87031c7d-d4f1-4a4b-8691-e93c3698118a-metrics-certs podName:87031c7d-d4f1-4a4b-8691-e93c3698118a nodeName:}" failed. No retries permitted until 2026-09-17 15:39:05.351164127 +0000 UTC m=+2.027906039 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87031c7d-d4f1-4a4b-8691-e93c3698118a-metrics-certs") pod "network-metrics-daemon-fjm5t" (UID: "87031c7d-d4f1-4a4b-8691-e93c3698118a") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 15:39:04.852573 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.851215 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8cc3d9c6-6452-4825-9708-86a460186487-etc-sysctl-conf\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.852573 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.851245 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-host-cni-netd\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.852573 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.851271 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.852573 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.851283 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/46f93a66-b09c-41ef-8156-73ebc20ab303-konnectivity-ca\") pod \"konnectivity-agent-qb2qz\" (UID: \"46f93a66-b09c-41ef-8156-73ebc20ab303\") " pod="kube-system/konnectivity-agent-qb2qz" Sep 17 15:39:04.852573 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.851297 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-host-run-netns\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.853484 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.851305 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-host-cni-netd\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.853484 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.851319 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-hostroot\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.853484 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.851339 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bb46c9f5-faf6-4564-be34-2923e2a5e5b1-device-dir\") pod \"aws-ebs-csi-driver-node-9nf6r\" (UID: \"bb46c9f5-faf6-4564-be34-2923e2a5e5b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nf6r" Sep 17 15:39:04.853484 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.851361 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8cc3d9c6-6452-4825-9708-86a460186487-etc-modprobe-d\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.853484 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.851351 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.853484 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.851403 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cc3d9c6-6452-4825-9708-86a460186487-etc-kubernetes\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.853484 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.851438 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8cc3d9c6-6452-4825-9708-86a460186487-tmp\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.853484 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.851465 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-node-log\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.853484 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.851489 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-host-cni-bin\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.853484 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.851545 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-host-cni-bin\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.853484 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.851560 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-node-log\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.853484 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.851578 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9eb875df-5cc6-40f5-978e-f0adf0b823d5-env-overrides\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.853484 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.851580 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1683b9c0-ac32-4cb2-a099-ce62182f0bce-tmp-dir\") pod \"node-resolver-hrgrs\" (UID: \"1683b9c0-ac32-4cb2-a099-ce62182f0bce\") " pod="openshift-dns/node-resolver-hrgrs" Sep 17 15:39:04.853484 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.851627 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qv2b\" (UniqueName: \"kubernetes.io/projected/75d806d9-420d-4e93-bb55-a30b25dcd5b9-kube-api-access-9qv2b\") pod \"network-check-target-kcjnr\" (UID: \"75d806d9-420d-4e93-bb55-a30b25dcd5b9\") " pod="openshift-network-diagnostics/network-check-target-kcjnr" Sep 17 15:39:04.853484 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.851642 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-etc-openvswitch\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.853484 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.851659 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-host-run-multus-certs\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.853484 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.851683 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bb46c9f5-faf6-4564-be34-2923e2a5e5b1-etc-selinux\") pod \"aws-ebs-csi-driver-node-9nf6r\" (UID: \"bb46c9f5-faf6-4564-be34-2923e2a5e5b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nf6r" Sep 17 15:39:04.854145 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.851783 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9eb875df-5cc6-40f5-978e-f0adf0b823d5-etc-openvswitch\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.854145 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.851825 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1683b9c0-ac32-4cb2-a099-ce62182f0bce-tmp-dir\") pod \"node-resolver-hrgrs\" (UID: \"1683b9c0-ac32-4cb2-a099-ce62182f0bce\") " pod="openshift-dns/node-resolver-hrgrs" Sep 17 15:39:04.854145 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.851831 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6841aae3-9f3e-439b-bc41-685e1c15baef-kubelet-config\") pod \"global-pull-secret-syncer-jtwf7\" (UID: \"6841aae3-9f3e-439b-bc41-685e1c15baef\") " pod="kube-system/global-pull-secret-syncer-jtwf7" Sep 17 15:39:04.854145 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.851858 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddzs6\" (UniqueName: \"kubernetes.io/projected/dbded374-06d6-4f90-b242-6b4f51e3ae11-kube-api-access-ddzs6\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.854145 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.851886 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6sgg\" (UniqueName: \"kubernetes.io/projected/bb46c9f5-faf6-4564-be34-2923e2a5e5b1-kube-api-access-g6sgg\") pod \"aws-ebs-csi-driver-node-9nf6r\" (UID: \"bb46c9f5-faf6-4564-be34-2923e2a5e5b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nf6r" Sep 17 15:39:04.854145 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.851895 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6841aae3-9f3e-439b-bc41-685e1c15baef-kubelet-config\") pod \"global-pull-secret-syncer-jtwf7\" (UID: \"6841aae3-9f3e-439b-bc41-685e1c15baef\") " pod="kube-system/global-pull-secret-syncer-jtwf7" Sep 17 15:39:04.854145 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.851910 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8cc3d9c6-6452-4825-9708-86a460186487-etc-sysctl-d\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.854346 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.854171 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9eb875df-5cc6-40f5-978e-f0adf0b823d5-ovn-node-metrics-cert\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.854346 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.854242 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/46f93a66-b09c-41ef-8156-73ebc20ab303-agent-certs\") pod \"konnectivity-agent-qb2qz\" (UID: \"46f93a66-b09c-41ef-8156-73ebc20ab303\") " pod="kube-system/konnectivity-agent-qb2qz" Sep 17 15:39:04.860059 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:04.860036 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 15:39:04.860059 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:04.860061 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 15:39:04.860216 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:04.860076 2581 projected.go:196] Error preparing data for projected volume kube-api-access-9qv2b for pod openshift-network-diagnostics/network-check-target-kcjnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 15:39:04.860216 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:04.860161 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75d806d9-420d-4e93-bb55-a30b25dcd5b9-kube-api-access-9qv2b podName:75d806d9-420d-4e93-bb55-a30b25dcd5b9 nodeName:}" failed. No retries permitted until 2026-09-17 15:39:05.360140964 +0000 UTC m=+2.036882871 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9qv2b" (UniqueName: "kubernetes.io/projected/75d806d9-420d-4e93-bb55-a30b25dcd5b9-kube-api-access-9qv2b") pod "network-check-target-kcjnr" (UID: "75d806d9-420d-4e93-bb55-a30b25dcd5b9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 15:39:04.861014 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.860995 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjxrp\" (UniqueName: \"kubernetes.io/projected/1683b9c0-ac32-4cb2-a099-ce62182f0bce-kube-api-access-rjxrp\") pod \"node-resolver-hrgrs\" (UID: \"1683b9c0-ac32-4cb2-a099-ce62182f0bce\") " pod="openshift-dns/node-resolver-hrgrs" Sep 17 15:39:04.861385 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.861368 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf5gb\" (UniqueName: \"kubernetes.io/projected/87031c7d-d4f1-4a4b-8691-e93c3698118a-kube-api-access-rf5gb\") pod \"network-metrics-daemon-fjm5t\" (UID: \"87031c7d-d4f1-4a4b-8691-e93c3698118a\") " pod="openshift-multus/network-metrics-daemon-fjm5t" Sep 17 15:39:04.862302 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.862286 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5j5v\" (UniqueName: \"kubernetes.io/projected/9eb875df-5cc6-40f5-978e-f0adf0b823d5-kube-api-access-v5j5v\") pod \"ovnkube-node-rvbm6\" (UID: \"9eb875df-5cc6-40f5-978e-f0adf0b823d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:04.887313 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:04.887271 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a6855b9b6b7591a9d6ab8882157cfaa.slice/crio-e2be33a65541f66c1be22b569b869afa79fa506d242fc4d6f60491f1b1c9894c WatchSource:0}: Error finding container e2be33a65541f66c1be22b569b869afa79fa506d242fc4d6f60491f1b1c9894c: Status 404 returned error can't find the container with id e2be33a65541f66c1be22b569b869afa79fa506d242fc4d6f60491f1b1c9894c Sep 17 15:39:04.887518 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:04.887499 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dda5558ac038c7e75d7be72746e233e.slice/crio-ac9aee5f270c6bfa4da11407772ed3df38bd5dae9a7faddb33b4c425510e397b WatchSource:0}: Error finding container ac9aee5f270c6bfa4da11407772ed3df38bd5dae9a7faddb33b4c425510e397b: Status 404 returned error can't find the container with id ac9aee5f270c6bfa4da11407772ed3df38bd5dae9a7faddb33b4c425510e397b Sep 17 15:39:04.894626 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.894325 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 15:39:04.953089 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953051 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddzs6\" (UniqueName: \"kubernetes.io/projected/dbded374-06d6-4f90-b242-6b4f51e3ae11-kube-api-access-ddzs6\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.953089 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953090 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6sgg\" (UniqueName: \"kubernetes.io/projected/bb46c9f5-faf6-4564-be34-2923e2a5e5b1-kube-api-access-g6sgg\") pod \"aws-ebs-csi-driver-node-9nf6r\" (UID: \"bb46c9f5-faf6-4564-be34-2923e2a5e5b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nf6r" Sep 17 15:39:04.953359 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953134 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8cc3d9c6-6452-4825-9708-86a460186487-etc-sysctl-d\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.953359 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953160 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fde60d54-dbed-4e5e-8103-4809b3074a8c-cni-binary-copy\") pod \"multus-additional-cni-plugins-dzqxm\" (UID: \"fde60d54-dbed-4e5e-8103-4809b3074a8c\") " pod="openshift-multus/multus-additional-cni-plugins-dzqxm" Sep 17 15:39:04.953359 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953180 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8cc3d9c6-6452-4825-9708-86a460186487-var-lib-kubelet\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.953359 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953201 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fde60d54-dbed-4e5e-8103-4809b3074a8c-cnibin\") pod \"multus-additional-cni-plugins-dzqxm\" (UID: \"fde60d54-dbed-4e5e-8103-4809b3074a8c\") " pod="openshift-multus/multus-additional-cni-plugins-dzqxm" Sep 17 15:39:04.953359 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953225 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-multus-socket-dir-parent\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.953359 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953249 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fde60d54-dbed-4e5e-8103-4809b3074a8c-system-cni-dir\") pod \"multus-additional-cni-plugins-dzqxm\" (UID: \"fde60d54-dbed-4e5e-8103-4809b3074a8c\") " pod="openshift-multus/multus-additional-cni-plugins-dzqxm" Sep 17 15:39:04.953359 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953292 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9stp\" (UniqueName: \"kubernetes.io/projected/818bcff9-462b-4695-b59e-4585c9597a23-kube-api-access-n9stp\") pod \"iptables-alerter-qnbfv\" (UID: \"818bcff9-462b-4695-b59e-4585c9597a23\") " pod="openshift-network-operator/iptables-alerter-qnbfv" Sep 17 15:39:04.953359 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953310 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fde60d54-dbed-4e5e-8103-4809b3074a8c-cnibin\") pod \"multus-additional-cni-plugins-dzqxm\" (UID: \"fde60d54-dbed-4e5e-8103-4809b3074a8c\") " pod="openshift-multus/multus-additional-cni-plugins-dzqxm" Sep 17 15:39:04.953359 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953327 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-multus-socket-dir-parent\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.953359 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953319 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8cc3d9c6-6452-4825-9708-86a460186487-run\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.953359 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953354 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fde60d54-dbed-4e5e-8103-4809b3074a8c-system-cni-dir\") pod \"multus-additional-cni-plugins-dzqxm\" (UID: \"fde60d54-dbed-4e5e-8103-4809b3074a8c\") " pod="openshift-multus/multus-additional-cni-plugins-dzqxm" Sep 17 15:39:04.953764 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953369 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8cc3d9c6-6452-4825-9708-86a460186487-run\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.953764 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953371 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8cc3d9c6-6452-4825-9708-86a460186487-etc-sysctl-d\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.953764 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953385 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a7107e67-41ae-412b-851e-0b4c830adfd0-host\") pod \"node-ca-6gbcs\" (UID: \"a7107e67-41ae-412b-851e-0b4c830adfd0\") " pod="openshift-image-registry/node-ca-6gbcs" Sep 17 15:39:04.953764 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953310 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8cc3d9c6-6452-4825-9708-86a460186487-var-lib-kubelet\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.953764 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953423 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-multus-conf-dir\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.953764 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953452 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dbded374-06d6-4f90-b242-6b4f51e3ae11-multus-daemon-config\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.953764 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953464 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a7107e67-41ae-412b-851e-0b4c830adfd0-host\") pod \"node-ca-6gbcs\" (UID: \"a7107e67-41ae-412b-851e-0b4c830adfd0\") " pod="openshift-image-registry/node-ca-6gbcs" Sep 17 15:39:04.953764 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953474 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-multus-conf-dir\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.953764 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953478 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fde60d54-dbed-4e5e-8103-4809b3074a8c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dzqxm\" (UID: \"fde60d54-dbed-4e5e-8103-4809b3074a8c\") " pod="openshift-multus/multus-additional-cni-plugins-dzqxm" Sep 17 15:39:04.953764 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953621 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj5wd\" (UniqueName: \"kubernetes.io/projected/fde60d54-dbed-4e5e-8103-4809b3074a8c-kube-api-access-hj5wd\") pod \"multus-additional-cni-plugins-dzqxm\" (UID: \"fde60d54-dbed-4e5e-8103-4809b3074a8c\") " pod="openshift-multus/multus-additional-cni-plugins-dzqxm" Sep 17 15:39:04.953764 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953653 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8cc3d9c6-6452-4825-9708-86a460186487-etc-sysconfig\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.953764 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953677 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8cc3d9c6-6452-4825-9708-86a460186487-sys\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.953764 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953715 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48dhl\" (UniqueName: \"kubernetes.io/projected/a7107e67-41ae-412b-851e-0b4c830adfd0-kube-api-access-48dhl\") pod \"node-ca-6gbcs\" (UID: \"a7107e67-41ae-412b-851e-0b4c830adfd0\") " pod="openshift-image-registry/node-ca-6gbcs" Sep 17 15:39:04.953764 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953738 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-system-cni-dir\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.953764 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953750 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8cc3d9c6-6452-4825-9708-86a460186487-etc-sysconfig\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.953764 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953760 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-multus-cni-dir\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.953764 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953773 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8cc3d9c6-6452-4825-9708-86a460186487-sys\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.954605 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953801 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-host-var-lib-cni-bin\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.954605 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953817 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-multus-cni-dir\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.954605 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953827 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fde60d54-dbed-4e5e-8103-4809b3074a8c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dzqxm\" (UID: \"fde60d54-dbed-4e5e-8103-4809b3074a8c\") " pod="openshift-multus/multus-additional-cni-plugins-dzqxm" Sep 17 15:39:04.954605 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953829 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fde60d54-dbed-4e5e-8103-4809b3074a8c-cni-binary-copy\") pod \"multus-additional-cni-plugins-dzqxm\" (UID: \"fde60d54-dbed-4e5e-8103-4809b3074a8c\") " pod="openshift-multus/multus-additional-cni-plugins-dzqxm" Sep 17 15:39:04.954605 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953854 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bb46c9f5-faf6-4564-be34-2923e2a5e5b1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9nf6r\" (UID: \"bb46c9f5-faf6-4564-be34-2923e2a5e5b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nf6r" Sep 17 15:39:04.954605 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953868 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-system-cni-dir\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.954605 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953882 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-host-var-lib-cni-bin\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.954605 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953882 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dbded374-06d6-4f90-b242-6b4f51e3ae11-cni-binary-copy\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.954605 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953921 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-host-run-k8s-cni-cncf-io\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.954605 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953930 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bb46c9f5-faf6-4564-be34-2923e2a5e5b1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9nf6r\" (UID: \"bb46c9f5-faf6-4564-be34-2923e2a5e5b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nf6r" Sep 17 15:39:04.954605 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953943 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-host-var-lib-cni-multus\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.954605 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953967 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-etc-kubernetes\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.954605 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953976 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-host-run-k8s-cni-cncf-io\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.954605 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.953988 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bb46c9f5-faf6-4564-be34-2923e2a5e5b1-socket-dir\") pod \"aws-ebs-csi-driver-node-9nf6r\" (UID: \"bb46c9f5-faf6-4564-be34-2923e2a5e5b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nf6r" Sep 17 15:39:04.954605 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954014 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-host-var-lib-cni-multus\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.954605 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954012 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fde60d54-dbed-4e5e-8103-4809b3074a8c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dzqxm\" (UID: \"fde60d54-dbed-4e5e-8103-4809b3074a8c\") " pod="openshift-multus/multus-additional-cni-plugins-dzqxm" Sep 17 15:39:04.954605 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954015 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fde60d54-dbed-4e5e-8103-4809b3074a8c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dzqxm\" (UID: \"fde60d54-dbed-4e5e-8103-4809b3074a8c\") " pod="openshift-multus/multus-additional-cni-plugins-dzqxm" Sep 17 15:39:04.955217 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954036 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fde60d54-dbed-4e5e-8103-4809b3074a8c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dzqxm\" (UID: \"fde60d54-dbed-4e5e-8103-4809b3074a8c\") " pod="openshift-multus/multus-additional-cni-plugins-dzqxm" Sep 17 15:39:04.955217 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954065 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/818bcff9-462b-4695-b59e-4585c9597a23-iptables-alerter-script\") pod \"iptables-alerter-qnbfv\" (UID: \"818bcff9-462b-4695-b59e-4585c9597a23\") " pod="openshift-network-operator/iptables-alerter-qnbfv" Sep 17 15:39:04.955217 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954049 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-etc-kubernetes\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.955217 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954093 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bb46c9f5-faf6-4564-be34-2923e2a5e5b1-sys-fs\") pod \"aws-ebs-csi-driver-node-9nf6r\" (UID: \"bb46c9f5-faf6-4564-be34-2923e2a5e5b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nf6r" Sep 17 15:39:04.955217 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954135 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8cc3d9c6-6452-4825-9708-86a460186487-lib-modules\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.955217 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954157 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8cc3d9c6-6452-4825-9708-86a460186487-etc-tuned\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.955217 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954169 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dbded374-06d6-4f90-b242-6b4f51e3ae11-multus-daemon-config\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.955217 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954179 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bb46c9f5-faf6-4564-be34-2923e2a5e5b1-socket-dir\") pod \"aws-ebs-csi-driver-node-9nf6r\" (UID: \"bb46c9f5-faf6-4564-be34-2923e2a5e5b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nf6r" Sep 17 15:39:04.955217 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954191 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bb46c9f5-faf6-4564-be34-2923e2a5e5b1-sys-fs\") pod \"aws-ebs-csi-driver-node-9nf6r\" (UID: \"bb46c9f5-faf6-4564-be34-2923e2a5e5b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nf6r" Sep 17 15:39:04.955217 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954182 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a7107e67-41ae-412b-851e-0b4c830adfd0-serviceca\") pod \"node-ca-6gbcs\" (UID: \"a7107e67-41ae-412b-851e-0b4c830adfd0\") " pod="openshift-image-registry/node-ca-6gbcs" Sep 17 15:39:04.955217 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954239 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-cnibin\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.955217 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954267 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/818bcff9-462b-4695-b59e-4585c9597a23-host-slash\") pod \"iptables-alerter-qnbfv\" (UID: \"818bcff9-462b-4695-b59e-4585c9597a23\") " pod="openshift-network-operator/iptables-alerter-qnbfv" Sep 17 15:39:04.955217 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954291 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bb46c9f5-faf6-4564-be34-2923e2a5e5b1-registration-dir\") pod \"aws-ebs-csi-driver-node-9nf6r\" (UID: \"bb46c9f5-faf6-4564-be34-2923e2a5e5b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nf6r" Sep 17 15:39:04.955217 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954298 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8cc3d9c6-6452-4825-9708-86a460186487-lib-modules\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.955217 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954315 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8cc3d9c6-6452-4825-9708-86a460186487-etc-systemd\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.955217 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954337 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5z7m\" (UniqueName: \"kubernetes.io/projected/8cc3d9c6-6452-4825-9708-86a460186487-kube-api-access-z5z7m\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.955217 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954340 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/818bcff9-462b-4695-b59e-4585c9597a23-host-slash\") pod \"iptables-alerter-qnbfv\" (UID: \"818bcff9-462b-4695-b59e-4585c9597a23\") " pod="openshift-network-operator/iptables-alerter-qnbfv" Sep 17 15:39:04.955764 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954376 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dbded374-06d6-4f90-b242-6b4f51e3ae11-cni-binary-copy\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.955764 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954388 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-cnibin\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.955764 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954380 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-host-var-lib-kubelet\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.955764 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954412 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-host-var-lib-kubelet\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.955764 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954425 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8cc3d9c6-6452-4825-9708-86a460186487-host\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.955764 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954433 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8cc3d9c6-6452-4825-9708-86a460186487-etc-systemd\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.955764 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954480 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8cc3d9c6-6452-4825-9708-86a460186487-host\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.955764 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954480 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bb46c9f5-faf6-4564-be34-2923e2a5e5b1-registration-dir\") pod \"aws-ebs-csi-driver-node-9nf6r\" (UID: \"bb46c9f5-faf6-4564-be34-2923e2a5e5b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nf6r" Sep 17 15:39:04.955764 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954516 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fde60d54-dbed-4e5e-8103-4809b3074a8c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dzqxm\" (UID: \"fde60d54-dbed-4e5e-8103-4809b3074a8c\") " pod="openshift-multus/multus-additional-cni-plugins-dzqxm" Sep 17 15:39:04.955764 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954547 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8cc3d9c6-6452-4825-9708-86a460186487-etc-sysctl-conf\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.955764 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954589 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-host-run-netns\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.955764 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954594 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a7107e67-41ae-412b-851e-0b4c830adfd0-serviceca\") pod \"node-ca-6gbcs\" (UID: \"a7107e67-41ae-412b-851e-0b4c830adfd0\") " pod="openshift-image-registry/node-ca-6gbcs" Sep 17 15:39:04.955764 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954616 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-hostroot\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.955764 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954624 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/818bcff9-462b-4695-b59e-4585c9597a23-iptables-alerter-script\") pod \"iptables-alerter-qnbfv\" (UID: \"818bcff9-462b-4695-b59e-4585c9597a23\") " pod="openshift-network-operator/iptables-alerter-qnbfv" Sep 17 15:39:04.955764 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954638 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-host-run-netns\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.955764 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954640 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bb46c9f5-faf6-4564-be34-2923e2a5e5b1-device-dir\") pod \"aws-ebs-csi-driver-node-9nf6r\" (UID: \"bb46c9f5-faf6-4564-be34-2923e2a5e5b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nf6r" Sep 17 15:39:04.955764 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954654 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-hostroot\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.955764 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954676 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8cc3d9c6-6452-4825-9708-86a460186487-etc-modprobe-d\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.956351 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954701 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cc3d9c6-6452-4825-9708-86a460186487-etc-kubernetes\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.956351 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954711 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8cc3d9c6-6452-4825-9708-86a460186487-etc-sysctl-conf\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.956351 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954679 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bb46c9f5-faf6-4564-be34-2923e2a5e5b1-device-dir\") pod \"aws-ebs-csi-driver-node-9nf6r\" (UID: \"bb46c9f5-faf6-4564-be34-2923e2a5e5b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nf6r" Sep 17 15:39:04.956351 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954721 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8cc3d9c6-6452-4825-9708-86a460186487-tmp\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.956351 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954754 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8cc3d9c6-6452-4825-9708-86a460186487-etc-modprobe-d\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.956351 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954754 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cc3d9c6-6452-4825-9708-86a460186487-etc-kubernetes\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.956351 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954767 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-host-run-multus-certs\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.956351 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954797 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bb46c9f5-faf6-4564-be34-2923e2a5e5b1-etc-selinux\") pod \"aws-ebs-csi-driver-node-9nf6r\" (UID: \"bb46c9f5-faf6-4564-be34-2923e2a5e5b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nf6r" Sep 17 15:39:04.956351 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954955 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bb46c9f5-faf6-4564-be34-2923e2a5e5b1-etc-selinux\") pod \"aws-ebs-csi-driver-node-9nf6r\" (UID: \"bb46c9f5-faf6-4564-be34-2923e2a5e5b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nf6r" Sep 17 15:39:04.956351 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.954970 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dbded374-06d6-4f90-b242-6b4f51e3ae11-host-run-multus-certs\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.956650 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.956448 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8cc3d9c6-6452-4825-9708-86a460186487-etc-tuned\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.956650 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.956633 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8cc3d9c6-6452-4825-9708-86a460186487-tmp\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:04.962996 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.962966 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj5wd\" (UniqueName: \"kubernetes.io/projected/fde60d54-dbed-4e5e-8103-4809b3074a8c-kube-api-access-hj5wd\") pod \"multus-additional-cni-plugins-dzqxm\" (UID: \"fde60d54-dbed-4e5e-8103-4809b3074a8c\") " pod="openshift-multus/multus-additional-cni-plugins-dzqxm" Sep 17 15:39:04.963157 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.963137 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6sgg\" (UniqueName: \"kubernetes.io/projected/bb46c9f5-faf6-4564-be34-2923e2a5e5b1-kube-api-access-g6sgg\") pod \"aws-ebs-csi-driver-node-9nf6r\" (UID: \"bb46c9f5-faf6-4564-be34-2923e2a5e5b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nf6r" Sep 17 15:39:04.963240 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.963223 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9stp\" (UniqueName: \"kubernetes.io/projected/818bcff9-462b-4695-b59e-4585c9597a23-kube-api-access-n9stp\") pod \"iptables-alerter-qnbfv\" (UID: \"818bcff9-462b-4695-b59e-4585c9597a23\") " pod="openshift-network-operator/iptables-alerter-qnbfv" Sep 17 15:39:04.963607 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.963586 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddzs6\" (UniqueName: \"kubernetes.io/projected/dbded374-06d6-4f90-b242-6b4f51e3ae11-kube-api-access-ddzs6\") pod \"multus-rfcds\" (UID: \"dbded374-06d6-4f90-b242-6b4f51e3ae11\") " pod="openshift-multus/multus-rfcds" Sep 17 15:39:04.963722 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.963705 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48dhl\" (UniqueName: \"kubernetes.io/projected/a7107e67-41ae-412b-851e-0b4c830adfd0-kube-api-access-48dhl\") pod \"node-ca-6gbcs\" (UID: \"a7107e67-41ae-412b-851e-0b4c830adfd0\") " pod="openshift-image-registry/node-ca-6gbcs" Sep 17 15:39:04.966013 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:04.965989 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5z7m\" (UniqueName: \"kubernetes.io/projected/8cc3d9c6-6452-4825-9708-86a460186487-kube-api-access-z5z7m\") pod \"tuned-kv96r\" (UID: \"8cc3d9c6-6452-4825-9708-86a460186487\") " pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:06.338401 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:06.338309 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hrgrs" Sep 17 15:39:06.348265 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:06.348236 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1683b9c0_ac32_4cb2_a099_ce62182f0bce.slice/crio-5bbba10fa020fdf477fee09ad6d9b760c279f8e34d047691fcda02b69cc3b505 WatchSource:0}: Error finding container 5bbba10fa020fdf477fee09ad6d9b760c279f8e34d047691fcda02b69cc3b505: Status 404 returned error can't find the container with id 5bbba10fa020fdf477fee09ad6d9b760c279f8e34d047691fcda02b69cc3b505 Sep 17 15:39:06.363642 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:06.363617 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:06.370721 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:06.370699 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qb2qz" Sep 17 15:39:06.372225 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:06.372197 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eb875df_5cc6_40f5_978e_f0adf0b823d5.slice/crio-68efac0ac0b430f372a772ddc90c009f48cd38badaf3711fb33ade36d946579e WatchSource:0}: Error finding container 68efac0ac0b430f372a772ddc90c009f48cd38badaf3711fb33ade36d946579e: Status 404 returned error can't find the container with id 68efac0ac0b430f372a772ddc90c009f48cd38badaf3711fb33ade36d946579e Sep 17 15:39:06.378849 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:06.378824 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46f93a66_b09c_41ef_8156_73ebc20ab303.slice/crio-9f8fea07c6c1dd38ce2767c6b8ca014c43112907a0c925ca31d10c1a915d58e2 WatchSource:0}: Error finding container 9f8fea07c6c1dd38ce2767c6b8ca014c43112907a0c925ca31d10c1a915d58e2: Status 404 returned error can't find the container with id 9f8fea07c6c1dd38ce2767c6b8ca014c43112907a0c925ca31d10c1a915d58e2 Sep 17 15:39:06.397799 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:06.397771 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6gbcs" Sep 17 15:39:06.402915 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:06.402872 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dzqxm" Sep 17 15:39:06.406885 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:06.406858 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7107e67_41ae_412b_851e_0b4c830adfd0.slice/crio-b99d7970f54af246986fbb70a27f9a4c65966dfa33a6dd555f096eaa1b72b983 WatchSource:0}: Error finding container b99d7970f54af246986fbb70a27f9a4c65966dfa33a6dd555f096eaa1b72b983: Status 404 returned error can't find the container with id b99d7970f54af246986fbb70a27f9a4c65966dfa33a6dd555f096eaa1b72b983 Sep 17 15:39:06.411271 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:06.411246 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfde60d54_dbed_4e5e_8103_4809b3074a8c.slice/crio-0348141b42b982b22da269c35866960c77134868359c6f946d5722c6d2f3b496 WatchSource:0}: Error finding container 0348141b42b982b22da269c35866960c77134868359c6f946d5722c6d2f3b496: Status 404 returned error can't find the container with id 0348141b42b982b22da269c35866960c77134868359c6f946d5722c6d2f3b496 Sep 17 15:39:06.451718 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:06.451686 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rfcds" Sep 17 15:39:06.461713 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:06.461681 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbded374_06d6_4f90_b242_6b4f51e3ae11.slice/crio-852ba001074975242d468d1eec77fe9ca3be6ebd7fa39e89ed938d3643b42f62 WatchSource:0}: Error finding container 852ba001074975242d468d1eec77fe9ca3be6ebd7fa39e89ed938d3643b42f62: Status 404 returned error can't find the container with id 852ba001074975242d468d1eec77fe9ca3be6ebd7fa39e89ed938d3643b42f62 Sep 17 15:39:06.476073 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:06.476025 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qnbfv" Sep 17 15:39:06.483276 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:06.483241 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nf6r" Sep 17 15:39:06.485107 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:06.485080 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod818bcff9_462b_4695_b59e_4585c9597a23.slice/crio-374e2e32126656430d98bb3f36ed496b8adb6eb03abfc1aa4437c6823be60e11 WatchSource:0}: Error finding container 374e2e32126656430d98bb3f36ed496b8adb6eb03abfc1aa4437c6823be60e11: Status 404 returned error can't find the container with id 374e2e32126656430d98bb3f36ed496b8adb6eb03abfc1aa4437c6823be60e11 Sep 17 15:39:06.488679 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:06.488658 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kv96r" Sep 17 15:39:06.492279 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:06.492203 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb46c9f5_faf6_4564_be34_2923e2a5e5b1.slice/crio-55978e8435bbb2ef57be1be9b8e83d945920e982a5ec089b07735016208275d5 WatchSource:0}: Error finding container 55978e8435bbb2ef57be1be9b8e83d945920e982a5ec089b07735016208275d5: Status 404 returned error can't find the container with id 55978e8435bbb2ef57be1be9b8e83d945920e982a5ec089b07735016208275d5 Sep 17 15:39:06.499122 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:06.499101 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cc3d9c6_6452_4825_9708_86a460186487.slice/crio-017c6f1627087f6c3899945d917654effe733891b6c1648145de42ebe652992d WatchSource:0}: Error finding container 017c6f1627087f6c3899945d917654effe733891b6c1648145de42ebe652992d: Status 404 returned error can't find the container with id 017c6f1627087f6c3899945d917654effe733891b6c1648145de42ebe652992d Sep 17 15:39:06.572922 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:06.572884 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 15:39:06.641441 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:06.641403 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6841aae3-9f3e-439b-bc41-685e1c15baef-original-pull-secret\") pod \"global-pull-secret-syncer-jtwf7\" (UID: \"6841aae3-9f3e-439b-bc41-685e1c15baef\") " pod="kube-system/global-pull-secret-syncer-jtwf7" Sep 17 15:39:06.641630 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:06.641469 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87031c7d-d4f1-4a4b-8691-e93c3698118a-metrics-certs\") pod \"network-metrics-daemon-fjm5t\" (UID: \"87031c7d-d4f1-4a4b-8691-e93c3698118a\") " pod="openshift-multus/network-metrics-daemon-fjm5t" Sep 17 15:39:06.641630 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:06.641558 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 15:39:06.641630 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:06.641566 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 15:39:06.641630 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:06.641623 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87031c7d-d4f1-4a4b-8691-e93c3698118a-metrics-certs podName:87031c7d-d4f1-4a4b-8691-e93c3698118a nodeName:}" failed. No retries permitted until 2026-09-17 15:39:07.641609648 +0000 UTC m=+3.035576497 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87031c7d-d4f1-4a4b-8691-e93c3698118a-metrics-certs") pod "network-metrics-daemon-fjm5t" (UID: "87031c7d-d4f1-4a4b-8691-e93c3698118a") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 15:39:06.641826 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:06.641646 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6841aae3-9f3e-439b-bc41-685e1c15baef-original-pull-secret podName:6841aae3-9f3e-439b-bc41-685e1c15baef nodeName:}" failed. No retries permitted until 2026-09-17 15:39:07.641628006 +0000 UTC m=+3.035594871 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6841aae3-9f3e-439b-bc41-685e1c15baef-original-pull-secret") pod "global-pull-secret-syncer-jtwf7" (UID: "6841aae3-9f3e-439b-bc41-685e1c15baef") : object "kube-system"/"original-pull-secret" not registered Sep 17 15:39:06.742203 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:06.742160 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qv2b\" (UniqueName: \"kubernetes.io/projected/75d806d9-420d-4e93-bb55-a30b25dcd5b9-kube-api-access-9qv2b\") pod \"network-check-target-kcjnr\" (UID: \"75d806d9-420d-4e93-bb55-a30b25dcd5b9\") " pod="openshift-network-diagnostics/network-check-target-kcjnr" Sep 17 15:39:06.742379 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:06.742319 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 15:39:06.742379 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:06.742340 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 15:39:06.742379 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:06.742354 2581 projected.go:196] Error preparing data for projected volume kube-api-access-9qv2b for pod openshift-network-diagnostics/network-check-target-kcjnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 15:39:06.742533 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:06.742407 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75d806d9-420d-4e93-bb55-a30b25dcd5b9-kube-api-access-9qv2b podName:75d806d9-420d-4e93-bb55-a30b25dcd5b9 nodeName:}" failed. No retries permitted until 2026-09-17 15:39:07.742386018 +0000 UTC m=+3.136352884 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9qv2b" (UniqueName: "kubernetes.io/projected/75d806d9-420d-4e93-bb55-a30b25dcd5b9-kube-api-access-9qv2b") pod "network-check-target-kcjnr" (UID: "75d806d9-420d-4e93-bb55-a30b25dcd5b9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 15:39:06.788376 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:06.788342 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 15:39:07.071629 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:07.071535 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 15:34:06 +0000 UTC" deadline="2028-05-05 04:07:40.361871772 +0000 UTC" Sep 17 15:39:07.071629 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:07.071575 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14292h28m33.290300988s" Sep 17 15:39:07.139597 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:07.139063 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtwf7" Sep 17 15:39:07.139597 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:07.139189 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtwf7" podUID="6841aae3-9f3e-439b-bc41-685e1c15baef" Sep 17 15:39:07.175775 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:07.175452 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kv96r" event={"ID":"8cc3d9c6-6452-4825-9708-86a460186487","Type":"ContainerStarted","Data":"017c6f1627087f6c3899945d917654effe733891b6c1648145de42ebe652992d"} Sep 17 15:39:07.197275 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:07.197233 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nf6r" event={"ID":"bb46c9f5-faf6-4564-be34-2923e2a5e5b1","Type":"ContainerStarted","Data":"55978e8435bbb2ef57be1be9b8e83d945920e982a5ec089b07735016208275d5"} Sep 17 15:39:07.203078 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:07.203035 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qnbfv" event={"ID":"818bcff9-462b-4695-b59e-4585c9597a23","Type":"ContainerStarted","Data":"374e2e32126656430d98bb3f36ed496b8adb6eb03abfc1aa4437c6823be60e11"} Sep 17 15:39:07.206760 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:07.206722 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rfcds" event={"ID":"dbded374-06d6-4f90-b242-6b4f51e3ae11","Type":"ContainerStarted","Data":"852ba001074975242d468d1eec77fe9ca3be6ebd7fa39e89ed938d3643b42f62"} Sep 17 15:39:07.224909 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:07.224856 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qb2qz" event={"ID":"46f93a66-b09c-41ef-8156-73ebc20ab303","Type":"ContainerStarted","Data":"9f8fea07c6c1dd38ce2767c6b8ca014c43112907a0c925ca31d10c1a915d58e2"} Sep 17 15:39:07.244588 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:07.244545 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" event={"ID":"9eb875df-5cc6-40f5-978e-f0adf0b823d5","Type":"ContainerStarted","Data":"68efac0ac0b430f372a772ddc90c009f48cd38badaf3711fb33ade36d946579e"} Sep 17 15:39:07.276657 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:07.276616 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-207.ec2.internal" event={"ID":"2dda5558ac038c7e75d7be72746e233e","Type":"ContainerStarted","Data":"ac9aee5f270c6bfa4da11407772ed3df38bd5dae9a7faddb33b4c425510e397b"} Sep 17 15:39:07.299643 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:07.299608 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-207.ec2.internal" event={"ID":"5a6855b9b6b7591a9d6ab8882157cfaa","Type":"ContainerStarted","Data":"e2be33a65541f66c1be22b569b869afa79fa506d242fc4d6f60491f1b1c9894c"} Sep 17 15:39:07.322592 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:07.322503 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dzqxm" event={"ID":"fde60d54-dbed-4e5e-8103-4809b3074a8c","Type":"ContainerStarted","Data":"0348141b42b982b22da269c35866960c77134868359c6f946d5722c6d2f3b496"} Sep 17 15:39:07.337625 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:07.337401 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6gbcs" event={"ID":"a7107e67-41ae-412b-851e-0b4c830adfd0","Type":"ContainerStarted","Data":"b99d7970f54af246986fbb70a27f9a4c65966dfa33a6dd555f096eaa1b72b983"} Sep 17 15:39:07.359675 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:07.359625 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hrgrs" event={"ID":"1683b9c0-ac32-4cb2-a099-ce62182f0bce","Type":"ContainerStarted","Data":"5bbba10fa020fdf477fee09ad6d9b760c279f8e34d047691fcda02b69cc3b505"} Sep 17 15:39:07.648531 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:07.648484 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6841aae3-9f3e-439b-bc41-685e1c15baef-original-pull-secret\") pod \"global-pull-secret-syncer-jtwf7\" (UID: \"6841aae3-9f3e-439b-bc41-685e1c15baef\") " pod="kube-system/global-pull-secret-syncer-jtwf7" Sep 17 15:39:07.648714 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:07.648557 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87031c7d-d4f1-4a4b-8691-e93c3698118a-metrics-certs\") pod \"network-metrics-daemon-fjm5t\" (UID: \"87031c7d-d4f1-4a4b-8691-e93c3698118a\") " pod="openshift-multus/network-metrics-daemon-fjm5t" Sep 17 15:39:07.648773 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:07.648718 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 15:39:07.648822 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:07.648783 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87031c7d-d4f1-4a4b-8691-e93c3698118a-metrics-certs podName:87031c7d-d4f1-4a4b-8691-e93c3698118a nodeName:}" failed. No retries permitted until 2026-09-17 15:39:09.648764113 +0000 UTC m=+5.042730965 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87031c7d-d4f1-4a4b-8691-e93c3698118a-metrics-certs") pod "network-metrics-daemon-fjm5t" (UID: "87031c7d-d4f1-4a4b-8691-e93c3698118a") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 15:39:07.649543 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:07.649522 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 15:39:07.649661 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:07.649588 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6841aae3-9f3e-439b-bc41-685e1c15baef-original-pull-secret podName:6841aae3-9f3e-439b-bc41-685e1c15baef nodeName:}" failed. No retries permitted until 2026-09-17 15:39:09.649570604 +0000 UTC m=+5.043537468 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6841aae3-9f3e-439b-bc41-685e1c15baef-original-pull-secret") pod "global-pull-secret-syncer-jtwf7" (UID: "6841aae3-9f3e-439b-bc41-685e1c15baef") : object "kube-system"/"original-pull-secret" not registered Sep 17 15:39:07.749414 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:07.749370 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qv2b\" (UniqueName: \"kubernetes.io/projected/75d806d9-420d-4e93-bb55-a30b25dcd5b9-kube-api-access-9qv2b\") pod \"network-check-target-kcjnr\" (UID: \"75d806d9-420d-4e93-bb55-a30b25dcd5b9\") " pod="openshift-network-diagnostics/network-check-target-kcjnr" Sep 17 15:39:07.749609 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:07.749589 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 15:39:07.749685 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:07.749619 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 15:39:07.749685 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:07.749632 2581 projected.go:196] Error preparing data for projected volume kube-api-access-9qv2b for pod openshift-network-diagnostics/network-check-target-kcjnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 15:39:07.749807 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:07.749695 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75d806d9-420d-4e93-bb55-a30b25dcd5b9-kube-api-access-9qv2b podName:75d806d9-420d-4e93-bb55-a30b25dcd5b9 nodeName:}" failed. No retries permitted until 2026-09-17 15:39:09.74967479 +0000 UTC m=+5.143641653 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9qv2b" (UniqueName: "kubernetes.io/projected/75d806d9-420d-4e93-bb55-a30b25dcd5b9-kube-api-access-9qv2b") pod "network-check-target-kcjnr" (UID: "75d806d9-420d-4e93-bb55-a30b25dcd5b9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 15:39:08.072697 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:08.072554 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 15:34:06 +0000 UTC" deadline="2028-02-28 11:51:31.130017211 +0000 UTC" Sep 17 15:39:08.072697 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:08.072615 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12692h12m23.057406433s" Sep 17 15:39:08.134115 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:08.134054 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcjnr" Sep 17 15:39:08.134300 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:08.134200 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kcjnr" podUID="75d806d9-420d-4e93-bb55-a30b25dcd5b9" Sep 17 15:39:08.134634 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:08.134605 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjm5t" Sep 17 15:39:08.134803 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:08.134713 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fjm5t" podUID="87031c7d-d4f1-4a4b-8691-e93c3698118a" Sep 17 15:39:08.649846 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:08.649811 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 15:39:09.133264 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:09.133230 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtwf7" Sep 17 15:39:09.133871 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:09.133371 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtwf7" podUID="6841aae3-9f3e-439b-bc41-685e1c15baef" Sep 17 15:39:09.667723 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:09.667685 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6841aae3-9f3e-439b-bc41-685e1c15baef-original-pull-secret\") pod \"global-pull-secret-syncer-jtwf7\" (UID: \"6841aae3-9f3e-439b-bc41-685e1c15baef\") " pod="kube-system/global-pull-secret-syncer-jtwf7" Sep 17 15:39:09.667927 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:09.667755 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87031c7d-d4f1-4a4b-8691-e93c3698118a-metrics-certs\") pod \"network-metrics-daemon-fjm5t\" (UID: \"87031c7d-d4f1-4a4b-8691-e93c3698118a\") " pod="openshift-multus/network-metrics-daemon-fjm5t" Sep 17 15:39:09.667999 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:09.667934 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 15:39:09.667999 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:09.667936 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 15:39:09.667999 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:09.667993 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6841aae3-9f3e-439b-bc41-685e1c15baef-original-pull-secret podName:6841aae3-9f3e-439b-bc41-685e1c15baef nodeName:}" failed. No retries permitted until 2026-09-17 15:39:13.667974929 +0000 UTC m=+9.061941815 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6841aae3-9f3e-439b-bc41-685e1c15baef-original-pull-secret") pod "global-pull-secret-syncer-jtwf7" (UID: "6841aae3-9f3e-439b-bc41-685e1c15baef") : object "kube-system"/"original-pull-secret" not registered Sep 17 15:39:09.668163 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:09.668011 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87031c7d-d4f1-4a4b-8691-e93c3698118a-metrics-certs podName:87031c7d-d4f1-4a4b-8691-e93c3698118a nodeName:}" failed. No retries permitted until 2026-09-17 15:39:13.668002201 +0000 UTC m=+9.061969056 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87031c7d-d4f1-4a4b-8691-e93c3698118a-metrics-certs") pod "network-metrics-daemon-fjm5t" (UID: "87031c7d-d4f1-4a4b-8691-e93c3698118a") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 15:39:09.768826 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:09.768785 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qv2b\" (UniqueName: \"kubernetes.io/projected/75d806d9-420d-4e93-bb55-a30b25dcd5b9-kube-api-access-9qv2b\") pod \"network-check-target-kcjnr\" (UID: \"75d806d9-420d-4e93-bb55-a30b25dcd5b9\") " pod="openshift-network-diagnostics/network-check-target-kcjnr" Sep 17 15:39:09.769131 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:09.769110 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 15:39:09.769234 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:09.769142 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 15:39:09.769234 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:09.769155 2581 projected.go:196] Error preparing data for projected volume kube-api-access-9qv2b for pod openshift-network-diagnostics/network-check-target-kcjnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 15:39:09.769234 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:09.769216 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75d806d9-420d-4e93-bb55-a30b25dcd5b9-kube-api-access-9qv2b podName:75d806d9-420d-4e93-bb55-a30b25dcd5b9 nodeName:}" failed. No retries permitted until 2026-09-17 15:39:13.769196946 +0000 UTC m=+9.163163803 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9qv2b" (UniqueName: "kubernetes.io/projected/75d806d9-420d-4e93-bb55-a30b25dcd5b9-kube-api-access-9qv2b") pod "network-check-target-kcjnr" (UID: "75d806d9-420d-4e93-bb55-a30b25dcd5b9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 15:39:10.133667 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:10.133634 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcjnr" Sep 17 15:39:10.134140 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:10.133666 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjm5t" Sep 17 15:39:10.134140 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:10.133781 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kcjnr" podUID="75d806d9-420d-4e93-bb55-a30b25dcd5b9" Sep 17 15:39:10.134140 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:10.133905 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fjm5t" podUID="87031c7d-d4f1-4a4b-8691-e93c3698118a" Sep 17 15:39:11.136489 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:11.135968 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtwf7" Sep 17 15:39:11.136489 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:11.136103 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtwf7" podUID="6841aae3-9f3e-439b-bc41-685e1c15baef" Sep 17 15:39:12.134075 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:12.134035 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcjnr" Sep 17 15:39:12.134263 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:12.134172 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kcjnr" podUID="75d806d9-420d-4e93-bb55-a30b25dcd5b9" Sep 17 15:39:12.134263 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:12.134209 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjm5t" Sep 17 15:39:12.134348 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:12.134273 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fjm5t" podUID="87031c7d-d4f1-4a4b-8691-e93c3698118a" Sep 17 15:39:13.135130 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:13.135091 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtwf7" Sep 17 15:39:13.135600 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:13.135233 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtwf7" podUID="6841aae3-9f3e-439b-bc41-685e1c15baef" Sep 17 15:39:13.703816 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:13.702962 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6841aae3-9f3e-439b-bc41-685e1c15baef-original-pull-secret\") pod \"global-pull-secret-syncer-jtwf7\" (UID: \"6841aae3-9f3e-439b-bc41-685e1c15baef\") " pod="kube-system/global-pull-secret-syncer-jtwf7" Sep 17 15:39:13.703816 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:13.703038 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87031c7d-d4f1-4a4b-8691-e93c3698118a-metrics-certs\") pod \"network-metrics-daemon-fjm5t\" (UID: \"87031c7d-d4f1-4a4b-8691-e93c3698118a\") " pod="openshift-multus/network-metrics-daemon-fjm5t" Sep 17 15:39:13.703816 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:13.703199 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 15:39:13.703816 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:13.703263 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87031c7d-d4f1-4a4b-8691-e93c3698118a-metrics-certs podName:87031c7d-d4f1-4a4b-8691-e93c3698118a nodeName:}" failed. No retries permitted until 2026-09-17 15:39:21.703244916 +0000 UTC m=+17.097211770 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87031c7d-d4f1-4a4b-8691-e93c3698118a-metrics-certs") pod "network-metrics-daemon-fjm5t" (UID: "87031c7d-d4f1-4a4b-8691-e93c3698118a") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 15:39:13.703816 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:13.703724 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 15:39:13.703816 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:13.703778 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6841aae3-9f3e-439b-bc41-685e1c15baef-original-pull-secret podName:6841aae3-9f3e-439b-bc41-685e1c15baef nodeName:}" failed. No retries permitted until 2026-09-17 15:39:21.703762578 +0000 UTC m=+17.097729434 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6841aae3-9f3e-439b-bc41-685e1c15baef-original-pull-secret") pod "global-pull-secret-syncer-jtwf7" (UID: "6841aae3-9f3e-439b-bc41-685e1c15baef") : object "kube-system"/"original-pull-secret" not registered Sep 17 15:39:13.804147 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:13.804112 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qv2b\" (UniqueName: \"kubernetes.io/projected/75d806d9-420d-4e93-bb55-a30b25dcd5b9-kube-api-access-9qv2b\") pod \"network-check-target-kcjnr\" (UID: \"75d806d9-420d-4e93-bb55-a30b25dcd5b9\") " pod="openshift-network-diagnostics/network-check-target-kcjnr" Sep 17 15:39:13.804366 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:13.804335 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 15:39:13.804366 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:13.804365 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 15:39:13.804501 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:13.804377 2581 projected.go:196] Error preparing data for projected volume kube-api-access-9qv2b for pod openshift-network-diagnostics/network-check-target-kcjnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 15:39:13.804501 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:13.804444 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75d806d9-420d-4e93-bb55-a30b25dcd5b9-kube-api-access-9qv2b podName:75d806d9-420d-4e93-bb55-a30b25dcd5b9 nodeName:}" failed. No retries permitted until 2026-09-17 15:39:21.804423862 +0000 UTC m=+17.198390714 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9qv2b" (UniqueName: "kubernetes.io/projected/75d806d9-420d-4e93-bb55-a30b25dcd5b9-kube-api-access-9qv2b") pod "network-check-target-kcjnr" (UID: "75d806d9-420d-4e93-bb55-a30b25dcd5b9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 15:39:14.134090 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:14.133627 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcjnr" Sep 17 15:39:14.134090 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:14.133637 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjm5t" Sep 17 15:39:14.134090 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:14.133752 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kcjnr" podUID="75d806d9-420d-4e93-bb55-a30b25dcd5b9" Sep 17 15:39:14.134090 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:14.133855 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fjm5t" podUID="87031c7d-d4f1-4a4b-8691-e93c3698118a" Sep 17 15:39:15.135384 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:15.135350 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtwf7" Sep 17 15:39:15.135917 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:15.135476 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtwf7" podUID="6841aae3-9f3e-439b-bc41-685e1c15baef" Sep 17 15:39:16.134475 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:16.133827 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcjnr" Sep 17 15:39:16.134475 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:16.133987 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kcjnr" podUID="75d806d9-420d-4e93-bb55-a30b25dcd5b9" Sep 17 15:39:16.134475 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:16.133832 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjm5t" Sep 17 15:39:16.134475 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:16.134436 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fjm5t" podUID="87031c7d-d4f1-4a4b-8691-e93c3698118a" Sep 17 15:39:17.133567 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:17.133532 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtwf7" Sep 17 15:39:17.134008 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:17.133689 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtwf7" podUID="6841aae3-9f3e-439b-bc41-685e1c15baef" Sep 17 15:39:18.133451 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:18.133410 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcjnr" Sep 17 15:39:18.133629 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:18.133429 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjm5t" Sep 17 15:39:18.133629 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:18.133531 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kcjnr" podUID="75d806d9-420d-4e93-bb55-a30b25dcd5b9" Sep 17 15:39:18.133629 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:18.133593 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fjm5t" podUID="87031c7d-d4f1-4a4b-8691-e93c3698118a" Sep 17 15:39:19.134245 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:19.134210 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtwf7" Sep 17 15:39:19.134669 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:19.134353 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtwf7" podUID="6841aae3-9f3e-439b-bc41-685e1c15baef" Sep 17 15:39:20.133699 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:20.133660 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjm5t" Sep 17 15:39:20.133699 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:20.133697 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcjnr" Sep 17 15:39:20.133944 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:20.133801 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fjm5t" podUID="87031c7d-d4f1-4a4b-8691-e93c3698118a" Sep 17 15:39:20.133944 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:20.133931 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kcjnr" podUID="75d806d9-420d-4e93-bb55-a30b25dcd5b9" Sep 17 15:39:21.134001 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:21.133958 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtwf7" Sep 17 15:39:21.134444 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:21.134084 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtwf7" podUID="6841aae3-9f3e-439b-bc41-685e1c15baef" Sep 17 15:39:21.764900 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:21.764845 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87031c7d-d4f1-4a4b-8691-e93c3698118a-metrics-certs\") pod \"network-metrics-daemon-fjm5t\" (UID: \"87031c7d-d4f1-4a4b-8691-e93c3698118a\") " pod="openshift-multus/network-metrics-daemon-fjm5t" Sep 17 15:39:21.765095 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:21.764935 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6841aae3-9f3e-439b-bc41-685e1c15baef-original-pull-secret\") pod \"global-pull-secret-syncer-jtwf7\" (UID: \"6841aae3-9f3e-439b-bc41-685e1c15baef\") " pod="kube-system/global-pull-secret-syncer-jtwf7" Sep 17 15:39:21.765095 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:21.765029 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 15:39:21.765095 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:21.765037 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 15:39:21.765095 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:21.765081 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6841aae3-9f3e-439b-bc41-685e1c15baef-original-pull-secret podName:6841aae3-9f3e-439b-bc41-685e1c15baef nodeName:}" failed. No retries permitted until 2026-09-17 15:39:37.765068258 +0000 UTC m=+33.159035123 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6841aae3-9f3e-439b-bc41-685e1c15baef-original-pull-secret") pod "global-pull-secret-syncer-jtwf7" (UID: "6841aae3-9f3e-439b-bc41-685e1c15baef") : object "kube-system"/"original-pull-secret" not registered Sep 17 15:39:21.765230 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:21.765101 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87031c7d-d4f1-4a4b-8691-e93c3698118a-metrics-certs podName:87031c7d-d4f1-4a4b-8691-e93c3698118a nodeName:}" failed. No retries permitted until 2026-09-17 15:39:37.765086934 +0000 UTC m=+33.159053800 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87031c7d-d4f1-4a4b-8691-e93c3698118a-metrics-certs") pod "network-metrics-daemon-fjm5t" (UID: "87031c7d-d4f1-4a4b-8691-e93c3698118a") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 15:39:21.865294 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:21.865256 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qv2b\" (UniqueName: \"kubernetes.io/projected/75d806d9-420d-4e93-bb55-a30b25dcd5b9-kube-api-access-9qv2b\") pod \"network-check-target-kcjnr\" (UID: \"75d806d9-420d-4e93-bb55-a30b25dcd5b9\") " pod="openshift-network-diagnostics/network-check-target-kcjnr" Sep 17 15:39:21.865489 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:21.865448 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 15:39:21.865489 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:21.865476 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 15:39:21.865489 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:21.865487 2581 projected.go:196] Error preparing data for projected volume kube-api-access-9qv2b for pod openshift-network-diagnostics/network-check-target-kcjnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 15:39:21.865656 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:21.865550 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75d806d9-420d-4e93-bb55-a30b25dcd5b9-kube-api-access-9qv2b podName:75d806d9-420d-4e93-bb55-a30b25dcd5b9 nodeName:}" failed. No retries permitted until 2026-09-17 15:39:37.865532356 +0000 UTC m=+33.259499230 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9qv2b" (UniqueName: "kubernetes.io/projected/75d806d9-420d-4e93-bb55-a30b25dcd5b9-kube-api-access-9qv2b") pod "network-check-target-kcjnr" (UID: "75d806d9-420d-4e93-bb55-a30b25dcd5b9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 15:39:22.133266 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:22.133228 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjm5t" Sep 17 15:39:22.133266 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:22.133251 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcjnr" Sep 17 15:39:22.133509 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:22.133352 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fjm5t" podUID="87031c7d-d4f1-4a4b-8691-e93c3698118a" Sep 17 15:39:22.133509 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:22.133469 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kcjnr" podUID="75d806d9-420d-4e93-bb55-a30b25dcd5b9" Sep 17 15:39:23.133721 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:23.133684 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtwf7" Sep 17 15:39:23.134254 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:23.133808 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtwf7" podUID="6841aae3-9f3e-439b-bc41-685e1c15baef" Sep 17 15:39:24.133266 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:24.133224 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcjnr" Sep 17 15:39:24.133462 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:24.133224 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjm5t" Sep 17 15:39:24.133462 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:24.133371 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kcjnr" podUID="75d806d9-420d-4e93-bb55-a30b25dcd5b9" Sep 17 15:39:24.133573 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:24.133474 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fjm5t" podUID="87031c7d-d4f1-4a4b-8691-e93c3698118a" Sep 17 15:39:25.136326 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:25.136296 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtwf7" Sep 17 15:39:25.136730 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:25.136406 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtwf7" podUID="6841aae3-9f3e-439b-bc41-685e1c15baef" Sep 17 15:39:26.133680 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:26.133648 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjm5t" Sep 17 15:39:26.133795 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:26.133661 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcjnr" Sep 17 15:39:26.133911 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:26.133804 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fjm5t" podUID="87031c7d-d4f1-4a4b-8691-e93c3698118a" Sep 17 15:39:26.133965 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:26.133924 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kcjnr" podUID="75d806d9-420d-4e93-bb55-a30b25dcd5b9" Sep 17 15:39:26.430592 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:26.429399 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvbm6_9eb875df-5cc6-40f5-978e-f0adf0b823d5/ovn-acl-logging/0.log" Sep 17 15:39:26.432261 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:26.432232 2581 generic.go:356] "Generic (PLEG): container finished" podID="9eb875df-5cc6-40f5-978e-f0adf0b823d5" containerID="f58fc7fe2cc0a7ae9b8e23181304f541f4377025c8e859f05e07845e0b664946" exitCode=1 Sep 17 15:39:26.432378 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:26.432326 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" event={"ID":"9eb875df-5cc6-40f5-978e-f0adf0b823d5","Type":"ContainerStarted","Data":"c7b43fae975db98abba437908010e16c695149d24198dab33624297b0a3cdc77"} Sep 17 15:39:26.432435 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:26.432411 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" event={"ID":"9eb875df-5cc6-40f5-978e-f0adf0b823d5","Type":"ContainerStarted","Data":"7c45593da40c8a8563dbf31a9793de75ae42a6fab8daba3f0071764acd5568f7"} Sep 17 15:39:26.432495 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:26.432462 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" event={"ID":"9eb875df-5cc6-40f5-978e-f0adf0b823d5","Type":"ContainerStarted","Data":"ed4675be9479f6df725adbd242680f2f28540f70170376f3606c9447a18d1ce3"} Sep 17 15:39:26.432548 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:26.432512 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" event={"ID":"9eb875df-5cc6-40f5-978e-f0adf0b823d5","Type":"ContainerDied","Data":"f58fc7fe2cc0a7ae9b8e23181304f541f4377025c8e859f05e07845e0b664946"} Sep 17 15:39:26.432603 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:26.432563 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" event={"ID":"9eb875df-5cc6-40f5-978e-f0adf0b823d5","Type":"ContainerStarted","Data":"b6cf89387d6cdc2520555944efd5e4f316ac3adbf636479221a11b061c5ed884"} Sep 17 15:39:26.445480 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:26.445054 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-207.ec2.internal" event={"ID":"5a6855b9b6b7591a9d6ab8882157cfaa","Type":"ContainerStarted","Data":"1ee800b2e794937b9d3dd4a722fcc8c2a1ceb5b7386f8b5bc7355e76775cdcab"} Sep 17 15:39:26.446746 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:26.446717 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kv96r" event={"ID":"8cc3d9c6-6452-4825-9708-86a460186487","Type":"ContainerStarted","Data":"bb4398faed521aed3abfb70bee67c4eacc20a07e3accd953d80a50c58cc88cf9"} Sep 17 15:39:26.478545 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:26.478490 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-207.ec2.internal" podStartSLOduration=20.478472433 podStartE2EDuration="20.478472433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:39:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:26.478390639 +0000 UTC m=+21.872357511" watchObservedRunningTime="2026-09-17 15:39:26.478472433 +0000 UTC m=+21.872439309" Sep 17 15:39:27.133778 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:27.133736 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtwf7" Sep 17 15:39:27.133998 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:27.133868 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtwf7" podUID="6841aae3-9f3e-439b-bc41-685e1c15baef" Sep 17 15:39:27.450296 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:27.450223 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nf6r" event={"ID":"bb46c9f5-faf6-4564-be34-2923e2a5e5b1","Type":"ContainerStarted","Data":"20dba747b9cc56dd2af57cb274ab137f5f01fd4d220688bb24f0a404dd2fe36f"} Sep 17 15:39:27.451675 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:27.451646 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qnbfv" event={"ID":"818bcff9-462b-4695-b59e-4585c9597a23","Type":"ContainerStarted","Data":"dd336293bbbcb0f42df4dd8358ae25de5accee039c0d07aaf9fcb638f4e317f6"} Sep 17 15:39:27.453152 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:27.453122 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rfcds" event={"ID":"dbded374-06d6-4f90-b242-6b4f51e3ae11","Type":"ContainerStarted","Data":"d1dd1dce864ae80ed66b7a71ba7d14d0fc0b08d129d7a14e870a52d4ccff002c"} Sep 17 15:39:27.454379 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:27.454358 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qb2qz" event={"ID":"46f93a66-b09c-41ef-8156-73ebc20ab303","Type":"ContainerStarted","Data":"0ffbe86fe459867fcd821df163fe816241431ad488ba32ede89e98a319624765"} Sep 17 15:39:27.456695 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:27.456669 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvbm6_9eb875df-5cc6-40f5-978e-f0adf0b823d5/ovn-acl-logging/0.log" Sep 17 15:39:27.457044 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:27.457026 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" event={"ID":"9eb875df-5cc6-40f5-978e-f0adf0b823d5","Type":"ContainerStarted","Data":"406a2476607e9afea759b3829551081225717ca5f3ff180075edaf21b3caf1f8"} Sep 17 15:39:27.460777 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:27.460752 2581 generic.go:356] "Generic (PLEG): container finished" podID="2dda5558ac038c7e75d7be72746e233e" containerID="3b17db561bc59703ef93b55c6e8923db2c48bc73aa907c17c96fcdfba72fbc11" exitCode=0 Sep 17 15:39:27.460879 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:27.460836 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-207.ec2.internal" event={"ID":"2dda5558ac038c7e75d7be72746e233e","Type":"ContainerDied","Data":"3b17db561bc59703ef93b55c6e8923db2c48bc73aa907c17c96fcdfba72fbc11"} Sep 17 15:39:27.462416 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:27.462396 2581 generic.go:356] "Generic (PLEG): container finished" podID="fde60d54-dbed-4e5e-8103-4809b3074a8c" containerID="be9cbb44de870eeeab85b36b699e4af327f8ecab0c61156bfd0d35b677ec79f2" exitCode=0 Sep 17 15:39:27.462500 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:27.462455 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dzqxm" event={"ID":"fde60d54-dbed-4e5e-8103-4809b3074a8c","Type":"ContainerDied","Data":"be9cbb44de870eeeab85b36b699e4af327f8ecab0c61156bfd0d35b677ec79f2"} Sep 17 15:39:27.463874 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:27.463855 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6gbcs" event={"ID":"a7107e67-41ae-412b-851e-0b4c830adfd0","Type":"ContainerStarted","Data":"dfe657f10b98470f3172c30ac9201ff895e0d52055f114cfcd0afac10a1a2d68"} Sep 17 15:39:27.465315 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:27.465295 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hrgrs" event={"ID":"1683b9c0-ac32-4cb2-a099-ce62182f0bce","Type":"ContainerStarted","Data":"6797a5edbd68b204c1380b843658bc7a8de7b5885e609f308dcc6cfa9a1110e7"} Sep 17 15:39:27.482916 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:27.482847 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kv96r" podStartSLOduration=3.342222673 podStartE2EDuration="22.482831067s" totalImagesPullingTime="19.140608394s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:39:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:26.513787334 +0000 UTC m=+21.907754207" watchObservedRunningTime="2026-09-17 15:39:27.482831067 +0000 UTC m=+22.876797939" Sep 17 15:39:27.509577 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:27.509532 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qnbfv" podStartSLOduration=3.351751111 podStartE2EDuration="22.509517273s" totalImagesPullingTime="19.157766162s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:39:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:27.482723122 +0000 UTC m=+22.876689993" watchObservedRunningTime="2026-09-17 15:39:27.509517273 +0000 UTC m=+22.903484143" Sep 17 15:39:27.539129 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:27.539082 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hrgrs" podStartSLOduration=3.2862905700000002 podStartE2EDuration="22.53906482s" totalImagesPullingTime="19.25277425s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:39:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:27.509733456 +0000 UTC m=+22.903700327" watchObservedRunningTime="2026-09-17 15:39:27.53906482 +0000 UTC m=+22.933031692" Sep 17 15:39:27.539432 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:27.539407 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6gbcs" podStartSLOduration=3.346033411 podStartE2EDuration="22.539400922s" totalImagesPullingTime="19.193367511s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:39:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:27.538883829 +0000 UTC m=+22.932850705" watchObservedRunningTime="2026-09-17 15:39:27.539400922 +0000 UTC m=+22.933367793" Sep 17 15:39:27.674008 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:27.673779 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qb2qz" podStartSLOduration=3.452384777 podStartE2EDuration="22.673755613s" totalImagesPullingTime="19.221370836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:39:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:27.644046634 +0000 UTC m=+23.038013506" watchObservedRunningTime="2026-09-17 15:39:27.673755613 +0000 UTC m=+23.067722485" Sep 17 15:39:27.913405 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:27.913378 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 17 15:39:28.104438 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:28.104309 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T15:39:27.913397815Z","UUID":"19203965-e0be-4698-a75f-208f1fa62984","Handler":null,"Name":"","Endpoint":""} Sep 17 15:39:28.106155 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:28.106131 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 17 15:39:28.106291 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:28.106176 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 17 15:39:28.133271 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:28.133234 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcjnr" Sep 17 15:39:28.133460 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:28.133236 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjm5t" Sep 17 15:39:28.133460 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:28.133367 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kcjnr" podUID="75d806d9-420d-4e93-bb55-a30b25dcd5b9" Sep 17 15:39:28.133551 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:28.133456 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fjm5t" podUID="87031c7d-d4f1-4a4b-8691-e93c3698118a" Sep 17 15:39:28.473474 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:28.473393 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nf6r" event={"ID":"bb46c9f5-faf6-4564-be34-2923e2a5e5b1","Type":"ContainerStarted","Data":"8bdf01bb395b9960744d5af273e76c6c24cbeb10b4685848cdd973e0c7f4403c"} Sep 17 15:39:28.475792 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:28.475727 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-207.ec2.internal" event={"ID":"2dda5558ac038c7e75d7be72746e233e","Type":"ContainerStarted","Data":"d0a726b223f4e0b45eb10af919882ea9fc5ccabf904c6a2ba831db2ec9e8f246"} Sep 17 15:39:28.500177 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:28.500122 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rfcds" podStartSLOduration=3.625085979 podStartE2EDuration="23.500098488s" totalImagesPullingTime="19.875012509s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:39:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:27.674334085 +0000 UTC m=+23.068300957" watchObservedRunningTime="2026-09-17 15:39:28.500098488 +0000 UTC m=+23.894065361" Sep 17 15:39:29.133323 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:29.133290 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtwf7" Sep 17 15:39:29.133499 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:29.133398 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtwf7" podUID="6841aae3-9f3e-439b-bc41-685e1c15baef" Sep 17 15:39:29.480965 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:29.480791 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nf6r" event={"ID":"bb46c9f5-faf6-4564-be34-2923e2a5e5b1","Type":"ContainerStarted","Data":"5f531fb81e460f1df2ef157693c3f11657a78268d175585a68008ff3a85665b3"} Sep 17 15:39:29.484520 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:29.484498 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvbm6_9eb875df-5cc6-40f5-978e-f0adf0b823d5/ovn-acl-logging/0.log" Sep 17 15:39:29.484977 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:29.484937 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" event={"ID":"9eb875df-5cc6-40f5-978e-f0adf0b823d5","Type":"ContainerStarted","Data":"e6f99d1f773fb9dc9cff182d299c5eb3cf252e76262804ef37fcc0b724eea15b"} Sep 17 15:39:29.516785 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:29.516731 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-207.ec2.internal" podStartSLOduration=23.516717195 podStartE2EDuration="23.516717195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:39:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:28.499683507 +0000 UTC m=+23.893650379" watchObservedRunningTime="2026-09-17 15:39:29.516717195 +0000 UTC m=+24.910684067" Sep 17 15:39:30.134240 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:30.134205 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjm5t" Sep 17 15:39:30.134240 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:30.134237 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcjnr" Sep 17 15:39:30.134512 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:30.134322 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fjm5t" podUID="87031c7d-d4f1-4a4b-8691-e93c3698118a" Sep 17 15:39:30.134512 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:30.134451 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kcjnr" podUID="75d806d9-420d-4e93-bb55-a30b25dcd5b9" Sep 17 15:39:31.134082 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:31.134040 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtwf7" Sep 17 15:39:31.134550 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:31.134198 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtwf7" podUID="6841aae3-9f3e-439b-bc41-685e1c15baef" Sep 17 15:39:31.147079 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:31.147048 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qb2qz" Sep 17 15:39:31.147644 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:31.147616 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qb2qz" Sep 17 15:39:31.175136 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:31.175077 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nf6r" podStartSLOduration=4.574983912 podStartE2EDuration="26.175053788s" totalImagesPullingTime="21.600069876s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:39:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:29.517409571 +0000 UTC m=+24.911376444" watchObservedRunningTime="2026-09-17 15:39:31.175053788 +0000 UTC m=+26.569020661" Sep 17 15:39:31.986977 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:31.986941 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qb2qz" Sep 17 15:39:31.987573 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:31.987555 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qb2qz" Sep 17 15:39:32.134179 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:32.134132 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcjnr" Sep 17 15:39:32.134575 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:32.134149 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjm5t" Sep 17 15:39:32.134575 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:32.134255 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kcjnr" podUID="75d806d9-420d-4e93-bb55-a30b25dcd5b9" Sep 17 15:39:32.134575 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:32.134351 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fjm5t" podUID="87031c7d-d4f1-4a4b-8691-e93c3698118a" Sep 17 15:39:32.496102 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:32.495956 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvbm6_9eb875df-5cc6-40f5-978e-f0adf0b823d5/ovn-acl-logging/0.log" Sep 17 15:39:32.496518 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:32.496483 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" event={"ID":"9eb875df-5cc6-40f5-978e-f0adf0b823d5","Type":"ContainerStarted","Data":"7fab2f8d0dcb58b2b4626386074820873a0713ed7e9f464797001f64ee416539"} Sep 17 15:39:32.496781 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:32.496759 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:32.496872 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:32.496829 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:32.496958 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:32.496875 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:32.496958 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:32.496939 2581 scope.go:117] "RemoveContainer" containerID="f58fc7fe2cc0a7ae9b8e23181304f541f4377025c8e859f05e07845e0b664946" Sep 17 15:39:32.513974 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:32.513938 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:32.514129 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:32.514110 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:39:33.134351 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:33.134321 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtwf7" Sep 17 15:39:33.134929 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:33.134427 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtwf7" podUID="6841aae3-9f3e-439b-bc41-685e1c15baef" Sep 17 15:39:33.503440 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:33.503353 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvbm6_9eb875df-5cc6-40f5-978e-f0adf0b823d5/ovn-acl-logging/0.log" Sep 17 15:39:33.504048 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:33.503928 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" event={"ID":"9eb875df-5cc6-40f5-978e-f0adf0b823d5","Type":"ContainerStarted","Data":"f3c8eb1c5c2937493d9ce3633b43303290b329e19c1e3ab74dbad5a3c9b02a13"} Sep 17 15:39:33.506663 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:33.506640 2581 generic.go:356] "Generic (PLEG): container finished" podID="fde60d54-dbed-4e5e-8103-4809b3074a8c" containerID="0ea4f203ec1c7f7517256b1cab8539ecef81214165b457dfbfc8eb68023e8960" exitCode=0 Sep 17 15:39:33.506995 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:33.506965 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dzqxm" event={"ID":"fde60d54-dbed-4e5e-8103-4809b3074a8c","Type":"ContainerDied","Data":"0ea4f203ec1c7f7517256b1cab8539ecef81214165b457dfbfc8eb68023e8960"} Sep 17 15:39:33.544959 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:33.544908 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" podStartSLOduration=9.098390487 podStartE2EDuration="28.544875942s" totalImagesPullingTime="19.446485455s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:39:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:33.5443471 +0000 UTC m=+28.938313974" watchObservedRunningTime="2026-09-17 15:39:33.544875942 +0000 UTC m=+28.938842814" Sep 17 15:39:34.134237 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:34.134201 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcjnr" Sep 17 15:39:34.134396 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:34.134328 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kcjnr" podUID="75d806d9-420d-4e93-bb55-a30b25dcd5b9" Sep 17 15:39:34.135052 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:34.134414 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjm5t" Sep 17 15:39:34.135052 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:34.134485 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fjm5t" podUID="87031c7d-d4f1-4a4b-8691-e93c3698118a" Sep 17 15:39:34.661130 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:34.661021 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kcjnr"] Sep 17 15:39:34.661285 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:34.661142 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcjnr" Sep 17 15:39:34.661344 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:34.661280 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kcjnr" podUID="75d806d9-420d-4e93-bb55-a30b25dcd5b9" Sep 17 15:39:34.661805 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:34.661782 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fjm5t"] Sep 17 15:39:34.661923 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:34.661908 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjm5t" Sep 17 15:39:34.662045 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:34.662016 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fjm5t" podUID="87031c7d-d4f1-4a4b-8691-e93c3698118a" Sep 17 15:39:34.662852 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:34.662832 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jtwf7"] Sep 17 15:39:34.662960 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:34.662941 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtwf7" Sep 17 15:39:34.663038 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:34.663018 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtwf7" podUID="6841aae3-9f3e-439b-bc41-685e1c15baef" Sep 17 15:39:35.513265 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:35.513177 2581 generic.go:356] "Generic (PLEG): container finished" podID="fde60d54-dbed-4e5e-8103-4809b3074a8c" containerID="c5d5106f0dbba84419766cee20c7d173c0676b4f98ae88bc5280d65b1b053917" exitCode=0 Sep 17 15:39:35.513265 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:35.513254 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dzqxm" event={"ID":"fde60d54-dbed-4e5e-8103-4809b3074a8c","Type":"ContainerDied","Data":"c5d5106f0dbba84419766cee20c7d173c0676b4f98ae88bc5280d65b1b053917"} Sep 17 15:39:36.134093 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:36.134055 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjm5t" Sep 17 15:39:36.134093 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:36.134087 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtwf7" Sep 17 15:39:36.134299 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:36.134178 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcjnr" Sep 17 15:39:36.134299 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:36.134190 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fjm5t" podUID="87031c7d-d4f1-4a4b-8691-e93c3698118a" Sep 17 15:39:36.134299 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:36.134266 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtwf7" podUID="6841aae3-9f3e-439b-bc41-685e1c15baef" Sep 17 15:39:36.134459 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:36.134325 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kcjnr" podUID="75d806d9-420d-4e93-bb55-a30b25dcd5b9" Sep 17 15:39:37.520087 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:37.520045 2581 generic.go:356] "Generic (PLEG): container finished" podID="fde60d54-dbed-4e5e-8103-4809b3074a8c" containerID="7fce940788f21de8d86e1f2781624db5d825ff96d46466a9f22b37d7a87ce5bc" exitCode=0 Sep 17 15:39:37.520507 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:37.520092 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dzqxm" event={"ID":"fde60d54-dbed-4e5e-8103-4809b3074a8c","Type":"ContainerDied","Data":"7fce940788f21de8d86e1f2781624db5d825ff96d46466a9f22b37d7a87ce5bc"} Sep 17 15:39:37.783711 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:37.783623 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6841aae3-9f3e-439b-bc41-685e1c15baef-original-pull-secret\") pod \"global-pull-secret-syncer-jtwf7\" (UID: \"6841aae3-9f3e-439b-bc41-685e1c15baef\") " pod="kube-system/global-pull-secret-syncer-jtwf7" Sep 17 15:39:37.783711 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:37.783667 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87031c7d-d4f1-4a4b-8691-e93c3698118a-metrics-certs\") pod \"network-metrics-daemon-fjm5t\" (UID: \"87031c7d-d4f1-4a4b-8691-e93c3698118a\") " pod="openshift-multus/network-metrics-daemon-fjm5t" Sep 17 15:39:37.783911 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:37.783753 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 15:39:37.783911 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:37.783756 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 15:39:37.783911 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:37.783803 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87031c7d-d4f1-4a4b-8691-e93c3698118a-metrics-certs podName:87031c7d-d4f1-4a4b-8691-e93c3698118a nodeName:}" failed. No retries permitted until 2026-09-17 15:40:09.783789479 +0000 UTC m=+65.177756347 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87031c7d-d4f1-4a4b-8691-e93c3698118a-metrics-certs") pod "network-metrics-daemon-fjm5t" (UID: "87031c7d-d4f1-4a4b-8691-e93c3698118a") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 15:39:37.783911 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:37.783815 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6841aae3-9f3e-439b-bc41-685e1c15baef-original-pull-secret podName:6841aae3-9f3e-439b-bc41-685e1c15baef nodeName:}" failed. No retries permitted until 2026-09-17 15:40:09.783809765 +0000 UTC m=+65.177776614 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6841aae3-9f3e-439b-bc41-685e1c15baef-original-pull-secret") pod "global-pull-secret-syncer-jtwf7" (UID: "6841aae3-9f3e-439b-bc41-685e1c15baef") : object "kube-system"/"original-pull-secret" not registered Sep 17 15:39:37.884518 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:37.884485 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qv2b\" (UniqueName: \"kubernetes.io/projected/75d806d9-420d-4e93-bb55-a30b25dcd5b9-kube-api-access-9qv2b\") pod \"network-check-target-kcjnr\" (UID: \"75d806d9-420d-4e93-bb55-a30b25dcd5b9\") " pod="openshift-network-diagnostics/network-check-target-kcjnr" Sep 17 15:39:37.884702 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:37.884629 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 15:39:37.884702 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:37.884647 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 15:39:37.884702 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:37.884659 2581 projected.go:196] Error preparing data for projected volume kube-api-access-9qv2b for pod openshift-network-diagnostics/network-check-target-kcjnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 15:39:37.884852 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:37.884721 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75d806d9-420d-4e93-bb55-a30b25dcd5b9-kube-api-access-9qv2b podName:75d806d9-420d-4e93-bb55-a30b25dcd5b9 nodeName:}" failed. No retries permitted until 2026-09-17 15:40:09.884701195 +0000 UTC m=+65.278668058 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9qv2b" (UniqueName: "kubernetes.io/projected/75d806d9-420d-4e93-bb55-a30b25dcd5b9-kube-api-access-9qv2b") pod "network-check-target-kcjnr" (UID: "75d806d9-420d-4e93-bb55-a30b25dcd5b9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 15:39:38.133865 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:38.133826 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtwf7" Sep 17 15:39:38.134074 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:38.133875 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjm5t" Sep 17 15:39:38.134074 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:38.133877 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcjnr" Sep 17 15:39:38.134074 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:38.133977 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtwf7" podUID="6841aae3-9f3e-439b-bc41-685e1c15baef" Sep 17 15:39:38.134241 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:38.134092 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fjm5t" podUID="87031c7d-d4f1-4a4b-8691-e93c3698118a" Sep 17 15:39:38.134241 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:38.134181 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kcjnr" podUID="75d806d9-420d-4e93-bb55-a30b25dcd5b9" Sep 17 15:39:38.897633 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:38.897604 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-207.ec2.internal" event="NodeReady" Sep 17 15:39:38.898100 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:38.897760 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 17 15:39:38.956542 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:38.956459 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wfnvz"] Sep 17 15:39:38.958527 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:38.958502 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wfnvz" Sep 17 15:39:38.961690 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:38.961663 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2fbs9\"" Sep 17 15:39:38.962236 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:38.962212 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 17 15:39:38.962617 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:38.962597 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-56c9v"] Sep 17 15:39:38.962690 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:38.962664 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 17 15:39:38.965432 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:38.965409 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-56c9v" Sep 17 15:39:38.967550 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:38.967527 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 17 15:39:38.967668 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:38.967585 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 17 15:39:38.967668 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:38.967662 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 17 15:39:38.968107 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:38.968086 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hgsvc\"" Sep 17 15:39:38.978236 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:38.974699 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wfnvz"] Sep 17 15:39:38.981533 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:38.981510 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-56c9v"] Sep 17 15:39:39.093789 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:39.093745 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd4c4e9b-c929-4dc5-8468-af8fb6cd29f8-cert\") pod \"ingress-canary-56c9v\" (UID: \"cd4c4e9b-c929-4dc5-8468-af8fb6cd29f8\") " pod="openshift-ingress-canary/ingress-canary-56c9v" Sep 17 15:39:39.093987 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:39.093797 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chgzt\" (UniqueName: \"kubernetes.io/projected/cd4c4e9b-c929-4dc5-8468-af8fb6cd29f8-kube-api-access-chgzt\") pod \"ingress-canary-56c9v\" (UID: \"cd4c4e9b-c929-4dc5-8468-af8fb6cd29f8\") " pod="openshift-ingress-canary/ingress-canary-56c9v" Sep 17 15:39:39.093987 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:39.093825 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59d788c0-fef9-42d2-b6c3-f2626f39261d-tmp-dir\") pod \"dns-default-wfnvz\" (UID: \"59d788c0-fef9-42d2-b6c3-f2626f39261d\") " pod="openshift-dns/dns-default-wfnvz" Sep 17 15:39:39.093987 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:39.093885 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrs2p\" (UniqueName: \"kubernetes.io/projected/59d788c0-fef9-42d2-b6c3-f2626f39261d-kube-api-access-xrs2p\") pod \"dns-default-wfnvz\" (UID: \"59d788c0-fef9-42d2-b6c3-f2626f39261d\") " pod="openshift-dns/dns-default-wfnvz" Sep 17 15:39:39.093987 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:39.093971 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59d788c0-fef9-42d2-b6c3-f2626f39261d-metrics-tls\") pod \"dns-default-wfnvz\" (UID: \"59d788c0-fef9-42d2-b6c3-f2626f39261d\") " pod="openshift-dns/dns-default-wfnvz" Sep 17 15:39:39.094182 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:39.093996 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/59d788c0-fef9-42d2-b6c3-f2626f39261d-config-volume\") pod \"dns-default-wfnvz\" (UID: \"59d788c0-fef9-42d2-b6c3-f2626f39261d\") " pod="openshift-dns/dns-default-wfnvz" Sep 17 15:39:39.194358 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:39.194318 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd4c4e9b-c929-4dc5-8468-af8fb6cd29f8-cert\") pod \"ingress-canary-56c9v\" (UID: \"cd4c4e9b-c929-4dc5-8468-af8fb6cd29f8\") " pod="openshift-ingress-canary/ingress-canary-56c9v" Sep 17 15:39:39.194358 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:39.194362 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chgzt\" (UniqueName: \"kubernetes.io/projected/cd4c4e9b-c929-4dc5-8468-af8fb6cd29f8-kube-api-access-chgzt\") pod \"ingress-canary-56c9v\" (UID: \"cd4c4e9b-c929-4dc5-8468-af8fb6cd29f8\") " pod="openshift-ingress-canary/ingress-canary-56c9v" Sep 17 15:39:39.194578 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:39.194385 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59d788c0-fef9-42d2-b6c3-f2626f39261d-tmp-dir\") pod \"dns-default-wfnvz\" (UID: \"59d788c0-fef9-42d2-b6c3-f2626f39261d\") " pod="openshift-dns/dns-default-wfnvz" Sep 17 15:39:39.194578 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:39.194410 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrs2p\" (UniqueName: \"kubernetes.io/projected/59d788c0-fef9-42d2-b6c3-f2626f39261d-kube-api-access-xrs2p\") pod \"dns-default-wfnvz\" (UID: \"59d788c0-fef9-42d2-b6c3-f2626f39261d\") " pod="openshift-dns/dns-default-wfnvz" Sep 17 15:39:39.194578 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:39.194455 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59d788c0-fef9-42d2-b6c3-f2626f39261d-metrics-tls\") pod \"dns-default-wfnvz\" (UID: \"59d788c0-fef9-42d2-b6c3-f2626f39261d\") " pod="openshift-dns/dns-default-wfnvz" Sep 17 15:39:39.194578 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:39.194482 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/59d788c0-fef9-42d2-b6c3-f2626f39261d-config-volume\") pod \"dns-default-wfnvz\" (UID: \"59d788c0-fef9-42d2-b6c3-f2626f39261d\") " pod="openshift-dns/dns-default-wfnvz" Sep 17 15:39:39.194773 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:39.194749 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59d788c0-fef9-42d2-b6c3-f2626f39261d-tmp-dir\") pod \"dns-default-wfnvz\" (UID: \"59d788c0-fef9-42d2-b6c3-f2626f39261d\") " pod="openshift-dns/dns-default-wfnvz" Sep 17 15:39:39.194867 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:39.194853 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 15:39:39.194949 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:39.194941 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59d788c0-fef9-42d2-b6c3-f2626f39261d-metrics-tls podName:59d788c0-fef9-42d2-b6c3-f2626f39261d nodeName:}" failed. No retries permitted until 2026-09-17 15:39:39.694922282 +0000 UTC m=+35.088889146 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59d788c0-fef9-42d2-b6c3-f2626f39261d-metrics-tls") pod "dns-default-wfnvz" (UID: "59d788c0-fef9-42d2-b6c3-f2626f39261d") : secret "dns-default-metrics-tls" not found Sep 17 15:39:39.195135 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:39.195103 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/59d788c0-fef9-42d2-b6c3-f2626f39261d-config-volume\") pod \"dns-default-wfnvz\" (UID: \"59d788c0-fef9-42d2-b6c3-f2626f39261d\") " pod="openshift-dns/dns-default-wfnvz" Sep 17 15:39:39.199345 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:39.199324 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd4c4e9b-c929-4dc5-8468-af8fb6cd29f8-cert\") pod \"ingress-canary-56c9v\" (UID: \"cd4c4e9b-c929-4dc5-8468-af8fb6cd29f8\") " pod="openshift-ingress-canary/ingress-canary-56c9v" Sep 17 15:39:39.206342 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:39.206304 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrs2p\" (UniqueName: \"kubernetes.io/projected/59d788c0-fef9-42d2-b6c3-f2626f39261d-kube-api-access-xrs2p\") pod \"dns-default-wfnvz\" (UID: \"59d788c0-fef9-42d2-b6c3-f2626f39261d\") " pod="openshift-dns/dns-default-wfnvz" Sep 17 15:39:39.207187 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:39.207125 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chgzt\" (UniqueName: \"kubernetes.io/projected/cd4c4e9b-c929-4dc5-8468-af8fb6cd29f8-kube-api-access-chgzt\") pod \"ingress-canary-56c9v\" (UID: \"cd4c4e9b-c929-4dc5-8468-af8fb6cd29f8\") " pod="openshift-ingress-canary/ingress-canary-56c9v" Sep 17 15:39:39.279275 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:39.279233 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-56c9v" Sep 17 15:39:39.572332 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:39.572101 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-56c9v"] Sep 17 15:39:39.576546 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:39:39.576520 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd4c4e9b_c929_4dc5_8468_af8fb6cd29f8.slice/crio-fecfccd14568df3b1bc171e471360ccc869321bf69557a94a3ed05e6c1aff4f9 WatchSource:0}: Error finding container fecfccd14568df3b1bc171e471360ccc869321bf69557a94a3ed05e6c1aff4f9: Status 404 returned error can't find the container with id fecfccd14568df3b1bc171e471360ccc869321bf69557a94a3ed05e6c1aff4f9 Sep 17 15:39:39.699125 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:39.699090 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59d788c0-fef9-42d2-b6c3-f2626f39261d-metrics-tls\") pod \"dns-default-wfnvz\" (UID: \"59d788c0-fef9-42d2-b6c3-f2626f39261d\") " pod="openshift-dns/dns-default-wfnvz" Sep 17 15:39:39.699303 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:39.699265 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 15:39:39.699368 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:39.699346 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59d788c0-fef9-42d2-b6c3-f2626f39261d-metrics-tls podName:59d788c0-fef9-42d2-b6c3-f2626f39261d nodeName:}" failed. No retries permitted until 2026-09-17 15:39:40.699324046 +0000 UTC m=+36.093290899 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59d788c0-fef9-42d2-b6c3-f2626f39261d-metrics-tls") pod "dns-default-wfnvz" (UID: "59d788c0-fef9-42d2-b6c3-f2626f39261d") : secret "dns-default-metrics-tls" not found Sep 17 15:39:40.134236 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:40.134198 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcjnr" Sep 17 15:39:40.134677 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:40.134250 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtwf7" Sep 17 15:39:40.134677 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:40.134199 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjm5t" Sep 17 15:39:40.136771 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:40.136745 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 15:39:40.137515 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:40.137465 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 15:39:40.137515 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:40.137486 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 15:39:40.137515 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:40.137487 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 15:39:40.137515 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:40.137503 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ddz86\"" Sep 17 15:39:40.137768 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:40.137488 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7j2g9\"" Sep 17 15:39:40.530050 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:40.529959 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-56c9v" event={"ID":"cd4c4e9b-c929-4dc5-8468-af8fb6cd29f8","Type":"ContainerStarted","Data":"fecfccd14568df3b1bc171e471360ccc869321bf69557a94a3ed05e6c1aff4f9"} Sep 17 15:39:40.708254 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:40.708214 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59d788c0-fef9-42d2-b6c3-f2626f39261d-metrics-tls\") pod \"dns-default-wfnvz\" (UID: \"59d788c0-fef9-42d2-b6c3-f2626f39261d\") " pod="openshift-dns/dns-default-wfnvz" Sep 17 15:39:40.708414 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:40.708384 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 15:39:40.708486 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:40.708462 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59d788c0-fef9-42d2-b6c3-f2626f39261d-metrics-tls podName:59d788c0-fef9-42d2-b6c3-f2626f39261d nodeName:}" failed. No retries permitted until 2026-09-17 15:39:42.708445283 +0000 UTC m=+38.102412147 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59d788c0-fef9-42d2-b6c3-f2626f39261d-metrics-tls") pod "dns-default-wfnvz" (UID: "59d788c0-fef9-42d2-b6c3-f2626f39261d") : secret "dns-default-metrics-tls" not found Sep 17 15:39:41.537281 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:41.537242 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dzqxm" event={"ID":"fde60d54-dbed-4e5e-8103-4809b3074a8c","Type":"ContainerStarted","Data":"2e2e1420d221e2ed332593ffd6daa56cd4cceec2b6fe84e6e8ec58124503a094"} Sep 17 15:39:42.547576 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:42.547531 2581 generic.go:356] "Generic (PLEG): container finished" podID="fde60d54-dbed-4e5e-8103-4809b3074a8c" containerID="2e2e1420d221e2ed332593ffd6daa56cd4cceec2b6fe84e6e8ec58124503a094" exitCode=0 Sep 17 15:39:42.548095 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:42.547610 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dzqxm" event={"ID":"fde60d54-dbed-4e5e-8103-4809b3074a8c","Type":"ContainerDied","Data":"2e2e1420d221e2ed332593ffd6daa56cd4cceec2b6fe84e6e8ec58124503a094"} Sep 17 15:39:42.726910 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:42.726856 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59d788c0-fef9-42d2-b6c3-f2626f39261d-metrics-tls\") pod \"dns-default-wfnvz\" (UID: \"59d788c0-fef9-42d2-b6c3-f2626f39261d\") " pod="openshift-dns/dns-default-wfnvz" Sep 17 15:39:42.727059 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:42.727032 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 15:39:42.727124 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:42.727112 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59d788c0-fef9-42d2-b6c3-f2626f39261d-metrics-tls podName:59d788c0-fef9-42d2-b6c3-f2626f39261d nodeName:}" failed. No retries permitted until 2026-09-17 15:39:46.727090937 +0000 UTC m=+42.121057803 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59d788c0-fef9-42d2-b6c3-f2626f39261d-metrics-tls") pod "dns-default-wfnvz" (UID: "59d788c0-fef9-42d2-b6c3-f2626f39261d") : secret "dns-default-metrics-tls" not found Sep 17 15:39:43.552963 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:43.552927 2581 generic.go:356] "Generic (PLEG): container finished" podID="fde60d54-dbed-4e5e-8103-4809b3074a8c" containerID="23a9db34714f4e4b8f194ca018f230298046dd52519256073f5ea2edd60784c0" exitCode=0 Sep 17 15:39:43.553427 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:43.552978 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dzqxm" event={"ID":"fde60d54-dbed-4e5e-8103-4809b3074a8c","Type":"ContainerDied","Data":"23a9db34714f4e4b8f194ca018f230298046dd52519256073f5ea2edd60784c0"} Sep 17 15:39:44.556645 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:44.556600 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-56c9v" event={"ID":"cd4c4e9b-c929-4dc5-8468-af8fb6cd29f8","Type":"ContainerStarted","Data":"97b057631ed26b61a80ea9ce607b0bd8325f0ae43eef2d81203669aaa2a986ff"} Sep 17 15:39:44.560125 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:44.560101 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dzqxm" event={"ID":"fde60d54-dbed-4e5e-8103-4809b3074a8c","Type":"ContainerStarted","Data":"bd7a46e3786a6e2bedaee8ab9f9ca145b86ff2b4cc0974a7a47ca049a00cabed"} Sep 17 15:39:44.575123 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:44.575062 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-56c9v" podStartSLOduration=2.356243677 podStartE2EDuration="6.57504574s" totalImagesPullingTime="4.218802063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:39:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:44.574813501 +0000 UTC m=+39.968780372" watchObservedRunningTime="2026-09-17 15:39:44.57504574 +0000 UTC m=+39.969012613" Sep 17 15:39:44.601239 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:44.601180 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dzqxm" podStartSLOduration=9.400300531 podStartE2EDuration="39.601162829s" totalImagesPullingTime="30.200862298s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:39:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:44.600674041 +0000 UTC m=+39.994640912" watchObservedRunningTime="2026-09-17 15:39:44.601162829 +0000 UTC m=+39.995129692" Sep 17 15:39:46.755948 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:46.755880 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59d788c0-fef9-42d2-b6c3-f2626f39261d-metrics-tls\") pod \"dns-default-wfnvz\" (UID: \"59d788c0-fef9-42d2-b6c3-f2626f39261d\") " pod="openshift-dns/dns-default-wfnvz" Sep 17 15:39:46.756351 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:46.756035 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 15:39:46.756351 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:46.756147 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59d788c0-fef9-42d2-b6c3-f2626f39261d-metrics-tls podName:59d788c0-fef9-42d2-b6c3-f2626f39261d nodeName:}" failed. No retries permitted until 2026-09-17 15:39:54.756130262 +0000 UTC m=+50.150097112 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59d788c0-fef9-42d2-b6c3-f2626f39261d-metrics-tls") pod "dns-default-wfnvz" (UID: "59d788c0-fef9-42d2-b6c3-f2626f39261d") : secret "dns-default-metrics-tls" not found Sep 17 15:39:54.811735 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:39:54.811689 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59d788c0-fef9-42d2-b6c3-f2626f39261d-metrics-tls\") pod \"dns-default-wfnvz\" (UID: \"59d788c0-fef9-42d2-b6c3-f2626f39261d\") " pod="openshift-dns/dns-default-wfnvz" Sep 17 15:39:54.812197 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:54.811806 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 15:39:54.812197 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:39:54.811883 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59d788c0-fef9-42d2-b6c3-f2626f39261d-metrics-tls podName:59d788c0-fef9-42d2-b6c3-f2626f39261d nodeName:}" failed. No retries permitted until 2026-09-17 15:40:10.811870041 +0000 UTC m=+66.205836892 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59d788c0-fef9-42d2-b6c3-f2626f39261d-metrics-tls") pod "dns-default-wfnvz" (UID: "59d788c0-fef9-42d2-b6c3-f2626f39261d") : secret "dns-default-metrics-tls" not found Sep 17 15:40:04.529770 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:04.529739 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rvbm6" Sep 17 15:40:09.815225 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:09.815181 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6841aae3-9f3e-439b-bc41-685e1c15baef-original-pull-secret\") pod \"global-pull-secret-syncer-jtwf7\" (UID: \"6841aae3-9f3e-439b-bc41-685e1c15baef\") " pod="kube-system/global-pull-secret-syncer-jtwf7" Sep 17 15:40:09.815225 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:09.815231 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87031c7d-d4f1-4a4b-8691-e93c3698118a-metrics-certs\") pod \"network-metrics-daemon-fjm5t\" (UID: \"87031c7d-d4f1-4a4b-8691-e93c3698118a\") " pod="openshift-multus/network-metrics-daemon-fjm5t" Sep 17 15:40:09.817621 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:09.817589 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 15:40:09.817748 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:09.817621 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 15:40:09.825589 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:09.825558 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 17 15:40:09.825716 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:09.825635 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87031c7d-d4f1-4a4b-8691-e93c3698118a-metrics-certs podName:87031c7d-d4f1-4a4b-8691-e93c3698118a nodeName:}" failed. No retries permitted until 2026-09-17 15:41:13.825615256 +0000 UTC m=+129.219582105 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87031c7d-d4f1-4a4b-8691-e93c3698118a-metrics-certs") pod "network-metrics-daemon-fjm5t" (UID: "87031c7d-d4f1-4a4b-8691-e93c3698118a") : secret "metrics-daemon-secret" not found Sep 17 15:40:09.828590 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:09.828570 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6841aae3-9f3e-439b-bc41-685e1c15baef-original-pull-secret\") pod \"global-pull-secret-syncer-jtwf7\" (UID: \"6841aae3-9f3e-439b-bc41-685e1c15baef\") " pod="kube-system/global-pull-secret-syncer-jtwf7" Sep 17 15:40:09.859861 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:09.859820 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtwf7" Sep 17 15:40:09.916315 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:09.916283 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qv2b\" (UniqueName: \"kubernetes.io/projected/75d806d9-420d-4e93-bb55-a30b25dcd5b9-kube-api-access-9qv2b\") pod \"network-check-target-kcjnr\" (UID: \"75d806d9-420d-4e93-bb55-a30b25dcd5b9\") " pod="openshift-network-diagnostics/network-check-target-kcjnr" Sep 17 15:40:09.918979 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:09.918961 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 15:40:09.929642 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:09.929618 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 15:40:09.940203 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:09.940178 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qv2b\" (UniqueName: \"kubernetes.io/projected/75d806d9-420d-4e93-bb55-a30b25dcd5b9-kube-api-access-9qv2b\") pod \"network-check-target-kcjnr\" (UID: \"75d806d9-420d-4e93-bb55-a30b25dcd5b9\") " pod="openshift-network-diagnostics/network-check-target-kcjnr" Sep 17 15:40:10.130429 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:10.130394 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jtwf7"] Sep 17 15:40:10.134061 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:40:10.134025 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6841aae3_9f3e_439b_bc41_685e1c15baef.slice/crio-9b3cc5fdbd86991853e3b0c97dae931ccb73b806f32a91098fa41d83f1173393 WatchSource:0}: Error finding container 9b3cc5fdbd86991853e3b0c97dae931ccb73b806f32a91098fa41d83f1173393: Status 404 returned error can't find the container with id 9b3cc5fdbd86991853e3b0c97dae931ccb73b806f32a91098fa41d83f1173393 Sep 17 15:40:10.148378 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:10.148353 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7j2g9\"" Sep 17 15:40:10.156461 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:10.156439 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcjnr" Sep 17 15:40:10.424832 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:10.424735 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kcjnr"] Sep 17 15:40:10.429147 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:40:10.429119 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75d806d9_420d_4e93_bb55_a30b25dcd5b9.slice/crio-d4788eadfeb82101af6ca71a7d282b31fb02176aa030dc1da484013a4f9c890e WatchSource:0}: Error finding container d4788eadfeb82101af6ca71a7d282b31fb02176aa030dc1da484013a4f9c890e: Status 404 returned error can't find the container with id d4788eadfeb82101af6ca71a7d282b31fb02176aa030dc1da484013a4f9c890e Sep 17 15:40:10.625294 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:10.625256 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kcjnr" event={"ID":"75d806d9-420d-4e93-bb55-a30b25dcd5b9","Type":"ContainerStarted","Data":"d4788eadfeb82101af6ca71a7d282b31fb02176aa030dc1da484013a4f9c890e"} Sep 17 15:40:10.626553 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:10.626527 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jtwf7" event={"ID":"6841aae3-9f3e-439b-bc41-685e1c15baef","Type":"ContainerStarted","Data":"9b3cc5fdbd86991853e3b0c97dae931ccb73b806f32a91098fa41d83f1173393"} Sep 17 15:40:10.823738 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:10.823636 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59d788c0-fef9-42d2-b6c3-f2626f39261d-metrics-tls\") pod \"dns-default-wfnvz\" (UID: \"59d788c0-fef9-42d2-b6c3-f2626f39261d\") " pod="openshift-dns/dns-default-wfnvz" Sep 17 15:40:10.824187 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:10.823812 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 15:40:10.824187 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:10.823901 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59d788c0-fef9-42d2-b6c3-f2626f39261d-metrics-tls podName:59d788c0-fef9-42d2-b6c3-f2626f39261d nodeName:}" failed. No retries permitted until 2026-09-17 15:40:42.823871876 +0000 UTC m=+98.217838725 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59d788c0-fef9-42d2-b6c3-f2626f39261d-metrics-tls") pod "dns-default-wfnvz" (UID: "59d788c0-fef9-42d2-b6c3-f2626f39261d") : secret "dns-default-metrics-tls" not found Sep 17 15:40:13.560107 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.560064 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-hrmwr"] Sep 17 15:40:13.561830 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.561811 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-hrmwr" Sep 17 15:40:13.569143 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.566759 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-w4dd2\"" Sep 17 15:40:13.569143 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.566838 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 17 15:40:13.569143 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.566867 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 17 15:40:13.569143 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.567011 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 17 15:40:13.569143 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.567256 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 17 15:40:13.569143 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.568245 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-86d54f56b-d42z6"] Sep 17 15:40:13.570321 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.570300 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-86d54f56b-d42z6" Sep 17 15:40:13.571075 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.571052 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 17 15:40:13.576427 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.576406 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 17 15:40:13.576664 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.576647 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 17 15:40:13.576664 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.576666 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-hrmwr"] Sep 17 15:40:13.576812 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.576800 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 17 15:40:13.577190 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.577169 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 17 15:40:13.577290 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.577189 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-snnpx\"" Sep 17 15:40:13.577290 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.577263 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 17 15:40:13.577465 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.577354 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 17 15:40:13.583792 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.583770 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-86d54f56b-d42z6"] Sep 17 15:40:13.642103 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.642072 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48-trusted-ca-bundle\") pod \"insights-operator-5844b856db-hrmwr\" (UID: \"d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48\") " pod="openshift-insights/insights-operator-5844b856db-hrmwr" Sep 17 15:40:13.642103 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.642109 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48-serving-cert\") pod \"insights-operator-5844b856db-hrmwr\" (UID: \"d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48\") " pod="openshift-insights/insights-operator-5844b856db-hrmwr" Sep 17 15:40:13.642361 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.642133 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-default-certificate\") pod \"router-default-86d54f56b-d42z6\" (UID: \"93ecf8b9-4484-4e06-a567-1d192fe5ce5e\") " pod="openshift-ingress/router-default-86d54f56b-d42z6" Sep 17 15:40:13.642361 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.642207 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48-tmp\") pod \"insights-operator-5844b856db-hrmwr\" (UID: \"d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48\") " pod="openshift-insights/insights-operator-5844b856db-hrmwr" Sep 17 15:40:13.642361 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.642250 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-service-ca-bundle\") pod \"router-default-86d54f56b-d42z6\" (UID: \"93ecf8b9-4484-4e06-a567-1d192fe5ce5e\") " pod="openshift-ingress/router-default-86d54f56b-d42z6" Sep 17 15:40:13.642361 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.642319 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48-snapshots\") pod \"insights-operator-5844b856db-hrmwr\" (UID: \"d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48\") " pod="openshift-insights/insights-operator-5844b856db-hrmwr" Sep 17 15:40:13.642361 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.642346 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48-service-ca-bundle\") pod \"insights-operator-5844b856db-hrmwr\" (UID: \"d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48\") " pod="openshift-insights/insights-operator-5844b856db-hrmwr" Sep 17 15:40:13.642573 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.642378 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-stats-auth\") pod \"router-default-86d54f56b-d42z6\" (UID: \"93ecf8b9-4484-4e06-a567-1d192fe5ce5e\") " pod="openshift-ingress/router-default-86d54f56b-d42z6" Sep 17 15:40:13.642573 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.642414 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-metrics-certs\") pod \"router-default-86d54f56b-d42z6\" (UID: \"93ecf8b9-4484-4e06-a567-1d192fe5ce5e\") " pod="openshift-ingress/router-default-86d54f56b-d42z6" Sep 17 15:40:13.642573 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.642438 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44ldd\" (UniqueName: \"kubernetes.io/projected/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-kube-api-access-44ldd\") pod \"router-default-86d54f56b-d42z6\" (UID: \"93ecf8b9-4484-4e06-a567-1d192fe5ce5e\") " pod="openshift-ingress/router-default-86d54f56b-d42z6" Sep 17 15:40:13.642573 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.642463 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl4v4\" (UniqueName: \"kubernetes.io/projected/d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48-kube-api-access-zl4v4\") pod \"insights-operator-5844b856db-hrmwr\" (UID: \"d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48\") " pod="openshift-insights/insights-operator-5844b856db-hrmwr" Sep 17 15:40:13.654704 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.654671 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xvldp"] Sep 17 15:40:13.656473 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.656445 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-z58zx"] Sep 17 15:40:13.656607 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.656588 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xvldp" Sep 17 15:40:13.658188 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.658168 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-z58zx" Sep 17 15:40:13.658753 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.658718 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 17 15:40:13.658882 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.658855 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 17 15:40:13.658999 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.658884 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-vhkl2\"" Sep 17 15:40:13.658999 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.658885 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 17 15:40:13.659185 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.659169 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 17 15:40:13.660206 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.660180 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 17 15:40:13.660432 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.660413 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-sf6kn\"" Sep 17 15:40:13.660537 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.660468 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 17 15:40:13.660931 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.660763 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 17 15:40:13.672858 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.672834 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xvldp"] Sep 17 15:40:13.676217 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.674885 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-z58zx"] Sep 17 15:40:13.742961 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.742920 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48-snapshots\") pod \"insights-operator-5844b856db-hrmwr\" (UID: \"d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48\") " pod="openshift-insights/insights-operator-5844b856db-hrmwr" Sep 17 15:40:13.742961 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.742967 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48-service-ca-bundle\") pod \"insights-operator-5844b856db-hrmwr\" (UID: \"d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48\") " pod="openshift-insights/insights-operator-5844b856db-hrmwr" Sep 17 15:40:13.743182 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.743006 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-stats-auth\") pod \"router-default-86d54f56b-d42z6\" (UID: \"93ecf8b9-4484-4e06-a567-1d192fe5ce5e\") " pod="openshift-ingress/router-default-86d54f56b-d42z6" Sep 17 15:40:13.743182 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.743042 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-metrics-certs\") pod \"router-default-86d54f56b-d42z6\" (UID: \"93ecf8b9-4484-4e06-a567-1d192fe5ce5e\") " pod="openshift-ingress/router-default-86d54f56b-d42z6" Sep 17 15:40:13.743182 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.743065 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44ldd\" (UniqueName: \"kubernetes.io/projected/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-kube-api-access-44ldd\") pod \"router-default-86d54f56b-d42z6\" (UID: \"93ecf8b9-4484-4e06-a567-1d192fe5ce5e\") " pod="openshift-ingress/router-default-86d54f56b-d42z6" Sep 17 15:40:13.743182 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.743097 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7960de71-b450-4dcd-b112-b20c91c1f63d-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-z58zx\" (UID: \"7960de71-b450-4dcd-b112-b20c91c1f63d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-z58zx" Sep 17 15:40:13.743182 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.743124 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl4v4\" (UniqueName: \"kubernetes.io/projected/d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48-kube-api-access-zl4v4\") pod \"insights-operator-5844b856db-hrmwr\" (UID: \"d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48\") " pod="openshift-insights/insights-operator-5844b856db-hrmwr" Sep 17 15:40:13.743182 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.743150 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b17688ff-c016-4fd1-9b35-c50ec5100d61-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-xvldp\" (UID: \"b17688ff-c016-4fd1-9b35-c50ec5100d61\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xvldp" Sep 17 15:40:13.743479 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.743198 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48-trusted-ca-bundle\") pod \"insights-operator-5844b856db-hrmwr\" (UID: \"d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48\") " pod="openshift-insights/insights-operator-5844b856db-hrmwr" Sep 17 15:40:13.743479 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:13.743217 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 15:40:13.743479 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:13.743291 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-metrics-certs podName:93ecf8b9-4484-4e06-a567-1d192fe5ce5e nodeName:}" failed. No retries permitted until 2026-09-17 15:40:14.243271163 +0000 UTC m=+69.637238027 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-metrics-certs") pod "router-default-86d54f56b-d42z6" (UID: "93ecf8b9-4484-4e06-a567-1d192fe5ce5e") : secret "router-metrics-certs-default" not found Sep 17 15:40:13.743479 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.743223 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48-serving-cert\") pod \"insights-operator-5844b856db-hrmwr\" (UID: \"d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48\") " pod="openshift-insights/insights-operator-5844b856db-hrmwr" Sep 17 15:40:13.743479 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.743401 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-default-certificate\") pod \"router-default-86d54f56b-d42z6\" (UID: \"93ecf8b9-4484-4e06-a567-1d192fe5ce5e\") " pod="openshift-ingress/router-default-86d54f56b-d42z6" Sep 17 15:40:13.743479 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.743440 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48-tmp\") pod \"insights-operator-5844b856db-hrmwr\" (UID: \"d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48\") " pod="openshift-insights/insights-operator-5844b856db-hrmwr" Sep 17 15:40:13.743479 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.743462 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-service-ca-bundle\") pod \"router-default-86d54f56b-d42z6\" (UID: \"93ecf8b9-4484-4e06-a567-1d192fe5ce5e\") " pod="openshift-ingress/router-default-86d54f56b-d42z6" Sep 17 15:40:13.743784 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.743523 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpgfc\" (UniqueName: \"kubernetes.io/projected/b17688ff-c016-4fd1-9b35-c50ec5100d61-kube-api-access-dpgfc\") pod \"kube-storage-version-migrator-operator-6c8f84f897-xvldp\" (UID: \"b17688ff-c016-4fd1-9b35-c50ec5100d61\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xvldp" Sep 17 15:40:13.743784 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.743558 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl586\" (UniqueName: \"kubernetes.io/projected/7960de71-b450-4dcd-b112-b20c91c1f63d-kube-api-access-nl586\") pod \"cluster-samples-operator-86499c89c4-z58zx\" (UID: \"7960de71-b450-4dcd-b112-b20c91c1f63d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-z58zx" Sep 17 15:40:13.743784 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.743583 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b17688ff-c016-4fd1-9b35-c50ec5100d61-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-xvldp\" (UID: \"b17688ff-c016-4fd1-9b35-c50ec5100d61\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xvldp" Sep 17 15:40:13.743784 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.743704 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48-snapshots\") pod \"insights-operator-5844b856db-hrmwr\" (UID: \"d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48\") " pod="openshift-insights/insights-operator-5844b856db-hrmwr" Sep 17 15:40:13.744006 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:13.743817 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-service-ca-bundle podName:93ecf8b9-4484-4e06-a567-1d192fe5ce5e nodeName:}" failed. No retries permitted until 2026-09-17 15:40:14.243788273 +0000 UTC m=+69.637755144 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-service-ca-bundle") pod "router-default-86d54f56b-d42z6" (UID: "93ecf8b9-4484-4e06-a567-1d192fe5ce5e") : configmap references non-existent config key: service-ca.crt Sep 17 15:40:13.744119 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.744063 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48-tmp\") pod \"insights-operator-5844b856db-hrmwr\" (UID: \"d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48\") " pod="openshift-insights/insights-operator-5844b856db-hrmwr" Sep 17 15:40:13.744335 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.744301 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48-service-ca-bundle\") pod \"insights-operator-5844b856db-hrmwr\" (UID: \"d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48\") " pod="openshift-insights/insights-operator-5844b856db-hrmwr" Sep 17 15:40:13.744654 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.744631 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48-trusted-ca-bundle\") pod \"insights-operator-5844b856db-hrmwr\" (UID: \"d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48\") " pod="openshift-insights/insights-operator-5844b856db-hrmwr" Sep 17 15:40:13.746570 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.746548 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-default-certificate\") pod \"router-default-86d54f56b-d42z6\" (UID: \"93ecf8b9-4484-4e06-a567-1d192fe5ce5e\") " pod="openshift-ingress/router-default-86d54f56b-d42z6" Sep 17 15:40:13.746660 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.746547 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48-serving-cert\") pod \"insights-operator-5844b856db-hrmwr\" (UID: \"d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48\") " pod="openshift-insights/insights-operator-5844b856db-hrmwr" Sep 17 15:40:13.746660 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.746597 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-stats-auth\") pod \"router-default-86d54f56b-d42z6\" (UID: \"93ecf8b9-4484-4e06-a567-1d192fe5ce5e\") " pod="openshift-ingress/router-default-86d54f56b-d42z6" Sep 17 15:40:13.754683 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.754662 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl4v4\" (UniqueName: \"kubernetes.io/projected/d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48-kube-api-access-zl4v4\") pod \"insights-operator-5844b856db-hrmwr\" (UID: \"d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48\") " pod="openshift-insights/insights-operator-5844b856db-hrmwr" Sep 17 15:40:13.754778 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.754757 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44ldd\" (UniqueName: \"kubernetes.io/projected/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-kube-api-access-44ldd\") pod \"router-default-86d54f56b-d42z6\" (UID: \"93ecf8b9-4484-4e06-a567-1d192fe5ce5e\") " pod="openshift-ingress/router-default-86d54f56b-d42z6" Sep 17 15:40:13.844321 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.844221 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpgfc\" (UniqueName: \"kubernetes.io/projected/b17688ff-c016-4fd1-9b35-c50ec5100d61-kube-api-access-dpgfc\") pod \"kube-storage-version-migrator-operator-6c8f84f897-xvldp\" (UID: \"b17688ff-c016-4fd1-9b35-c50ec5100d61\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xvldp" Sep 17 15:40:13.844321 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.844276 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl586\" (UniqueName: \"kubernetes.io/projected/7960de71-b450-4dcd-b112-b20c91c1f63d-kube-api-access-nl586\") pod \"cluster-samples-operator-86499c89c4-z58zx\" (UID: \"7960de71-b450-4dcd-b112-b20c91c1f63d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-z58zx" Sep 17 15:40:13.844321 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.844302 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b17688ff-c016-4fd1-9b35-c50ec5100d61-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-xvldp\" (UID: \"b17688ff-c016-4fd1-9b35-c50ec5100d61\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xvldp" Sep 17 15:40:13.844597 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.844374 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7960de71-b450-4dcd-b112-b20c91c1f63d-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-z58zx\" (UID: \"7960de71-b450-4dcd-b112-b20c91c1f63d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-z58zx" Sep 17 15:40:13.844597 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.844402 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b17688ff-c016-4fd1-9b35-c50ec5100d61-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-xvldp\" (UID: \"b17688ff-c016-4fd1-9b35-c50ec5100d61\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xvldp" Sep 17 15:40:13.844597 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:13.844547 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 15:40:13.844708 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:13.844630 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7960de71-b450-4dcd-b112-b20c91c1f63d-samples-operator-tls podName:7960de71-b450-4dcd-b112-b20c91c1f63d nodeName:}" failed. No retries permitted until 2026-09-17 15:40:14.344613172 +0000 UTC m=+69.738580030 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7960de71-b450-4dcd-b112-b20c91c1f63d-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-z58zx" (UID: "7960de71-b450-4dcd-b112-b20c91c1f63d") : secret "samples-operator-tls" not found Sep 17 15:40:13.844940 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.844919 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b17688ff-c016-4fd1-9b35-c50ec5100d61-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-xvldp\" (UID: \"b17688ff-c016-4fd1-9b35-c50ec5100d61\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xvldp" Sep 17 15:40:13.847274 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.847250 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b17688ff-c016-4fd1-9b35-c50ec5100d61-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-xvldp\" (UID: \"b17688ff-c016-4fd1-9b35-c50ec5100d61\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xvldp" Sep 17 15:40:13.855238 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.855210 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpgfc\" (UniqueName: \"kubernetes.io/projected/b17688ff-c016-4fd1-9b35-c50ec5100d61-kube-api-access-dpgfc\") pod \"kube-storage-version-migrator-operator-6c8f84f897-xvldp\" (UID: \"b17688ff-c016-4fd1-9b35-c50ec5100d61\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xvldp" Sep 17 15:40:13.855968 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.855946 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl586\" (UniqueName: \"kubernetes.io/projected/7960de71-b450-4dcd-b112-b20c91c1f63d-kube-api-access-nl586\") pod \"cluster-samples-operator-86499c89c4-z58zx\" (UID: \"7960de71-b450-4dcd-b112-b20c91c1f63d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-z58zx" Sep 17 15:40:13.877697 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.877661 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-hrmwr" Sep 17 15:40:13.967964 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:13.967935 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xvldp" Sep 17 15:40:14.027816 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:14.027772 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-kjss7"] Sep 17 15:40:14.030590 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:14.030569 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-kjss7" Sep 17 15:40:14.034758 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:14.034737 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-s4wj4\"" Sep 17 15:40:14.044010 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:14.043984 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-kjss7"] Sep 17 15:40:14.046020 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:14.045996 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bc79\" (UniqueName: \"kubernetes.io/projected/9b63cb52-0a1c-4581-b605-9ecb5aee6d16-kube-api-access-6bc79\") pod \"network-check-source-6f8b768455-kjss7\" (UID: \"9b63cb52-0a1c-4581-b605-9ecb5aee6d16\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-kjss7" Sep 17 15:40:14.147024 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:14.146980 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bc79\" (UniqueName: \"kubernetes.io/projected/9b63cb52-0a1c-4581-b605-9ecb5aee6d16-kube-api-access-6bc79\") pod \"network-check-source-6f8b768455-kjss7\" (UID: \"9b63cb52-0a1c-4581-b605-9ecb5aee6d16\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-kjss7" Sep 17 15:40:14.159300 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:14.159265 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bc79\" (UniqueName: \"kubernetes.io/projected/9b63cb52-0a1c-4581-b605-9ecb5aee6d16-kube-api-access-6bc79\") pod \"network-check-source-6f8b768455-kjss7\" (UID: \"9b63cb52-0a1c-4581-b605-9ecb5aee6d16\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-kjss7" Sep 17 15:40:14.248409 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:14.248369 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-metrics-certs\") pod \"router-default-86d54f56b-d42z6\" (UID: \"93ecf8b9-4484-4e06-a567-1d192fe5ce5e\") " pod="openshift-ingress/router-default-86d54f56b-d42z6" Sep 17 15:40:14.248577 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:14.248439 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-service-ca-bundle\") pod \"router-default-86d54f56b-d42z6\" (UID: \"93ecf8b9-4484-4e06-a567-1d192fe5ce5e\") " pod="openshift-ingress/router-default-86d54f56b-d42z6" Sep 17 15:40:14.248577 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:14.248545 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 15:40:14.248685 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:14.248607 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-service-ca-bundle podName:93ecf8b9-4484-4e06-a567-1d192fe5ce5e nodeName:}" failed. No retries permitted until 2026-09-17 15:40:15.248585824 +0000 UTC m=+70.642552698 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-service-ca-bundle") pod "router-default-86d54f56b-d42z6" (UID: "93ecf8b9-4484-4e06-a567-1d192fe5ce5e") : configmap references non-existent config key: service-ca.crt Sep 17 15:40:14.248685 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:14.248630 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-metrics-certs podName:93ecf8b9-4484-4e06-a567-1d192fe5ce5e nodeName:}" failed. No retries permitted until 2026-09-17 15:40:15.248620863 +0000 UTC m=+70.642587719 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-metrics-certs") pod "router-default-86d54f56b-d42z6" (UID: "93ecf8b9-4484-4e06-a567-1d192fe5ce5e") : secret "router-metrics-certs-default" not found Sep 17 15:40:14.340936 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:14.340878 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-kjss7" Sep 17 15:40:14.349260 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:14.349225 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7960de71-b450-4dcd-b112-b20c91c1f63d-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-z58zx\" (UID: \"7960de71-b450-4dcd-b112-b20c91c1f63d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-z58zx" Sep 17 15:40:14.349417 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:14.349394 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 15:40:14.349552 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:14.349479 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7960de71-b450-4dcd-b112-b20c91c1f63d-samples-operator-tls podName:7960de71-b450-4dcd-b112-b20c91c1f63d nodeName:}" failed. No retries permitted until 2026-09-17 15:40:15.349455728 +0000 UTC m=+70.743422577 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7960de71-b450-4dcd-b112-b20c91c1f63d-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-z58zx" (UID: "7960de71-b450-4dcd-b112-b20c91c1f63d") : secret "samples-operator-tls" not found Sep 17 15:40:15.246302 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:15.245104 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-hrmwr"] Sep 17 15:40:15.248799 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:15.248770 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xvldp"] Sep 17 15:40:15.249957 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:15.249501 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-kjss7"] Sep 17 15:40:15.249957 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:40:15.249709 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd64fbb0e_4f31_4bc1_a6f6_f8d517fc0b48.slice/crio-a6a20a235a43c7de5fccb1a13f4cad0ee574acd610f9385006ec9bf50c1f11f9 WatchSource:0}: Error finding container a6a20a235a43c7de5fccb1a13f4cad0ee574acd610f9385006ec9bf50c1f11f9: Status 404 returned error can't find the container with id a6a20a235a43c7de5fccb1a13f4cad0ee574acd610f9385006ec9bf50c1f11f9 Sep 17 15:40:15.251976 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:40:15.251953 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b63cb52_0a1c_4581_b605_9ecb5aee6d16.slice/crio-f416083c6a7503abd27aabf061f1f2a81b082279287d26e1c50c962cbc77822f WatchSource:0}: Error finding container f416083c6a7503abd27aabf061f1f2a81b082279287d26e1c50c962cbc77822f: Status 404 returned error can't find the container with id f416083c6a7503abd27aabf061f1f2a81b082279287d26e1c50c962cbc77822f Sep 17 15:40:15.252992 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:40:15.252969 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb17688ff_c016_4fd1_9b35_c50ec5100d61.slice/crio-ce987501a67ef02cadfb8419b04d6a160b5edd2abd7a65c1d62598f6322b0f39 WatchSource:0}: Error finding container ce987501a67ef02cadfb8419b04d6a160b5edd2abd7a65c1d62598f6322b0f39: Status 404 returned error can't find the container with id ce987501a67ef02cadfb8419b04d6a160b5edd2abd7a65c1d62598f6322b0f39 Sep 17 15:40:15.254508 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:15.254484 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-metrics-certs\") pod \"router-default-86d54f56b-d42z6\" (UID: \"93ecf8b9-4484-4e06-a567-1d192fe5ce5e\") " pod="openshift-ingress/router-default-86d54f56b-d42z6" Sep 17 15:40:15.254589 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:15.254567 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-service-ca-bundle\") pod \"router-default-86d54f56b-d42z6\" (UID: \"93ecf8b9-4484-4e06-a567-1d192fe5ce5e\") " pod="openshift-ingress/router-default-86d54f56b-d42z6" Sep 17 15:40:15.254683 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:15.254571 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 15:40:15.254777 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:15.254639 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-service-ca-bundle podName:93ecf8b9-4484-4e06-a567-1d192fe5ce5e nodeName:}" failed. No retries permitted until 2026-09-17 15:40:17.254622558 +0000 UTC m=+72.648589427 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-service-ca-bundle") pod "router-default-86d54f56b-d42z6" (UID: "93ecf8b9-4484-4e06-a567-1d192fe5ce5e") : configmap references non-existent config key: service-ca.crt Sep 17 15:40:15.254880 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:15.254828 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-metrics-certs podName:93ecf8b9-4484-4e06-a567-1d192fe5ce5e nodeName:}" failed. No retries permitted until 2026-09-17 15:40:17.254804416 +0000 UTC m=+72.648771285 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-metrics-certs") pod "router-default-86d54f56b-d42z6" (UID: "93ecf8b9-4484-4e06-a567-1d192fe5ce5e") : secret "router-metrics-certs-default" not found Sep 17 15:40:15.355749 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:15.355712 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7960de71-b450-4dcd-b112-b20c91c1f63d-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-z58zx\" (UID: \"7960de71-b450-4dcd-b112-b20c91c1f63d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-z58zx" Sep 17 15:40:15.355972 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:15.355946 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 15:40:15.356050 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:15.356028 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7960de71-b450-4dcd-b112-b20c91c1f63d-samples-operator-tls podName:7960de71-b450-4dcd-b112-b20c91c1f63d nodeName:}" failed. No retries permitted until 2026-09-17 15:40:17.356006391 +0000 UTC m=+72.749973244 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7960de71-b450-4dcd-b112-b20c91c1f63d-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-z58zx" (UID: "7960de71-b450-4dcd-b112-b20c91c1f63d") : secret "samples-operator-tls" not found Sep 17 15:40:15.644909 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:15.644849 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kcjnr" event={"ID":"75d806d9-420d-4e93-bb55-a30b25dcd5b9","Type":"ContainerStarted","Data":"ac1c75fdedaafa1abde8fde2fe76894905426b9f774e042609afd7b733f4d326"} Sep 17 15:40:15.645115 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:15.645023 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kcjnr" Sep 17 15:40:15.646692 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:15.646663 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-hrmwr" event={"ID":"d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48","Type":"ContainerStarted","Data":"a6a20a235a43c7de5fccb1a13f4cad0ee574acd610f9385006ec9bf50c1f11f9"} Sep 17 15:40:15.648495 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:15.648465 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jtwf7" event={"ID":"6841aae3-9f3e-439b-bc41-685e1c15baef","Type":"ContainerStarted","Data":"90e51e06eda5889d086382f41334e60c97bc3b327a0a4c4b15d8e5af1f8d7c29"} Sep 17 15:40:15.650591 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:15.650556 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-kjss7" event={"ID":"9b63cb52-0a1c-4581-b605-9ecb5aee6d16","Type":"ContainerStarted","Data":"01389c33575d87f4316797da62c429459e3381ecf8d5bcf901f4f96917fcb060"} Sep 17 15:40:15.650703 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:15.650604 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-kjss7" event={"ID":"9b63cb52-0a1c-4581-b605-9ecb5aee6d16","Type":"ContainerStarted","Data":"f416083c6a7503abd27aabf061f1f2a81b082279287d26e1c50c962cbc77822f"} Sep 17 15:40:15.652026 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:15.652000 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xvldp" event={"ID":"b17688ff-c016-4fd1-9b35-c50ec5100d61","Type":"ContainerStarted","Data":"ce987501a67ef02cadfb8419b04d6a160b5edd2abd7a65c1d62598f6322b0f39"} Sep 17 15:40:15.668943 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:15.668879 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kcjnr" podStartSLOduration=66.134973272 podStartE2EDuration="1m10.668862801s" totalImagesPullingTime="4.533889529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:39:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:15.667943149 +0000 UTC m=+71.061910011" watchObservedRunningTime="2026-09-17 15:40:15.668862801 +0000 UTC m=+71.062829664" Sep 17 15:40:15.688789 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:15.688724 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-kjss7" podStartSLOduration=1.6887030429999998 podStartE2EDuration="1.688703043s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:40:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:15.687664757 +0000 UTC m=+71.081631629" watchObservedRunningTime="2026-09-17 15:40:15.688703043 +0000 UTC m=+71.082669916" Sep 17 15:40:15.706493 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:15.706440 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jtwf7" podStartSLOduration=65.88402573 podStartE2EDuration="1m10.706421575s" totalImagesPullingTime="4.822395845s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:39:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:15.705829768 +0000 UTC m=+71.099796642" watchObservedRunningTime="2026-09-17 15:40:15.706421575 +0000 UTC m=+71.100388453" Sep 17 15:40:17.272798 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:17.272755 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-metrics-certs\") pod \"router-default-86d54f56b-d42z6\" (UID: \"93ecf8b9-4484-4e06-a567-1d192fe5ce5e\") " pod="openshift-ingress/router-default-86d54f56b-d42z6" Sep 17 15:40:17.273229 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:17.272828 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-service-ca-bundle\") pod \"router-default-86d54f56b-d42z6\" (UID: \"93ecf8b9-4484-4e06-a567-1d192fe5ce5e\") " pod="openshift-ingress/router-default-86d54f56b-d42z6" Sep 17 15:40:17.273229 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:17.272957 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 15:40:17.273229 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:17.273037 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-service-ca-bundle podName:93ecf8b9-4484-4e06-a567-1d192fe5ce5e nodeName:}" failed. No retries permitted until 2026-09-17 15:40:21.273017407 +0000 UTC m=+76.666984278 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-service-ca-bundle") pod "router-default-86d54f56b-d42z6" (UID: "93ecf8b9-4484-4e06-a567-1d192fe5ce5e") : configmap references non-existent config key: service-ca.crt Sep 17 15:40:17.273229 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:17.273060 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-metrics-certs podName:93ecf8b9-4484-4e06-a567-1d192fe5ce5e nodeName:}" failed. No retries permitted until 2026-09-17 15:40:21.273051749 +0000 UTC m=+76.667018603 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-metrics-certs") pod "router-default-86d54f56b-d42z6" (UID: "93ecf8b9-4484-4e06-a567-1d192fe5ce5e") : secret "router-metrics-certs-default" not found Sep 17 15:40:17.374151 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:17.374111 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7960de71-b450-4dcd-b112-b20c91c1f63d-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-z58zx\" (UID: \"7960de71-b450-4dcd-b112-b20c91c1f63d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-z58zx" Sep 17 15:40:17.374347 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:17.374260 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 15:40:17.374347 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:17.374324 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7960de71-b450-4dcd-b112-b20c91c1f63d-samples-operator-tls podName:7960de71-b450-4dcd-b112-b20c91c1f63d nodeName:}" failed. No retries permitted until 2026-09-17 15:40:21.374307871 +0000 UTC m=+76.768274743 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7960de71-b450-4dcd-b112-b20c91c1f63d-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-z58zx" (UID: "7960de71-b450-4dcd-b112-b20c91c1f63d") : secret "samples-operator-tls" not found Sep 17 15:40:17.661127 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:17.661084 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xvldp" event={"ID":"b17688ff-c016-4fd1-9b35-c50ec5100d61","Type":"ContainerStarted","Data":"b6062aab6188ef216ac697e7cf3a60ed75cf69aab5375e0b80e18ee4ff7a9d8e"} Sep 17 15:40:17.662669 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:17.662645 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-hrmwr" event={"ID":"d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48","Type":"ContainerStarted","Data":"8958e25c14b2689eb57e145de27f7092ffb504fe3df1532de079643849fdfbfa"} Sep 17 15:40:17.681080 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:17.681011 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xvldp" podStartSLOduration=2.410791118 podStartE2EDuration="4.680989796s" totalImagesPullingTime="2.270198678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:40:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:17.679615963 +0000 UTC m=+73.073582835" watchObservedRunningTime="2026-09-17 15:40:17.680989796 +0000 UTC m=+73.074956668" Sep 17 15:40:17.699392 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:17.699339 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-hrmwr" podStartSLOduration=2.428547618 podStartE2EDuration="4.699321588s" totalImagesPullingTime="2.27077397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:40:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:17.698184588 +0000 UTC m=+73.092151452" watchObservedRunningTime="2026-09-17 15:40:17.699321588 +0000 UTC m=+73.093288459" Sep 17 15:40:18.388349 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:18.388311 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ntqk6"] Sep 17 15:40:18.391697 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:18.391675 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ntqk6" Sep 17 15:40:18.396320 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:18.396293 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 17 15:40:18.396830 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:18.396806 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 17 15:40:18.397128 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:18.397106 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mv47d\"" Sep 17 15:40:18.406500 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:18.406473 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ntqk6"] Sep 17 15:40:18.482693 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:18.482660 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-data-volume\") pod \"insights-runtime-extractor-ntqk6\" (UID: \"ef55fd00-44a9-4735-93d3-fb1f2cf2d01e\") " pod="openshift-insights/insights-runtime-extractor-ntqk6" Sep 17 15:40:18.482876 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:18.482744 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ntqk6\" (UID: \"ef55fd00-44a9-4735-93d3-fb1f2cf2d01e\") " pod="openshift-insights/insights-runtime-extractor-ntqk6" Sep 17 15:40:18.482876 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:18.482811 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x5br\" (UniqueName: \"kubernetes.io/projected/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-kube-api-access-8x5br\") pod \"insights-runtime-extractor-ntqk6\" (UID: \"ef55fd00-44a9-4735-93d3-fb1f2cf2d01e\") " pod="openshift-insights/insights-runtime-extractor-ntqk6" Sep 17 15:40:18.482876 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:18.482851 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-crio-socket\") pod \"insights-runtime-extractor-ntqk6\" (UID: \"ef55fd00-44a9-4735-93d3-fb1f2cf2d01e\") " pod="openshift-insights/insights-runtime-extractor-ntqk6" Sep 17 15:40:18.482876 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:18.482870 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ntqk6\" (UID: \"ef55fd00-44a9-4735-93d3-fb1f2cf2d01e\") " pod="openshift-insights/insights-runtime-extractor-ntqk6" Sep 17 15:40:18.584211 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:18.584169 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ntqk6\" (UID: \"ef55fd00-44a9-4735-93d3-fb1f2cf2d01e\") " pod="openshift-insights/insights-runtime-extractor-ntqk6" Sep 17 15:40:18.584425 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:18.584228 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x5br\" (UniqueName: \"kubernetes.io/projected/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-kube-api-access-8x5br\") pod \"insights-runtime-extractor-ntqk6\" (UID: \"ef55fd00-44a9-4735-93d3-fb1f2cf2d01e\") " pod="openshift-insights/insights-runtime-extractor-ntqk6" Sep 17 15:40:18.584425 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:18.584261 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-crio-socket\") pod \"insights-runtime-extractor-ntqk6\" (UID: \"ef55fd00-44a9-4735-93d3-fb1f2cf2d01e\") " pod="openshift-insights/insights-runtime-extractor-ntqk6" Sep 17 15:40:18.584425 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:18.584284 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ntqk6\" (UID: \"ef55fd00-44a9-4735-93d3-fb1f2cf2d01e\") " pod="openshift-insights/insights-runtime-extractor-ntqk6" Sep 17 15:40:18.584425 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:18.584323 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 15:40:18.584425 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:18.584347 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-data-volume\") pod \"insights-runtime-extractor-ntqk6\" (UID: \"ef55fd00-44a9-4735-93d3-fb1f2cf2d01e\") " pod="openshift-insights/insights-runtime-extractor-ntqk6" Sep 17 15:40:18.584425 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:18.584368 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-crio-socket\") pod \"insights-runtime-extractor-ntqk6\" (UID: \"ef55fd00-44a9-4735-93d3-fb1f2cf2d01e\") " pod="openshift-insights/insights-runtime-extractor-ntqk6" Sep 17 15:40:18.584425 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:18.584411 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-kube-rbac-proxy-cm podName:ef55fd00-44a9-4735-93d3-fb1f2cf2d01e nodeName:}" failed. No retries permitted until 2026-09-17 15:40:19.084388994 +0000 UTC m=+74.478355864 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ntqk6" (UID: "ef55fd00-44a9-4735-93d3-fb1f2cf2d01e") : configmap "kube-rbac-proxy" not found Sep 17 15:40:18.584825 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:18.584437 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 15:40:18.584825 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:18.584486 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-insights-runtime-extractor-tls podName:ef55fd00-44a9-4735-93d3-fb1f2cf2d01e nodeName:}" failed. No retries permitted until 2026-09-17 15:40:19.084469056 +0000 UTC m=+74.478435907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ntqk6" (UID: "ef55fd00-44a9-4735-93d3-fb1f2cf2d01e") : secret "insights-runtime-extractor-tls" not found Sep 17 15:40:18.584825 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:18.584720 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-data-volume\") pod \"insights-runtime-extractor-ntqk6\" (UID: \"ef55fd00-44a9-4735-93d3-fb1f2cf2d01e\") " pod="openshift-insights/insights-runtime-extractor-ntqk6" Sep 17 15:40:18.594118 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:18.594092 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x5br\" (UniqueName: \"kubernetes.io/projected/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-kube-api-access-8x5br\") pod \"insights-runtime-extractor-ntqk6\" (UID: \"ef55fd00-44a9-4735-93d3-fb1f2cf2d01e\") " pod="openshift-insights/insights-runtime-extractor-ntqk6" Sep 17 15:40:19.087443 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:19.087395 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ntqk6\" (UID: \"ef55fd00-44a9-4735-93d3-fb1f2cf2d01e\") " pod="openshift-insights/insights-runtime-extractor-ntqk6" Sep 17 15:40:19.087652 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:19.087464 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ntqk6\" (UID: \"ef55fd00-44a9-4735-93d3-fb1f2cf2d01e\") " pod="openshift-insights/insights-runtime-extractor-ntqk6" Sep 17 15:40:19.087652 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:19.087545 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 15:40:19.087652 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:19.087585 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 15:40:19.087652 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:19.087619 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-kube-rbac-proxy-cm podName:ef55fd00-44a9-4735-93d3-fb1f2cf2d01e nodeName:}" failed. No retries permitted until 2026-09-17 15:40:20.087602556 +0000 UTC m=+75.481569419 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ntqk6" (UID: "ef55fd00-44a9-4735-93d3-fb1f2cf2d01e") : configmap "kube-rbac-proxy" not found Sep 17 15:40:19.087652 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:19.087640 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-insights-runtime-extractor-tls podName:ef55fd00-44a9-4735-93d3-fb1f2cf2d01e nodeName:}" failed. No retries permitted until 2026-09-17 15:40:20.087625404 +0000 UTC m=+75.481592257 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ntqk6" (UID: "ef55fd00-44a9-4735-93d3-fb1f2cf2d01e") : secret "insights-runtime-extractor-tls" not found Sep 17 15:40:20.094003 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:20.093853 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ntqk6\" (UID: \"ef55fd00-44a9-4735-93d3-fb1f2cf2d01e\") " pod="openshift-insights/insights-runtime-extractor-ntqk6" Sep 17 15:40:20.094003 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:20.093987 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 15:40:20.094568 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:20.094024 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ntqk6\" (UID: \"ef55fd00-44a9-4735-93d3-fb1f2cf2d01e\") " pod="openshift-insights/insights-runtime-extractor-ntqk6" Sep 17 15:40:20.094568 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:20.094056 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-kube-rbac-proxy-cm podName:ef55fd00-44a9-4735-93d3-fb1f2cf2d01e nodeName:}" failed. No retries permitted until 2026-09-17 15:40:22.094040056 +0000 UTC m=+77.488006906 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ntqk6" (UID: "ef55fd00-44a9-4735-93d3-fb1f2cf2d01e") : configmap "kube-rbac-proxy" not found Sep 17 15:40:20.094568 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:20.094104 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 15:40:20.094568 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:20.094147 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-insights-runtime-extractor-tls podName:ef55fd00-44a9-4735-93d3-fb1f2cf2d01e nodeName:}" failed. No retries permitted until 2026-09-17 15:40:22.094136146 +0000 UTC m=+77.488102996 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ntqk6" (UID: "ef55fd00-44a9-4735-93d3-fb1f2cf2d01e") : secret "insights-runtime-extractor-tls" not found Sep 17 15:40:20.359997 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:20.359970 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hrgrs_1683b9c0-ac32-4cb2-a099-ce62182f0bce/dns-node-resolver/0.log" Sep 17 15:40:21.144020 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:21.143985 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6gbcs_a7107e67-41ae-412b-851e-0b4c830adfd0/node-ca/0.log" Sep 17 15:40:21.302302 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:21.302260 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-metrics-certs\") pod \"router-default-86d54f56b-d42z6\" (UID: \"93ecf8b9-4484-4e06-a567-1d192fe5ce5e\") " pod="openshift-ingress/router-default-86d54f56b-d42z6" Sep 17 15:40:21.302517 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:21.302326 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-service-ca-bundle\") pod \"router-default-86d54f56b-d42z6\" (UID: \"93ecf8b9-4484-4e06-a567-1d192fe5ce5e\") " pod="openshift-ingress/router-default-86d54f56b-d42z6" Sep 17 15:40:21.302517 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:21.302433 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-service-ca-bundle podName:93ecf8b9-4484-4e06-a567-1d192fe5ce5e nodeName:}" failed. No retries permitted until 2026-09-17 15:40:29.302418701 +0000 UTC m=+84.696385550 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-service-ca-bundle") pod "router-default-86d54f56b-d42z6" (UID: "93ecf8b9-4484-4e06-a567-1d192fe5ce5e") : configmap references non-existent config key: service-ca.crt Sep 17 15:40:21.302517 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:21.302447 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 15:40:21.302517 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:21.302512 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-metrics-certs podName:93ecf8b9-4484-4e06-a567-1d192fe5ce5e nodeName:}" failed. No retries permitted until 2026-09-17 15:40:29.302494583 +0000 UTC m=+84.696461450 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-metrics-certs") pod "router-default-86d54f56b-d42z6" (UID: "93ecf8b9-4484-4e06-a567-1d192fe5ce5e") : secret "router-metrics-certs-default" not found Sep 17 15:40:21.402851 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:21.402751 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7960de71-b450-4dcd-b112-b20c91c1f63d-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-z58zx\" (UID: \"7960de71-b450-4dcd-b112-b20c91c1f63d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-z58zx" Sep 17 15:40:21.403020 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:21.402956 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 15:40:21.403057 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:21.403033 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7960de71-b450-4dcd-b112-b20c91c1f63d-samples-operator-tls podName:7960de71-b450-4dcd-b112-b20c91c1f63d nodeName:}" failed. No retries permitted until 2026-09-17 15:40:29.403013077 +0000 UTC m=+84.796979928 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7960de71-b450-4dcd-b112-b20c91c1f63d-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-z58zx" (UID: "7960de71-b450-4dcd-b112-b20c91c1f63d") : secret "samples-operator-tls" not found Sep 17 15:40:21.945715 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:21.945684 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-56c9v_cd4c4e9b-c929-4dc5-8468-af8fb6cd29f8/serve-healthcheck-canary/0.log" Sep 17 15:40:22.109079 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:22.109024 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ntqk6\" (UID: \"ef55fd00-44a9-4735-93d3-fb1f2cf2d01e\") " pod="openshift-insights/insights-runtime-extractor-ntqk6" Sep 17 15:40:22.109079 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:22.109090 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ntqk6\" (UID: \"ef55fd00-44a9-4735-93d3-fb1f2cf2d01e\") " pod="openshift-insights/insights-runtime-extractor-ntqk6" Sep 17 15:40:22.109353 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:22.109172 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 15:40:22.109353 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:22.109199 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 15:40:22.109353 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:22.109250 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-insights-runtime-extractor-tls podName:ef55fd00-44a9-4735-93d3-fb1f2cf2d01e nodeName:}" failed. No retries permitted until 2026-09-17 15:40:26.109234251 +0000 UTC m=+81.503201105 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ntqk6" (UID: "ef55fd00-44a9-4735-93d3-fb1f2cf2d01e") : secret "insights-runtime-extractor-tls" not found Sep 17 15:40:22.109353 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:22.109264 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-kube-rbac-proxy-cm podName:ef55fd00-44a9-4735-93d3-fb1f2cf2d01e nodeName:}" failed. No retries permitted until 2026-09-17 15:40:26.109257195 +0000 UTC m=+81.503224044 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ntqk6" (UID: "ef55fd00-44a9-4735-93d3-fb1f2cf2d01e") : configmap "kube-rbac-proxy" not found Sep 17 15:40:26.141263 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:26.141112 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ntqk6\" (UID: \"ef55fd00-44a9-4735-93d3-fb1f2cf2d01e\") " pod="openshift-insights/insights-runtime-extractor-ntqk6" Sep 17 15:40:26.141263 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:26.141178 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ntqk6\" (UID: \"ef55fd00-44a9-4735-93d3-fb1f2cf2d01e\") " pod="openshift-insights/insights-runtime-extractor-ntqk6" Sep 17 15:40:26.141263 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:26.141246 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 15:40:26.141726 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:26.141328 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-kube-rbac-proxy-cm podName:ef55fd00-44a9-4735-93d3-fb1f2cf2d01e nodeName:}" failed. No retries permitted until 2026-09-17 15:40:34.141312507 +0000 UTC m=+89.535279391 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ntqk6" (UID: "ef55fd00-44a9-4735-93d3-fb1f2cf2d01e") : configmap "kube-rbac-proxy" not found Sep 17 15:40:26.141726 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:26.141342 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 15:40:26.141726 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:26.141403 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-insights-runtime-extractor-tls podName:ef55fd00-44a9-4735-93d3-fb1f2cf2d01e nodeName:}" failed. No retries permitted until 2026-09-17 15:40:34.141387331 +0000 UTC m=+89.535354181 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ntqk6" (UID: "ef55fd00-44a9-4735-93d3-fb1f2cf2d01e") : secret "insights-runtime-extractor-tls" not found Sep 17 15:40:29.366954 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:29.366885 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-metrics-certs\") pod \"router-default-86d54f56b-d42z6\" (UID: \"93ecf8b9-4484-4e06-a567-1d192fe5ce5e\") " pod="openshift-ingress/router-default-86d54f56b-d42z6" Sep 17 15:40:29.367345 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:29.366983 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-service-ca-bundle\") pod \"router-default-86d54f56b-d42z6\" (UID: \"93ecf8b9-4484-4e06-a567-1d192fe5ce5e\") " pod="openshift-ingress/router-default-86d54f56b-d42z6" Sep 17 15:40:29.367345 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:29.367133 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-service-ca-bundle podName:93ecf8b9-4484-4e06-a567-1d192fe5ce5e nodeName:}" failed. No retries permitted until 2026-09-17 15:40:45.36711546 +0000 UTC m=+100.761082316 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-service-ca-bundle") pod "router-default-86d54f56b-d42z6" (UID: "93ecf8b9-4484-4e06-a567-1d192fe5ce5e") : configmap references non-existent config key: service-ca.crt Sep 17 15:40:29.369523 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:29.369500 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-metrics-certs\") pod \"router-default-86d54f56b-d42z6\" (UID: \"93ecf8b9-4484-4e06-a567-1d192fe5ce5e\") " pod="openshift-ingress/router-default-86d54f56b-d42z6" Sep 17 15:40:29.468196 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:29.468154 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7960de71-b450-4dcd-b112-b20c91c1f63d-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-z58zx\" (UID: \"7960de71-b450-4dcd-b112-b20c91c1f63d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-z58zx" Sep 17 15:40:29.470648 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:29.470625 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7960de71-b450-4dcd-b112-b20c91c1f63d-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-z58zx\" (UID: \"7960de71-b450-4dcd-b112-b20c91c1f63d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-z58zx" Sep 17 15:40:29.578124 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:29.578085 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-z58zx" Sep 17 15:40:29.847532 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:29.847498 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-z58zx"] Sep 17 15:40:30.710062 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:30.710011 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-z58zx" event={"ID":"7960de71-b450-4dcd-b112-b20c91c1f63d","Type":"ContainerStarted","Data":"e0916f979b49a13b446060d3ce1fdebfd1d4a15257882d56e36fa31de4835921"} Sep 17 15:40:31.715175 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:31.715141 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-z58zx" event={"ID":"7960de71-b450-4dcd-b112-b20c91c1f63d","Type":"ContainerStarted","Data":"fd9948b8bb8681189b0467e50076b5c19dc3b3938fd9e505175c23c0340289a6"} Sep 17 15:40:31.715587 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:31.715199 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-z58zx" event={"ID":"7960de71-b450-4dcd-b112-b20c91c1f63d","Type":"ContainerStarted","Data":"47f7f3f12ade993bf6b04d236d82468be03ca1fad1727efb5638789d9b7a1eea"} Sep 17 15:40:31.733996 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:31.733950 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-z58zx" podStartSLOduration=17.33198384 podStartE2EDuration="18.733933607s" totalImagesPullingTime="1.401949767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:40:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:31.733270492 +0000 UTC m=+87.127237364" watchObservedRunningTime="2026-09-17 15:40:31.733933607 +0000 UTC m=+87.127900480" Sep 17 15:40:34.212001 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:34.211960 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ntqk6\" (UID: \"ef55fd00-44a9-4735-93d3-fb1f2cf2d01e\") " pod="openshift-insights/insights-runtime-extractor-ntqk6" Sep 17 15:40:34.212385 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:34.212013 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ntqk6\" (UID: \"ef55fd00-44a9-4735-93d3-fb1f2cf2d01e\") " pod="openshift-insights/insights-runtime-extractor-ntqk6" Sep 17 15:40:34.212633 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:34.212606 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ntqk6\" (UID: \"ef55fd00-44a9-4735-93d3-fb1f2cf2d01e\") " pod="openshift-insights/insights-runtime-extractor-ntqk6" Sep 17 15:40:34.214549 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:34.214529 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef55fd00-44a9-4735-93d3-fb1f2cf2d01e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ntqk6\" (UID: \"ef55fd00-44a9-4735-93d3-fb1f2cf2d01e\") " pod="openshift-insights/insights-runtime-extractor-ntqk6" Sep 17 15:40:34.300714 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:34.300673 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ntqk6" Sep 17 15:40:34.585801 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:34.585718 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ntqk6"] Sep 17 15:40:34.588764 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:40:34.588738 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef55fd00_44a9_4735_93d3_fb1f2cf2d01e.slice/crio-9faf8147e2f3d3dd9f5ce0836e0f0a229036a147daeef29156177f5a8437424c WatchSource:0}: Error finding container 9faf8147e2f3d3dd9f5ce0836e0f0a229036a147daeef29156177f5a8437424c: Status 404 returned error can't find the container with id 9faf8147e2f3d3dd9f5ce0836e0f0a229036a147daeef29156177f5a8437424c Sep 17 15:40:34.725779 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:34.725748 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ntqk6" event={"ID":"ef55fd00-44a9-4735-93d3-fb1f2cf2d01e","Type":"ContainerStarted","Data":"05b6a783610bcae78e79d369329fc064bbf3858608f8e51c5c640a51f44fc0ba"} Sep 17 15:40:34.725983 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:34.725805 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ntqk6" event={"ID":"ef55fd00-44a9-4735-93d3-fb1f2cf2d01e","Type":"ContainerStarted","Data":"9faf8147e2f3d3dd9f5ce0836e0f0a229036a147daeef29156177f5a8437424c"} Sep 17 15:40:35.730188 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:35.730149 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ntqk6" event={"ID":"ef55fd00-44a9-4735-93d3-fb1f2cf2d01e","Type":"ContainerStarted","Data":"56fe4d5e3917bb7d1d57bfc74d44467b92c613cbfe09e61096c604ca0ecf2598"} Sep 17 15:40:36.735427 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:36.735390 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ntqk6" event={"ID":"ef55fd00-44a9-4735-93d3-fb1f2cf2d01e","Type":"ContainerStarted","Data":"98454c02546a6e4562ccb9fee672e280861c1c5571214b5d3f3b1a4cf3ce73e9"} Sep 17 15:40:36.759194 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:36.759145 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ntqk6" podStartSLOduration=16.916911305 podStartE2EDuration="18.759126688s" totalImagesPullingTime="1.842215383s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:40:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:36.758127729 +0000 UTC m=+92.152094613" watchObservedRunningTime="2026-09-17 15:40:36.759126688 +0000 UTC m=+92.153093560" Sep 17 15:40:41.465416 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:41.465375 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-648b5cc675-4ptjs"] Sep 17 15:40:41.467395 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:41.467378 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-648b5cc675-4ptjs" Sep 17 15:40:41.470244 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:41.470217 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 17 15:40:41.471225 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:41.471208 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 17 15:40:41.471328 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:41.471210 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 17 15:40:41.471721 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:41.471701 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 17 15:40:41.481479 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:41.481455 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-648b5cc675-4ptjs"] Sep 17 15:40:41.571477 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:41.571446 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e094d5a5-03b7-4c0c-95f6-e40dbbcc7d32-tmp\") pod \"klusterlet-addon-workmgr-648b5cc675-4ptjs\" (UID: \"e094d5a5-03b7-4c0c-95f6-e40dbbcc7d32\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-648b5cc675-4ptjs" Sep 17 15:40:41.571477 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:41.571483 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e094d5a5-03b7-4c0c-95f6-e40dbbcc7d32-klusterlet-config\") pod \"klusterlet-addon-workmgr-648b5cc675-4ptjs\" (UID: \"e094d5a5-03b7-4c0c-95f6-e40dbbcc7d32\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-648b5cc675-4ptjs" Sep 17 15:40:41.571702 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:41.571586 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msvdv\" (UniqueName: \"kubernetes.io/projected/e094d5a5-03b7-4c0c-95f6-e40dbbcc7d32-kube-api-access-msvdv\") pod \"klusterlet-addon-workmgr-648b5cc675-4ptjs\" (UID: \"e094d5a5-03b7-4c0c-95f6-e40dbbcc7d32\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-648b5cc675-4ptjs" Sep 17 15:40:41.672371 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:41.672337 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msvdv\" (UniqueName: \"kubernetes.io/projected/e094d5a5-03b7-4c0c-95f6-e40dbbcc7d32-kube-api-access-msvdv\") pod \"klusterlet-addon-workmgr-648b5cc675-4ptjs\" (UID: \"e094d5a5-03b7-4c0c-95f6-e40dbbcc7d32\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-648b5cc675-4ptjs" Sep 17 15:40:41.672551 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:41.672397 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e094d5a5-03b7-4c0c-95f6-e40dbbcc7d32-tmp\") pod \"klusterlet-addon-workmgr-648b5cc675-4ptjs\" (UID: \"e094d5a5-03b7-4c0c-95f6-e40dbbcc7d32\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-648b5cc675-4ptjs" Sep 17 15:40:41.672551 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:41.672416 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e094d5a5-03b7-4c0c-95f6-e40dbbcc7d32-klusterlet-config\") pod \"klusterlet-addon-workmgr-648b5cc675-4ptjs\" (UID: \"e094d5a5-03b7-4c0c-95f6-e40dbbcc7d32\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-648b5cc675-4ptjs" Sep 17 15:40:41.672811 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:41.672789 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e094d5a5-03b7-4c0c-95f6-e40dbbcc7d32-tmp\") pod \"klusterlet-addon-workmgr-648b5cc675-4ptjs\" (UID: \"e094d5a5-03b7-4c0c-95f6-e40dbbcc7d32\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-648b5cc675-4ptjs" Sep 17 15:40:41.675029 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:41.674999 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e094d5a5-03b7-4c0c-95f6-e40dbbcc7d32-klusterlet-config\") pod \"klusterlet-addon-workmgr-648b5cc675-4ptjs\" (UID: \"e094d5a5-03b7-4c0c-95f6-e40dbbcc7d32\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-648b5cc675-4ptjs" Sep 17 15:40:41.691293 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:41.691265 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msvdv\" (UniqueName: \"kubernetes.io/projected/e094d5a5-03b7-4c0c-95f6-e40dbbcc7d32-kube-api-access-msvdv\") pod \"klusterlet-addon-workmgr-648b5cc675-4ptjs\" (UID: \"e094d5a5-03b7-4c0c-95f6-e40dbbcc7d32\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-648b5cc675-4ptjs" Sep 17 15:40:41.776121 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:41.776033 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-648b5cc675-4ptjs" Sep 17 15:40:42.045174 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:42.045082 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-648b5cc675-4ptjs"] Sep 17 15:40:42.047780 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:40:42.047753 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode094d5a5_03b7_4c0c_95f6_e40dbbcc7d32.slice/crio-52dbe91b826e8443081673802106b867c549ce918e3c193ba62f02ffb235975a WatchSource:0}: Error finding container 52dbe91b826e8443081673802106b867c549ce918e3c193ba62f02ffb235975a: Status 404 returned error can't find the container with id 52dbe91b826e8443081673802106b867c549ce918e3c193ba62f02ffb235975a Sep 17 15:40:42.754027 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:42.753993 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-648b5cc675-4ptjs" event={"ID":"e094d5a5-03b7-4c0c-95f6-e40dbbcc7d32","Type":"ContainerStarted","Data":"52dbe91b826e8443081673802106b867c549ce918e3c193ba62f02ffb235975a"} Sep 17 15:40:42.883121 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:42.883073 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59d788c0-fef9-42d2-b6c3-f2626f39261d-metrics-tls\") pod \"dns-default-wfnvz\" (UID: \"59d788c0-fef9-42d2-b6c3-f2626f39261d\") " pod="openshift-dns/dns-default-wfnvz" Sep 17 15:40:42.886495 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:42.886430 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59d788c0-fef9-42d2-b6c3-f2626f39261d-metrics-tls\") pod \"dns-default-wfnvz\" (UID: \"59d788c0-fef9-42d2-b6c3-f2626f39261d\") " pod="openshift-dns/dns-default-wfnvz" Sep 17 15:40:43.175862 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:43.175820 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2fbs9\"" Sep 17 15:40:43.180569 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:43.180434 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wfnvz" Sep 17 15:40:43.467621 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:43.467539 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wfnvz"] Sep 17 15:40:43.471188 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:40:43.471144 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59d788c0_fef9_42d2_b6c3_f2626f39261d.slice/crio-8b44dcc5f4164a022f8c1a5dbb09062d4acc59f7f7a71b9f3f8433540630ea1f WatchSource:0}: Error finding container 8b44dcc5f4164a022f8c1a5dbb09062d4acc59f7f7a71b9f3f8433540630ea1f: Status 404 returned error can't find the container with id 8b44dcc5f4164a022f8c1a5dbb09062d4acc59f7f7a71b9f3f8433540630ea1f Sep 17 15:40:43.759415 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:43.759332 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wfnvz" event={"ID":"59d788c0-fef9-42d2-b6c3-f2626f39261d","Type":"ContainerStarted","Data":"8b44dcc5f4164a022f8c1a5dbb09062d4acc59f7f7a71b9f3f8433540630ea1f"} Sep 17 15:40:45.402384 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:45.402334 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-service-ca-bundle\") pod \"router-default-86d54f56b-d42z6\" (UID: \"93ecf8b9-4484-4e06-a567-1d192fe5ce5e\") " pod="openshift-ingress/router-default-86d54f56b-d42z6" Sep 17 15:40:45.403111 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:45.403090 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93ecf8b9-4484-4e06-a567-1d192fe5ce5e-service-ca-bundle\") pod \"router-default-86d54f56b-d42z6\" (UID: \"93ecf8b9-4484-4e06-a567-1d192fe5ce5e\") " pod="openshift-ingress/router-default-86d54f56b-d42z6" Sep 17 15:40:45.685707 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:45.685605 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-86d54f56b-d42z6" Sep 17 15:40:46.658002 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:46.657972 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kcjnr" Sep 17 15:40:47.029165 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:47.029096 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-86d54f56b-d42z6"] Sep 17 15:40:47.031968 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:40:47.031941 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93ecf8b9_4484_4e06_a567_1d192fe5ce5e.slice/crio-c9d5ca899323e7aaea87b20121f1bdb33d73fe5ddbe588f170cd2e2916e799ac WatchSource:0}: Error finding container c9d5ca899323e7aaea87b20121f1bdb33d73fe5ddbe588f170cd2e2916e799ac: Status 404 returned error can't find the container with id c9d5ca899323e7aaea87b20121f1bdb33d73fe5ddbe588f170cd2e2916e799ac Sep 17 15:40:47.775103 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:47.775065 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wfnvz" event={"ID":"59d788c0-fef9-42d2-b6c3-f2626f39261d","Type":"ContainerStarted","Data":"0a0af19bcb62206841d1b2d295ea7a883ae04c843254ee5a8ae7e44252283704"} Sep 17 15:40:47.775542 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:47.775120 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wfnvz" event={"ID":"59d788c0-fef9-42d2-b6c3-f2626f39261d","Type":"ContainerStarted","Data":"8dc93f46aa0ff94020c97cc88d8e012032d4da8f91a33ba3142c2aa23fa60793"} Sep 17 15:40:47.775542 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:47.775176 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wfnvz" Sep 17 15:40:47.776631 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:47.776609 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-86d54f56b-d42z6" event={"ID":"93ecf8b9-4484-4e06-a567-1d192fe5ce5e","Type":"ContainerStarted","Data":"8aff78a7e69d3713d7a8a4670a4bbd6b0df8668a94aa922bd2eae6dafb095b5d"} Sep 17 15:40:47.776766 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:47.776644 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-86d54f56b-d42z6" event={"ID":"93ecf8b9-4484-4e06-a567-1d192fe5ce5e","Type":"ContainerStarted","Data":"c9d5ca899323e7aaea87b20121f1bdb33d73fe5ddbe588f170cd2e2916e799ac"} Sep 17 15:40:47.777931 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:47.777884 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-648b5cc675-4ptjs" event={"ID":"e094d5a5-03b7-4c0c-95f6-e40dbbcc7d32","Type":"ContainerStarted","Data":"bf2f533105baf6afe47367d25186e26e36d818f8b33434bc70085760fb84901d"} Sep 17 15:40:47.778096 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:47.778081 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-648b5cc675-4ptjs" Sep 17 15:40:47.779837 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:47.779820 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-648b5cc675-4ptjs" Sep 17 15:40:47.795611 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:47.795540 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wfnvz" podStartSLOduration=66.51578824 podStartE2EDuration="1m9.795521844s" totalImagesPullingTime="3.279733604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:39:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:47.794978051 +0000 UTC m=+103.188944925" watchObservedRunningTime="2026-09-17 15:40:47.795521844 +0000 UTC m=+103.189488716" Sep 17 15:40:47.815302 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:47.815227 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-86d54f56b-d42z6" podStartSLOduration=34.815208673 podStartE2EDuration="34.815208673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:40:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:47.814156568 +0000 UTC m=+103.208123440" watchObservedRunningTime="2026-09-17 15:40:47.815208673 +0000 UTC m=+103.209175545" Sep 17 15:40:47.835670 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:47.835613 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-648b5cc675-4ptjs" podStartSLOduration=2.135870794 podStartE2EDuration="6.83559511s" totalImagesPullingTime="4.699724316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:40:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:47.834518107 +0000 UTC m=+103.228484981" watchObservedRunningTime="2026-09-17 15:40:47.83559511 +0000 UTC m=+103.229561983" Sep 17 15:40:48.139028 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:48.138993 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-vhgtf"] Sep 17 15:40:48.161310 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:48.161277 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-vhgtf"] Sep 17 15:40:48.161454 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:48.161405 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-vhgtf" Sep 17 15:40:48.165001 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:48.164970 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 17 15:40:48.165001 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:48.164991 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-ldzf5\"" Sep 17 15:40:48.227415 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:48.227370 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f3b3dbb9-f72a-4555-8073-81e17bb420c7-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-vhgtf\" (UID: \"f3b3dbb9-f72a-4555-8073-81e17bb420c7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-vhgtf" Sep 17 15:40:48.328458 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:48.328417 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f3b3dbb9-f72a-4555-8073-81e17bb420c7-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-vhgtf\" (UID: \"f3b3dbb9-f72a-4555-8073-81e17bb420c7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-vhgtf" Sep 17 15:40:48.328656 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:48.328599 2581 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 17 15:40:48.328726 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:48.328683 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3b3dbb9-f72a-4555-8073-81e17bb420c7-tls-certificates podName:f3b3dbb9-f72a-4555-8073-81e17bb420c7 nodeName:}" failed. No retries permitted until 2026-09-17 15:40:48.828660862 +0000 UTC m=+104.222627734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/f3b3dbb9-f72a-4555-8073-81e17bb420c7-tls-certificates") pod "prometheus-operator-admission-webhook-5864cd99d7-vhgtf" (UID: "f3b3dbb9-f72a-4555-8073-81e17bb420c7") : secret "prometheus-operator-admission-webhook-tls" not found Sep 17 15:40:48.686807 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:48.686762 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-86d54f56b-d42z6" Sep 17 15:40:48.689393 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:48.689369 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-86d54f56b-d42z6" Sep 17 15:40:48.781821 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:48.781787 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-86d54f56b-d42z6" Sep 17 15:40:48.783165 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:48.783146 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-86d54f56b-d42z6" Sep 17 15:40:48.832459 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:48.832427 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f3b3dbb9-f72a-4555-8073-81e17bb420c7-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-vhgtf\" (UID: \"f3b3dbb9-f72a-4555-8073-81e17bb420c7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-vhgtf" Sep 17 15:40:48.835366 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:48.835337 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f3b3dbb9-f72a-4555-8073-81e17bb420c7-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-vhgtf\" (UID: \"f3b3dbb9-f72a-4555-8073-81e17bb420c7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-vhgtf" Sep 17 15:40:49.071317 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:49.071224 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-vhgtf" Sep 17 15:40:49.361044 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:49.361016 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-vhgtf"] Sep 17 15:40:49.364105 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:40:49.364070 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3b3dbb9_f72a_4555_8073_81e17bb420c7.slice/crio-283a90b6e0846403efe084c3d04cdcf64d6c5eacfdff144ed8ff1ec441f5b3b7 WatchSource:0}: Error finding container 283a90b6e0846403efe084c3d04cdcf64d6c5eacfdff144ed8ff1ec441f5b3b7: Status 404 returned error can't find the container with id 283a90b6e0846403efe084c3d04cdcf64d6c5eacfdff144ed8ff1ec441f5b3b7 Sep 17 15:40:49.785837 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:49.785742 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-vhgtf" event={"ID":"f3b3dbb9-f72a-4555-8073-81e17bb420c7","Type":"ContainerStarted","Data":"283a90b6e0846403efe084c3d04cdcf64d6c5eacfdff144ed8ff1ec441f5b3b7"} Sep 17 15:40:50.791114 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:50.791018 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-vhgtf" event={"ID":"f3b3dbb9-f72a-4555-8073-81e17bb420c7","Type":"ContainerStarted","Data":"50c6cd31ee8927e5f4c65c2b9b0128c0e851e05d881bc1f37659c82128066801"} Sep 17 15:40:50.791532 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:50.791279 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-vhgtf" Sep 17 15:40:50.795906 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:50.795865 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-vhgtf" Sep 17 15:40:50.817855 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:50.817792 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-vhgtf" podStartSLOduration=1.790094928 podStartE2EDuration="2.817776091s" totalImagesPullingTime="1.027681163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:40:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:50.817066834 +0000 UTC m=+106.211033707" watchObservedRunningTime="2026-09-17 15:40:50.817776091 +0000 UTC m=+106.211742962" Sep 17 15:40:51.251508 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:51.251465 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-wmt9l"] Sep 17 15:40:51.253567 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:51.253552 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-wmt9l" Sep 17 15:40:51.255881 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:51.255852 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 17 15:40:51.256027 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:51.255982 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 17 15:40:51.256027 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:51.256010 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 17 15:40:51.256866 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:51.256849 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 17 15:40:51.256866 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:51.256859 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 17 15:40:51.257029 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:51.256886 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-bm4r9\"" Sep 17 15:40:51.269531 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:51.269504 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-wmt9l"] Sep 17 15:40:51.352054 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:51.352021 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b5505cdb-be20-46c1-b389-a53a49ada82f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-wmt9l\" (UID: \"b5505cdb-be20-46c1-b389-a53a49ada82f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wmt9l" Sep 17 15:40:51.352216 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:51.352075 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b5505cdb-be20-46c1-b389-a53a49ada82f-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-wmt9l\" (UID: \"b5505cdb-be20-46c1-b389-a53a49ada82f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wmt9l" Sep 17 15:40:51.352216 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:51.352115 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5505cdb-be20-46c1-b389-a53a49ada82f-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-wmt9l\" (UID: \"b5505cdb-be20-46c1-b389-a53a49ada82f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wmt9l" Sep 17 15:40:51.352216 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:51.352141 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb4xz\" (UniqueName: \"kubernetes.io/projected/b5505cdb-be20-46c1-b389-a53a49ada82f-kube-api-access-zb4xz\") pod \"prometheus-operator-68bcd7f987-wmt9l\" (UID: \"b5505cdb-be20-46c1-b389-a53a49ada82f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wmt9l" Sep 17 15:40:51.453321 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:51.453287 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b5505cdb-be20-46c1-b389-a53a49ada82f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-wmt9l\" (UID: \"b5505cdb-be20-46c1-b389-a53a49ada82f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wmt9l" Sep 17 15:40:51.453490 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:51.453347 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b5505cdb-be20-46c1-b389-a53a49ada82f-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-wmt9l\" (UID: \"b5505cdb-be20-46c1-b389-a53a49ada82f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wmt9l" Sep 17 15:40:51.453490 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:51.453375 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5505cdb-be20-46c1-b389-a53a49ada82f-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-wmt9l\" (UID: \"b5505cdb-be20-46c1-b389-a53a49ada82f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wmt9l" Sep 17 15:40:51.453490 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:51.453405 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb4xz\" (UniqueName: \"kubernetes.io/projected/b5505cdb-be20-46c1-b389-a53a49ada82f-kube-api-access-zb4xz\") pod \"prometheus-operator-68bcd7f987-wmt9l\" (UID: \"b5505cdb-be20-46c1-b389-a53a49ada82f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wmt9l" Sep 17 15:40:51.453490 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:51.453445 2581 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 17 15:40:51.453683 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:40:51.453527 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5505cdb-be20-46c1-b389-a53a49ada82f-prometheus-operator-tls podName:b5505cdb-be20-46c1-b389-a53a49ada82f nodeName:}" failed. No retries permitted until 2026-09-17 15:40:51.953509843 +0000 UTC m=+107.347476694 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/b5505cdb-be20-46c1-b389-a53a49ada82f-prometheus-operator-tls") pod "prometheus-operator-68bcd7f987-wmt9l" (UID: "b5505cdb-be20-46c1-b389-a53a49ada82f") : secret "prometheus-operator-tls" not found Sep 17 15:40:51.454159 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:51.454137 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5505cdb-be20-46c1-b389-a53a49ada82f-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-wmt9l\" (UID: \"b5505cdb-be20-46c1-b389-a53a49ada82f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wmt9l" Sep 17 15:40:51.455883 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:51.455859 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b5505cdb-be20-46c1-b389-a53a49ada82f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-wmt9l\" (UID: \"b5505cdb-be20-46c1-b389-a53a49ada82f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wmt9l" Sep 17 15:40:51.468711 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:51.468685 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb4xz\" (UniqueName: \"kubernetes.io/projected/b5505cdb-be20-46c1-b389-a53a49ada82f-kube-api-access-zb4xz\") pod \"prometheus-operator-68bcd7f987-wmt9l\" (UID: \"b5505cdb-be20-46c1-b389-a53a49ada82f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wmt9l" Sep 17 15:40:51.957512 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:51.957477 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b5505cdb-be20-46c1-b389-a53a49ada82f-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-wmt9l\" (UID: \"b5505cdb-be20-46c1-b389-a53a49ada82f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wmt9l" Sep 17 15:40:51.960301 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:51.960275 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b5505cdb-be20-46c1-b389-a53a49ada82f-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-wmt9l\" (UID: \"b5505cdb-be20-46c1-b389-a53a49ada82f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wmt9l" Sep 17 15:40:52.162717 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:52.162673 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-wmt9l" Sep 17 15:40:52.439701 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:52.439581 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-wmt9l"] Sep 17 15:40:52.442150 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:40:52.442115 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5505cdb_be20_46c1_b389_a53a49ada82f.slice/crio-5e4bb65bf9505f9280d6e873a40d7de5969d4cfcad7a4b82c0b62ac6bfbb7c5c WatchSource:0}: Error finding container 5e4bb65bf9505f9280d6e873a40d7de5969d4cfcad7a4b82c0b62ac6bfbb7c5c: Status 404 returned error can't find the container with id 5e4bb65bf9505f9280d6e873a40d7de5969d4cfcad7a4b82c0b62ac6bfbb7c5c Sep 17 15:40:52.801190 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:52.801148 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-wmt9l" event={"ID":"b5505cdb-be20-46c1-b389-a53a49ada82f","Type":"ContainerStarted","Data":"5e4bb65bf9505f9280d6e873a40d7de5969d4cfcad7a4b82c0b62ac6bfbb7c5c"} Sep 17 15:40:53.807216 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:53.807117 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-wmt9l" event={"ID":"b5505cdb-be20-46c1-b389-a53a49ada82f","Type":"ContainerStarted","Data":"f6ca351247c6996d735c86cc83fffacef80f516e1649446624b51c6d8a31174b"} Sep 17 15:40:53.807216 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:53.807180 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-wmt9l" event={"ID":"b5505cdb-be20-46c1-b389-a53a49ada82f","Type":"ContainerStarted","Data":"3a9117053a6799eaac9866cd33f1c130a9fcab397727206316c41daf72b4d812"} Sep 17 15:40:53.836482 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:53.836427 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-wmt9l" podStartSLOduration=1.7604943899999999 podStartE2EDuration="2.836412231s" totalImagesPullingTime="1.075917841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:40:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:53.834831077 +0000 UTC m=+109.228797959" watchObservedRunningTime="2026-09-17 15:40:53.836412231 +0000 UTC m=+109.230379119" Sep 17 15:40:55.643635 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:55.643598 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cmkqv"] Sep 17 15:40:55.645795 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:55.645778 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cmkqv" Sep 17 15:40:55.647962 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:55.647936 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dl7rm\"" Sep 17 15:40:55.648109 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:55.648093 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 17 15:40:55.648184 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:55.648147 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 17 15:40:55.648286 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:55.648265 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 17 15:40:55.789706 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:55.789671 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70016297-ea47-4ce3-b4e0-ec282d319fb1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cmkqv\" (UID: \"70016297-ea47-4ce3-b4e0-ec282d319fb1\") " pod="openshift-monitoring/node-exporter-cmkqv" Sep 17 15:40:55.789706 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:55.789705 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/70016297-ea47-4ce3-b4e0-ec282d319fb1-node-exporter-accelerators-collector-config\") pod \"node-exporter-cmkqv\" (UID: \"70016297-ea47-4ce3-b4e0-ec282d319fb1\") " pod="openshift-monitoring/node-exporter-cmkqv" Sep 17 15:40:55.789978 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:55.789780 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/70016297-ea47-4ce3-b4e0-ec282d319fb1-node-exporter-wtmp\") pod \"node-exporter-cmkqv\" (UID: \"70016297-ea47-4ce3-b4e0-ec282d319fb1\") " pod="openshift-monitoring/node-exporter-cmkqv" Sep 17 15:40:55.789978 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:55.789810 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjr4m\" (UniqueName: \"kubernetes.io/projected/70016297-ea47-4ce3-b4e0-ec282d319fb1-kube-api-access-bjr4m\") pod \"node-exporter-cmkqv\" (UID: \"70016297-ea47-4ce3-b4e0-ec282d319fb1\") " pod="openshift-monitoring/node-exporter-cmkqv" Sep 17 15:40:55.789978 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:55.789846 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70016297-ea47-4ce3-b4e0-ec282d319fb1-metrics-client-ca\") pod \"node-exporter-cmkqv\" (UID: \"70016297-ea47-4ce3-b4e0-ec282d319fb1\") " pod="openshift-monitoring/node-exporter-cmkqv" Sep 17 15:40:55.789978 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:55.789862 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/70016297-ea47-4ce3-b4e0-ec282d319fb1-root\") pod \"node-exporter-cmkqv\" (UID: \"70016297-ea47-4ce3-b4e0-ec282d319fb1\") " pod="openshift-monitoring/node-exporter-cmkqv" Sep 17 15:40:55.789978 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:55.789926 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/70016297-ea47-4ce3-b4e0-ec282d319fb1-node-exporter-textfile\") pod \"node-exporter-cmkqv\" (UID: \"70016297-ea47-4ce3-b4e0-ec282d319fb1\") " pod="openshift-monitoring/node-exporter-cmkqv" Sep 17 15:40:55.789978 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:55.789972 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/70016297-ea47-4ce3-b4e0-ec282d319fb1-node-exporter-tls\") pod \"node-exporter-cmkqv\" (UID: \"70016297-ea47-4ce3-b4e0-ec282d319fb1\") " pod="openshift-monitoring/node-exporter-cmkqv" Sep 17 15:40:55.790173 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:55.790021 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70016297-ea47-4ce3-b4e0-ec282d319fb1-sys\") pod \"node-exporter-cmkqv\" (UID: \"70016297-ea47-4ce3-b4e0-ec282d319fb1\") " pod="openshift-monitoring/node-exporter-cmkqv" Sep 17 15:40:55.891217 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:55.891182 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70016297-ea47-4ce3-b4e0-ec282d319fb1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cmkqv\" (UID: \"70016297-ea47-4ce3-b4e0-ec282d319fb1\") " pod="openshift-monitoring/node-exporter-cmkqv" Sep 17 15:40:55.891217 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:55.891218 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/70016297-ea47-4ce3-b4e0-ec282d319fb1-node-exporter-accelerators-collector-config\") pod \"node-exporter-cmkqv\" (UID: \"70016297-ea47-4ce3-b4e0-ec282d319fb1\") " pod="openshift-monitoring/node-exporter-cmkqv" Sep 17 15:40:55.891446 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:55.891272 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/70016297-ea47-4ce3-b4e0-ec282d319fb1-node-exporter-wtmp\") pod \"node-exporter-cmkqv\" (UID: \"70016297-ea47-4ce3-b4e0-ec282d319fb1\") " pod="openshift-monitoring/node-exporter-cmkqv" Sep 17 15:40:55.891446 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:55.891295 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjr4m\" (UniqueName: \"kubernetes.io/projected/70016297-ea47-4ce3-b4e0-ec282d319fb1-kube-api-access-bjr4m\") pod \"node-exporter-cmkqv\" (UID: \"70016297-ea47-4ce3-b4e0-ec282d319fb1\") " pod="openshift-monitoring/node-exporter-cmkqv" Sep 17 15:40:55.891446 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:55.891333 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70016297-ea47-4ce3-b4e0-ec282d319fb1-metrics-client-ca\") pod \"node-exporter-cmkqv\" (UID: \"70016297-ea47-4ce3-b4e0-ec282d319fb1\") " pod="openshift-monitoring/node-exporter-cmkqv" Sep 17 15:40:55.891591 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:55.891476 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/70016297-ea47-4ce3-b4e0-ec282d319fb1-node-exporter-wtmp\") pod \"node-exporter-cmkqv\" (UID: \"70016297-ea47-4ce3-b4e0-ec282d319fb1\") " pod="openshift-monitoring/node-exporter-cmkqv" Sep 17 15:40:55.891591 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:55.891567 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/70016297-ea47-4ce3-b4e0-ec282d319fb1-root\") pod \"node-exporter-cmkqv\" (UID: \"70016297-ea47-4ce3-b4e0-ec282d319fb1\") " pod="openshift-monitoring/node-exporter-cmkqv" Sep 17 15:40:55.891696 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:55.891502 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/70016297-ea47-4ce3-b4e0-ec282d319fb1-root\") pod \"node-exporter-cmkqv\" (UID: \"70016297-ea47-4ce3-b4e0-ec282d319fb1\") " pod="openshift-monitoring/node-exporter-cmkqv" Sep 17 15:40:55.891751 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:55.891690 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/70016297-ea47-4ce3-b4e0-ec282d319fb1-node-exporter-textfile\") pod \"node-exporter-cmkqv\" (UID: \"70016297-ea47-4ce3-b4e0-ec282d319fb1\") " pod="openshift-monitoring/node-exporter-cmkqv" Sep 17 15:40:55.891751 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:55.891721 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/70016297-ea47-4ce3-b4e0-ec282d319fb1-node-exporter-tls\") pod \"node-exporter-cmkqv\" (UID: \"70016297-ea47-4ce3-b4e0-ec282d319fb1\") " pod="openshift-monitoring/node-exporter-cmkqv" Sep 17 15:40:55.891845 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:55.891750 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70016297-ea47-4ce3-b4e0-ec282d319fb1-sys\") pod \"node-exporter-cmkqv\" (UID: \"70016297-ea47-4ce3-b4e0-ec282d319fb1\") " pod="openshift-monitoring/node-exporter-cmkqv" Sep 17 15:40:55.891984 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:55.891860 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70016297-ea47-4ce3-b4e0-ec282d319fb1-sys\") pod \"node-exporter-cmkqv\" (UID: \"70016297-ea47-4ce3-b4e0-ec282d319fb1\") " pod="openshift-monitoring/node-exporter-cmkqv" Sep 17 15:40:55.891984 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:55.891971 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70016297-ea47-4ce3-b4e0-ec282d319fb1-metrics-client-ca\") pod \"node-exporter-cmkqv\" (UID: \"70016297-ea47-4ce3-b4e0-ec282d319fb1\") " pod="openshift-monitoring/node-exporter-cmkqv" Sep 17 15:40:55.892090 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:55.892002 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/70016297-ea47-4ce3-b4e0-ec282d319fb1-node-exporter-accelerators-collector-config\") pod \"node-exporter-cmkqv\" (UID: \"70016297-ea47-4ce3-b4e0-ec282d319fb1\") " pod="openshift-monitoring/node-exporter-cmkqv" Sep 17 15:40:55.892090 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:55.892058 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/70016297-ea47-4ce3-b4e0-ec282d319fb1-node-exporter-textfile\") pod \"node-exporter-cmkqv\" (UID: \"70016297-ea47-4ce3-b4e0-ec282d319fb1\") " pod="openshift-monitoring/node-exporter-cmkqv" Sep 17 15:40:55.893763 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:55.893709 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70016297-ea47-4ce3-b4e0-ec282d319fb1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cmkqv\" (UID: \"70016297-ea47-4ce3-b4e0-ec282d319fb1\") " pod="openshift-monitoring/node-exporter-cmkqv" Sep 17 15:40:55.894165 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:55.894147 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/70016297-ea47-4ce3-b4e0-ec282d319fb1-node-exporter-tls\") pod \"node-exporter-cmkqv\" (UID: \"70016297-ea47-4ce3-b4e0-ec282d319fb1\") " pod="openshift-monitoring/node-exporter-cmkqv" Sep 17 15:40:55.901518 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:55.901494 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjr4m\" (UniqueName: \"kubernetes.io/projected/70016297-ea47-4ce3-b4e0-ec282d319fb1-kube-api-access-bjr4m\") pod \"node-exporter-cmkqv\" (UID: \"70016297-ea47-4ce3-b4e0-ec282d319fb1\") " pod="openshift-monitoring/node-exporter-cmkqv" Sep 17 15:40:55.954528 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:55.954487 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cmkqv" Sep 17 15:40:55.963871 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:40:55.963833 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70016297_ea47_4ce3_b4e0_ec282d319fb1.slice/crio-caed40f784172569e3e90f5dd9836a3a6673f1d5a9aa760ca0a1f6e868e4a5f8 WatchSource:0}: Error finding container caed40f784172569e3e90f5dd9836a3a6673f1d5a9aa760ca0a1f6e868e4a5f8: Status 404 returned error can't find the container with id caed40f784172569e3e90f5dd9836a3a6673f1d5a9aa760ca0a1f6e868e4a5f8 Sep 17 15:40:56.824449 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:56.824418 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cmkqv" event={"ID":"70016297-ea47-4ce3-b4e0-ec282d319fb1","Type":"ContainerStarted","Data":"caed40f784172569e3e90f5dd9836a3a6673f1d5a9aa760ca0a1f6e868e4a5f8"} Sep 17 15:40:57.784244 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:57.784214 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wfnvz" Sep 17 15:40:57.830101 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:57.830060 2581 generic.go:356] "Generic (PLEG): container finished" podID="70016297-ea47-4ce3-b4e0-ec282d319fb1" containerID="9dbce9ba7fe73f5632df3fb5975b4e89a183670db0a1069b46b9aa5968464efa" exitCode=0 Sep 17 15:40:57.830572 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:57.830111 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cmkqv" event={"ID":"70016297-ea47-4ce3-b4e0-ec282d319fb1","Type":"ContainerDied","Data":"9dbce9ba7fe73f5632df3fb5975b4e89a183670db0a1069b46b9aa5968464efa"} Sep 17 15:40:58.836339 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:58.836297 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cmkqv" event={"ID":"70016297-ea47-4ce3-b4e0-ec282d319fb1","Type":"ContainerStarted","Data":"371ebee53a5427440ea24f1b0274b4a657768d8c9df51a58b199ce3fe5acbf81"} Sep 17 15:40:58.836712 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:58.836364 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cmkqv" event={"ID":"70016297-ea47-4ce3-b4e0-ec282d319fb1","Type":"ContainerStarted","Data":"7bfb707466cf8138e34796739ecfac7f83397c41f1ad77db462cef97235d18bf"} Sep 17 15:40:58.863429 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:40:58.863376 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cmkqv" podStartSLOduration=2.952523085 podStartE2EDuration="3.863360507s" totalImagesPullingTime="837.473662ms" totalInitContainerRuntime="73.36376ms" isStatefulPod=true podCreationTimestamp="2026-09-17 15:40:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:58.863173347 +0000 UTC m=+114.257140218" watchObservedRunningTime="2026-09-17 15:40:58.863360507 +0000 UTC m=+114.257327378" Sep 17 15:41:00.414321 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:00.414274 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-kmtxk"] Sep 17 15:41:00.420931 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:00.420881 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kmtxk" Sep 17 15:41:00.423477 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:00.423448 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 17 15:41:00.423609 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:00.423490 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-ft4rl\"" Sep 17 15:41:00.430138 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:00.430107 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-kmtxk"] Sep 17 15:41:00.527925 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:00.527869 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f53e0493-b85b-431b-8900-39206abd62a1-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-kmtxk\" (UID: \"f53e0493-b85b-431b-8900-39206abd62a1\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kmtxk" Sep 17 15:41:00.528090 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:00.527984 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g6pd\" (UniqueName: \"kubernetes.io/projected/f53e0493-b85b-431b-8900-39206abd62a1-kube-api-access-9g6pd\") pod \"monitoring-plugin-5d85778b9d-kmtxk\" (UID: \"f53e0493-b85b-431b-8900-39206abd62a1\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kmtxk" Sep 17 15:41:00.629370 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:00.629329 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g6pd\" (UniqueName: \"kubernetes.io/projected/f53e0493-b85b-431b-8900-39206abd62a1-kube-api-access-9g6pd\") pod \"monitoring-plugin-5d85778b9d-kmtxk\" (UID: \"f53e0493-b85b-431b-8900-39206abd62a1\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kmtxk" Sep 17 15:41:00.629538 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:00.629410 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f53e0493-b85b-431b-8900-39206abd62a1-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-kmtxk\" (UID: \"f53e0493-b85b-431b-8900-39206abd62a1\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kmtxk" Sep 17 15:41:00.629538 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:41:00.629502 2581 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Sep 17 15:41:00.629616 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:41:00.629567 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f53e0493-b85b-431b-8900-39206abd62a1-monitoring-plugin-cert podName:f53e0493-b85b-431b-8900-39206abd62a1 nodeName:}" failed. No retries permitted until 2026-09-17 15:41:01.129552042 +0000 UTC m=+116.523518905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/f53e0493-b85b-431b-8900-39206abd62a1-monitoring-plugin-cert") pod "monitoring-plugin-5d85778b9d-kmtxk" (UID: "f53e0493-b85b-431b-8900-39206abd62a1") : secret "monitoring-plugin-cert" not found Sep 17 15:41:00.644256 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:00.644223 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g6pd\" (UniqueName: \"kubernetes.io/projected/f53e0493-b85b-431b-8900-39206abd62a1-kube-api-access-9g6pd\") pod \"monitoring-plugin-5d85778b9d-kmtxk\" (UID: \"f53e0493-b85b-431b-8900-39206abd62a1\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kmtxk" Sep 17 15:41:01.026620 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.026578 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-65c6696c5f-6cscm"] Sep 17 15:41:01.028874 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.028852 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-65c6696c5f-6cscm" Sep 17 15:41:01.039605 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.039584 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 17 15:41:01.039605 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.039595 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 17 15:41:01.039792 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.039749 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-ll5lk\"" Sep 17 15:41:01.039996 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.039980 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 17 15:41:01.040059 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.039991 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 17 15:41:01.040059 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.040044 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 17 15:41:01.044506 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.044489 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 17 15:41:01.067519 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.067483 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-65c6696c5f-6cscm"] Sep 17 15:41:01.134122 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.134083 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/734fdefa-a1ad-4248-be54-0d3642d68065-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-65c6696c5f-6cscm\" (UID: \"734fdefa-a1ad-4248-be54-0d3642d68065\") " pod="openshift-monitoring/telemeter-client-65c6696c5f-6cscm" Sep 17 15:41:01.134122 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.134126 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/734fdefa-a1ad-4248-be54-0d3642d68065-secret-telemeter-client\") pod \"telemeter-client-65c6696c5f-6cscm\" (UID: \"734fdefa-a1ad-4248-be54-0d3642d68065\") " pod="openshift-monitoring/telemeter-client-65c6696c5f-6cscm" Sep 17 15:41:01.134359 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.134175 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/734fdefa-a1ad-4248-be54-0d3642d68065-metrics-client-ca\") pod \"telemeter-client-65c6696c5f-6cscm\" (UID: \"734fdefa-a1ad-4248-be54-0d3642d68065\") " pod="openshift-monitoring/telemeter-client-65c6696c5f-6cscm" Sep 17 15:41:01.134359 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.134200 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/734fdefa-a1ad-4248-be54-0d3642d68065-telemeter-trusted-ca-bundle\") pod \"telemeter-client-65c6696c5f-6cscm\" (UID: \"734fdefa-a1ad-4248-be54-0d3642d68065\") " pod="openshift-monitoring/telemeter-client-65c6696c5f-6cscm" Sep 17 15:41:01.134359 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.134218 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnj4k\" (UniqueName: \"kubernetes.io/projected/734fdefa-a1ad-4248-be54-0d3642d68065-kube-api-access-wnj4k\") pod \"telemeter-client-65c6696c5f-6cscm\" (UID: \"734fdefa-a1ad-4248-be54-0d3642d68065\") " pod="openshift-monitoring/telemeter-client-65c6696c5f-6cscm" Sep 17 15:41:01.134359 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.134272 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/734fdefa-a1ad-4248-be54-0d3642d68065-serving-certs-ca-bundle\") pod \"telemeter-client-65c6696c5f-6cscm\" (UID: \"734fdefa-a1ad-4248-be54-0d3642d68065\") " pod="openshift-monitoring/telemeter-client-65c6696c5f-6cscm" Sep 17 15:41:01.134359 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.134297 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f53e0493-b85b-431b-8900-39206abd62a1-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-kmtxk\" (UID: \"f53e0493-b85b-431b-8900-39206abd62a1\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kmtxk" Sep 17 15:41:01.134359 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.134326 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/734fdefa-a1ad-4248-be54-0d3642d68065-federate-client-tls\") pod \"telemeter-client-65c6696c5f-6cscm\" (UID: \"734fdefa-a1ad-4248-be54-0d3642d68065\") " pod="openshift-monitoring/telemeter-client-65c6696c5f-6cscm" Sep 17 15:41:01.134572 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.134371 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/734fdefa-a1ad-4248-be54-0d3642d68065-telemeter-client-tls\") pod \"telemeter-client-65c6696c5f-6cscm\" (UID: \"734fdefa-a1ad-4248-be54-0d3642d68065\") " pod="openshift-monitoring/telemeter-client-65c6696c5f-6cscm" Sep 17 15:41:01.137202 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.137178 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f53e0493-b85b-431b-8900-39206abd62a1-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-kmtxk\" (UID: \"f53e0493-b85b-431b-8900-39206abd62a1\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kmtxk" Sep 17 15:41:01.235721 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.235685 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/734fdefa-a1ad-4248-be54-0d3642d68065-serving-certs-ca-bundle\") pod \"telemeter-client-65c6696c5f-6cscm\" (UID: \"734fdefa-a1ad-4248-be54-0d3642d68065\") " pod="openshift-monitoring/telemeter-client-65c6696c5f-6cscm" Sep 17 15:41:01.235721 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.235735 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/734fdefa-a1ad-4248-be54-0d3642d68065-federate-client-tls\") pod \"telemeter-client-65c6696c5f-6cscm\" (UID: \"734fdefa-a1ad-4248-be54-0d3642d68065\") " pod="openshift-monitoring/telemeter-client-65c6696c5f-6cscm" Sep 17 15:41:01.235996 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.235778 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/734fdefa-a1ad-4248-be54-0d3642d68065-telemeter-client-tls\") pod \"telemeter-client-65c6696c5f-6cscm\" (UID: \"734fdefa-a1ad-4248-be54-0d3642d68065\") " pod="openshift-monitoring/telemeter-client-65c6696c5f-6cscm" Sep 17 15:41:01.235996 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.235815 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/734fdefa-a1ad-4248-be54-0d3642d68065-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-65c6696c5f-6cscm\" (UID: \"734fdefa-a1ad-4248-be54-0d3642d68065\") " pod="openshift-monitoring/telemeter-client-65c6696c5f-6cscm" Sep 17 15:41:01.235996 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.235841 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/734fdefa-a1ad-4248-be54-0d3642d68065-secret-telemeter-client\") pod \"telemeter-client-65c6696c5f-6cscm\" (UID: \"734fdefa-a1ad-4248-be54-0d3642d68065\") " pod="openshift-monitoring/telemeter-client-65c6696c5f-6cscm" Sep 17 15:41:01.235996 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.235922 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/734fdefa-a1ad-4248-be54-0d3642d68065-metrics-client-ca\") pod \"telemeter-client-65c6696c5f-6cscm\" (UID: \"734fdefa-a1ad-4248-be54-0d3642d68065\") " pod="openshift-monitoring/telemeter-client-65c6696c5f-6cscm" Sep 17 15:41:01.235996 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.235950 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/734fdefa-a1ad-4248-be54-0d3642d68065-telemeter-trusted-ca-bundle\") pod \"telemeter-client-65c6696c5f-6cscm\" (UID: \"734fdefa-a1ad-4248-be54-0d3642d68065\") " pod="openshift-monitoring/telemeter-client-65c6696c5f-6cscm" Sep 17 15:41:01.235996 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.235972 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnj4k\" (UniqueName: \"kubernetes.io/projected/734fdefa-a1ad-4248-be54-0d3642d68065-kube-api-access-wnj4k\") pod \"telemeter-client-65c6696c5f-6cscm\" (UID: \"734fdefa-a1ad-4248-be54-0d3642d68065\") " pod="openshift-monitoring/telemeter-client-65c6696c5f-6cscm" Sep 17 15:41:01.236687 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.236662 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/734fdefa-a1ad-4248-be54-0d3642d68065-metrics-client-ca\") pod \"telemeter-client-65c6696c5f-6cscm\" (UID: \"734fdefa-a1ad-4248-be54-0d3642d68065\") " pod="openshift-monitoring/telemeter-client-65c6696c5f-6cscm" Sep 17 15:41:01.236803 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.236663 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/734fdefa-a1ad-4248-be54-0d3642d68065-serving-certs-ca-bundle\") pod \"telemeter-client-65c6696c5f-6cscm\" (UID: \"734fdefa-a1ad-4248-be54-0d3642d68065\") " pod="openshift-monitoring/telemeter-client-65c6696c5f-6cscm" Sep 17 15:41:01.236908 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.236806 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/734fdefa-a1ad-4248-be54-0d3642d68065-telemeter-trusted-ca-bundle\") pod \"telemeter-client-65c6696c5f-6cscm\" (UID: \"734fdefa-a1ad-4248-be54-0d3642d68065\") " pod="openshift-monitoring/telemeter-client-65c6696c5f-6cscm" Sep 17 15:41:01.238713 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.238689 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/734fdefa-a1ad-4248-be54-0d3642d68065-telemeter-client-tls\") pod \"telemeter-client-65c6696c5f-6cscm\" (UID: \"734fdefa-a1ad-4248-be54-0d3642d68065\") " pod="openshift-monitoring/telemeter-client-65c6696c5f-6cscm" Sep 17 15:41:01.238807 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.238716 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/734fdefa-a1ad-4248-be54-0d3642d68065-secret-telemeter-client\") pod \"telemeter-client-65c6696c5f-6cscm\" (UID: \"734fdefa-a1ad-4248-be54-0d3642d68065\") " pod="openshift-monitoring/telemeter-client-65c6696c5f-6cscm" Sep 17 15:41:01.239054 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.239038 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/734fdefa-a1ad-4248-be54-0d3642d68065-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-65c6696c5f-6cscm\" (UID: \"734fdefa-a1ad-4248-be54-0d3642d68065\") " pod="openshift-monitoring/telemeter-client-65c6696c5f-6cscm" Sep 17 15:41:01.239218 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.239199 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/734fdefa-a1ad-4248-be54-0d3642d68065-federate-client-tls\") pod \"telemeter-client-65c6696c5f-6cscm\" (UID: \"734fdefa-a1ad-4248-be54-0d3642d68065\") " pod="openshift-monitoring/telemeter-client-65c6696c5f-6cscm" Sep 17 15:41:01.254702 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.254674 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnj4k\" (UniqueName: \"kubernetes.io/projected/734fdefa-a1ad-4248-be54-0d3642d68065-kube-api-access-wnj4k\") pod \"telemeter-client-65c6696c5f-6cscm\" (UID: \"734fdefa-a1ad-4248-be54-0d3642d68065\") " pod="openshift-monitoring/telemeter-client-65c6696c5f-6cscm" Sep 17 15:41:01.332634 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.332551 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kmtxk" Sep 17 15:41:01.338096 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.338073 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-65c6696c5f-6cscm" Sep 17 15:41:01.611973 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.611804 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-kmtxk"] Sep 17 15:41:01.614647 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:41:01.614620 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf53e0493_b85b_431b_8900_39206abd62a1.slice/crio-31c3527cf74390dc43267f5850aa3624c20224558bfd22a95a891f625802a8e4 WatchSource:0}: Error finding container 31c3527cf74390dc43267f5850aa3624c20224558bfd22a95a891f625802a8e4: Status 404 returned error can't find the container with id 31c3527cf74390dc43267f5850aa3624c20224558bfd22a95a891f625802a8e4 Sep 17 15:41:01.628184 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.628159 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-65c6696c5f-6cscm"] Sep 17 15:41:01.631486 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:41:01.631447 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod734fdefa_a1ad_4248_be54_0d3642d68065.slice/crio-459a97da85c654b258a890bbefca45150caba1cc2f634083425778489bdcc964 WatchSource:0}: Error finding container 459a97da85c654b258a890bbefca45150caba1cc2f634083425778489bdcc964: Status 404 returned error can't find the container with id 459a97da85c654b258a890bbefca45150caba1cc2f634083425778489bdcc964 Sep 17 15:41:01.849269 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.849223 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65c6696c5f-6cscm" event={"ID":"734fdefa-a1ad-4248-be54-0d3642d68065","Type":"ContainerStarted","Data":"459a97da85c654b258a890bbefca45150caba1cc2f634083425778489bdcc964"} Sep 17 15:41:01.850551 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.850524 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kmtxk" event={"ID":"f53e0493-b85b-431b-8900-39206abd62a1","Type":"ContainerStarted","Data":"31c3527cf74390dc43267f5850aa3624c20224558bfd22a95a891f625802a8e4"} Sep 17 15:41:01.955333 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.955217 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 15:41:01.958701 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.958664 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:01.961104 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.961072 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5a033cjadritb\"" Sep 17 15:41:01.961343 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.961323 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 17 15:41:01.961845 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.961821 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 17 15:41:01.962269 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.962017 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 17 15:41:01.962269 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.962044 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 17 15:41:01.962269 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.962017 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 17 15:41:01.962269 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.962100 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 17 15:41:01.962269 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.962131 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 17 15:41:01.962269 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.962198 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 17 15:41:01.962642 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.962625 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 17 15:41:01.962836 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.962814 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 17 15:41:01.962963 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.962948 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 17 15:41:01.963148 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.963080 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 17 15:41:01.963148 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.963083 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-54p99\"" Sep 17 15:41:01.963281 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.963179 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 17 15:41:01.966373 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.966348 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 17 15:41:01.973882 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.973405 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 17 15:41:01.997198 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:01.997162 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 15:41:02.145351 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.145311 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.145522 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.145365 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.145522 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.145403 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.145522 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.145439 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.145522 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.145462 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.145522 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.145503 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.145780 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.145530 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.145780 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.145559 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.145780 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.145580 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.145780 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.145624 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.145780 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.145646 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtp7q\" (UniqueName: \"kubernetes.io/projected/55c96906-5dd4-484b-bafc-347cb7804bb2-kube-api-access-vtp7q\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.145780 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.145670 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55c96906-5dd4-484b-bafc-347cb7804bb2-config-out\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.145780 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.145719 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55c96906-5dd4-484b-bafc-347cb7804bb2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.145780 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.145750 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.145780 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.145769 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.146258 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.145795 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-config\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.146258 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.145819 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/55c96906-5dd4-484b-bafc-347cb7804bb2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.146258 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.145854 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.146258 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.145879 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-web-config\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.146258 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.145930 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.248315 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.248211 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.248315 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.248261 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.248315 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.248291 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.248593 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.248320 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.248593 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.248342 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.248593 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.248379 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.248593 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.248404 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.248593 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.248431 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.248593 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.248450 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.248593 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.248479 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.248593 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.248503 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtp7q\" (UniqueName: \"kubernetes.io/projected/55c96906-5dd4-484b-bafc-347cb7804bb2-kube-api-access-vtp7q\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.248593 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.248531 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55c96906-5dd4-484b-bafc-347cb7804bb2-config-out\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.248593 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.248565 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55c96906-5dd4-484b-bafc-347cb7804bb2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.248593 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.248585 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.249165 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.248610 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.249165 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.248641 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-config\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.249165 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.248662 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/55c96906-5dd4-484b-bafc-347cb7804bb2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.249165 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.248710 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.249165 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.248738 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-web-config\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.249165 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.248769 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.251003 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.250730 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.251003 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.250730 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.251003 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.250796 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.251246 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.251008 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.252027 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.251717 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.252921 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.252256 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.252921 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.252643 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/55c96906-5dd4-484b-bafc-347cb7804bb2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.254040 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.254014 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.257365 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.257054 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55c96906-5dd4-484b-bafc-347cb7804bb2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.258965 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.258710 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.259275 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.259246 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.260664 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.260076 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-web-config\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.260664 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.260163 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.260664 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.260445 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.260664 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.260507 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-config\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.260664 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.260628 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.261028 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.261004 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.261660 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.261633 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.264003 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.263963 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55c96906-5dd4-484b-bafc-347cb7804bb2-config-out\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.269599 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.269570 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtp7q\" (UniqueName: \"kubernetes.io/projected/55c96906-5dd4-484b-bafc-347cb7804bb2-kube-api-access-vtp7q\") pod \"prometheus-k8s-0\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.277671 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.277408 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:02.610630 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:02.610357 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 15:41:02.851039 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:41:02.851003 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55c96906_5dd4_484b_bafc_347cb7804bb2.slice/crio-71b21cd7ea77caecfb368fcab81d519b93226d1f3944ca3592e8d70887e6337b WatchSource:0}: Error finding container 71b21cd7ea77caecfb368fcab81d519b93226d1f3944ca3592e8d70887e6337b: Status 404 returned error can't find the container with id 71b21cd7ea77caecfb368fcab81d519b93226d1f3944ca3592e8d70887e6337b Sep 17 15:41:03.860252 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:03.860214 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65c6696c5f-6cscm" event={"ID":"734fdefa-a1ad-4248-be54-0d3642d68065","Type":"ContainerStarted","Data":"6afc35fd178c25d264b7a5d381eb050d206f9e6af36b51dbf5bd6f1540dd6f98"} Sep 17 15:41:03.862638 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:03.862124 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kmtxk" event={"ID":"f53e0493-b85b-431b-8900-39206abd62a1","Type":"ContainerStarted","Data":"1f3031c9cb618888049161c854793fabc59e40d585331171a5577d054debcc66"} Sep 17 15:41:03.862638 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:03.862600 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kmtxk" Sep 17 15:41:03.864292 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:03.864256 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55c96906-5dd4-484b-bafc-347cb7804bb2","Type":"ContainerStarted","Data":"71b21cd7ea77caecfb368fcab81d519b93226d1f3944ca3592e8d70887e6337b"} Sep 17 15:41:03.868406 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:03.868384 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kmtxk" Sep 17 15:41:03.891059 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:03.891003 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kmtxk" podStartSLOduration=2.6271060779999997 podStartE2EDuration="3.890985387s" totalImagesPullingTime="1.263879309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:41:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:41:03.888961801 +0000 UTC m=+119.282928673" watchObservedRunningTime="2026-09-17 15:41:03.890985387 +0000 UTC m=+119.284952258" Sep 17 15:41:04.870651 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:04.870611 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65c6696c5f-6cscm" event={"ID":"734fdefa-a1ad-4248-be54-0d3642d68065","Type":"ContainerStarted","Data":"8cdaadc304f309ccd12db5fd7443e5aae6c98730095270099e043e97e8d28546"} Sep 17 15:41:04.871135 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:04.870679 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65c6696c5f-6cscm" event={"ID":"734fdefa-a1ad-4248-be54-0d3642d68065","Type":"ContainerStarted","Data":"257a2d75ee92943fe19d38917095dfaef7f451deae9b76eed1528f354a496e42"} Sep 17 15:41:04.872579 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:04.872547 2581 generic.go:356] "Generic (PLEG): container finished" podID="55c96906-5dd4-484b-bafc-347cb7804bb2" containerID="823031bbc5a5d1cadd7a4d1a131429eece7461ed2910f959e55552372b7d0c6e" exitCode=0 Sep 17 15:41:04.872679 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:04.872626 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55c96906-5dd4-484b-bafc-347cb7804bb2","Type":"ContainerDied","Data":"823031bbc5a5d1cadd7a4d1a131429eece7461ed2910f959e55552372b7d0c6e"} Sep 17 15:41:04.906167 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:04.906112 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-65c6696c5f-6cscm" podStartSLOduration=2.538141488 podStartE2EDuration="4.906093794s" totalImagesPullingTime="2.367952306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:41:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:41:04.904239475 +0000 UTC m=+120.298206384" watchObservedRunningTime="2026-09-17 15:41:04.906093794 +0000 UTC m=+120.300060666" Sep 17 15:41:08.892338 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:08.892303 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55c96906-5dd4-484b-bafc-347cb7804bb2","Type":"ContainerStarted","Data":"79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2"} Sep 17 15:41:08.892804 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:08.892425 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55c96906-5dd4-484b-bafc-347cb7804bb2","Type":"ContainerStarted","Data":"204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f"} Sep 17 15:41:10.908472 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:10.908434 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55c96906-5dd4-484b-bafc-347cb7804bb2","Type":"ContainerStarted","Data":"f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7"} Sep 17 15:41:10.908874 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:10.908495 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55c96906-5dd4-484b-bafc-347cb7804bb2","Type":"ContainerStarted","Data":"e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851"} Sep 17 15:41:10.908874 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:10.908522 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55c96906-5dd4-484b-bafc-347cb7804bb2","Type":"ContainerStarted","Data":"19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784"} Sep 17 15:41:10.908874 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:10.908544 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55c96906-5dd4-484b-bafc-347cb7804bb2","Type":"ContainerStarted","Data":"702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954"} Sep 17 15:41:10.949068 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:10.948994 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.897801125 podStartE2EDuration="9.94896871s" totalImagesPullingTime="6.030562976s" totalInitContainerRuntime="20.604609ms" isStatefulPod=false podCreationTimestamp="2026-09-17 15:41:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:41:10.946962622 +0000 UTC m=+126.340929494" watchObservedRunningTime="2026-09-17 15:41:10.94896871 +0000 UTC m=+126.342935583" Sep 17 15:41:12.278605 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:12.278547 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:41:13.862216 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:13.862173 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87031c7d-d4f1-4a4b-8691-e93c3698118a-metrics-certs\") pod \"network-metrics-daemon-fjm5t\" (UID: \"87031c7d-d4f1-4a4b-8691-e93c3698118a\") " pod="openshift-multus/network-metrics-daemon-fjm5t" Sep 17 15:41:13.864700 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:13.864676 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87031c7d-d4f1-4a4b-8691-e93c3698118a-metrics-certs\") pod \"network-metrics-daemon-fjm5t\" (UID: \"87031c7d-d4f1-4a4b-8691-e93c3698118a\") " pod="openshift-multus/network-metrics-daemon-fjm5t" Sep 17 15:41:14.055030 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:14.054997 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ddz86\"" Sep 17 15:41:14.063700 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:14.063675 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjm5t" Sep 17 15:41:14.350767 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:14.350734 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fjm5t"] Sep 17 15:41:14.353769 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:41:14.353744 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87031c7d_d4f1_4a4b_8691_e93c3698118a.slice/crio-0f5734c98c94060fa3b67030a230af3403f9c9fef4ac02734266e7a10dd70cd8 WatchSource:0}: Error finding container 0f5734c98c94060fa3b67030a230af3403f9c9fef4ac02734266e7a10dd70cd8: Status 404 returned error can't find the container with id 0f5734c98c94060fa3b67030a230af3403f9c9fef4ac02734266e7a10dd70cd8 Sep 17 15:41:14.929241 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:14.929199 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fjm5t" event={"ID":"87031c7d-d4f1-4a4b-8691-e93c3698118a","Type":"ContainerStarted","Data":"0f5734c98c94060fa3b67030a230af3403f9c9fef4ac02734266e7a10dd70cd8"} Sep 17 15:41:15.934761 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:15.934723 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fjm5t" event={"ID":"87031c7d-d4f1-4a4b-8691-e93c3698118a","Type":"ContainerStarted","Data":"bfc3e2ce31de42150b235fa4264e63c2ba198cd1224dfc8cecb73f07153ec979"} Sep 17 15:41:15.935167 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:15.934788 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fjm5t" event={"ID":"87031c7d-d4f1-4a4b-8691-e93c3698118a","Type":"ContainerStarted","Data":"c3fa8c93a504950917294b8b4d17180f4bb7455c9faa4088de1e867c6934bbc9"} Sep 17 15:41:15.962051 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:15.961987 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fjm5t" podStartSLOduration=130.046780753 podStartE2EDuration="2m10.961969246s" totalImagesPullingTime="915.188493ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:39:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:41:15.961278853 +0000 UTC m=+131.355245726" watchObservedRunningTime="2026-09-17 15:41:15.961969246 +0000 UTC m=+131.355936117" Sep 17 15:41:28.986362 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:28.986327 2581 generic.go:356] "Generic (PLEG): container finished" podID="d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48" containerID="8958e25c14b2689eb57e145de27f7092ffb504fe3df1532de079643849fdfbfa" exitCode=0 Sep 17 15:41:28.986780 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:28.986405 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-hrmwr" event={"ID":"d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48","Type":"ContainerDied","Data":"8958e25c14b2689eb57e145de27f7092ffb504fe3df1532de079643849fdfbfa"} Sep 17 15:41:28.986821 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:28.986790 2581 scope.go:117] "RemoveContainer" containerID="8958e25c14b2689eb57e145de27f7092ffb504fe3df1532de079643849fdfbfa" Sep 17 15:41:29.966987 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:29.966945 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86d54f56b-d42z6_93ecf8b9-4484-4e06-a567-1d192fe5ce5e/router/0.log" Sep 17 15:41:29.974328 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:29.974298 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-56c9v_cd4c4e9b-c929-4dc5-8468-af8fb6cd29f8/serve-healthcheck-canary/0.log" Sep 17 15:41:29.993145 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:29.993115 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-hrmwr" event={"ID":"d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48","Type":"ContainerStarted","Data":"986b535495130fe7a2e16d54a4339671999b333a9e500accfed34645a0cabe08"} Sep 17 15:41:44.055434 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:44.055395 2581 generic.go:356] "Generic (PLEG): container finished" podID="b17688ff-c016-4fd1-9b35-c50ec5100d61" containerID="b6062aab6188ef216ac697e7cf3a60ed75cf69aab5375e0b80e18ee4ff7a9d8e" exitCode=0 Sep 17 15:41:44.055880 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:44.055467 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xvldp" event={"ID":"b17688ff-c016-4fd1-9b35-c50ec5100d61","Type":"ContainerDied","Data":"b6062aab6188ef216ac697e7cf3a60ed75cf69aab5375e0b80e18ee4ff7a9d8e"} Sep 17 15:41:44.055880 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:44.055811 2581 scope.go:117] "RemoveContainer" containerID="b6062aab6188ef216ac697e7cf3a60ed75cf69aab5375e0b80e18ee4ff7a9d8e" Sep 17 15:41:45.061750 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:41:45.061716 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xvldp" event={"ID":"b17688ff-c016-4fd1-9b35-c50ec5100d61","Type":"ContainerStarted","Data":"9b5e7c7a4a733fbb9ddbf42208e0d6120cf63ba927faf2420756b13761ca234c"} Sep 17 15:42:02.278497 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:02.278394 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:02.295226 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:02.295196 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:03.149222 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:03.149194 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:20.435561 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.435516 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 15:42:20.436121 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.435848 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="55c96906-5dd4-484b-bafc-347cb7804bb2" containerName="prometheus" containerID="cri-o://204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f" gracePeriod=600 Sep 17 15:42:20.436121 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.435871 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="55c96906-5dd4-484b-bafc-347cb7804bb2" containerName="thanos-sidecar" containerID="cri-o://f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7" gracePeriod=600 Sep 17 15:42:20.436121 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.435946 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="55c96906-5dd4-484b-bafc-347cb7804bb2" containerName="kube-rbac-proxy-thanos" containerID="cri-o://e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851" gracePeriod=600 Sep 17 15:42:20.436121 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.435937 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="55c96906-5dd4-484b-bafc-347cb7804bb2" containerName="kube-rbac-proxy-web" containerID="cri-o://702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954" gracePeriod=600 Sep 17 15:42:20.436121 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.435943 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="55c96906-5dd4-484b-bafc-347cb7804bb2" containerName="config-reloader" containerID="cri-o://79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2" gracePeriod=600 Sep 17 15:42:20.436121 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.435868 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="55c96906-5dd4-484b-bafc-347cb7804bb2" containerName="kube-rbac-proxy" containerID="cri-o://19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784" gracePeriod=600 Sep 17 15:42:20.686106 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.685952 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:20.756409 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.756367 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55c96906-5dd4-484b-bafc-347cb7804bb2-config-out\") pod \"55c96906-5dd4-484b-bafc-347cb7804bb2\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " Sep 17 15:42:20.756594 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.756433 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-configmap-metrics-client-ca\") pod \"55c96906-5dd4-484b-bafc-347cb7804bb2\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " Sep 17 15:42:20.756594 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.756467 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55c96906-5dd4-484b-bafc-347cb7804bb2-tls-assets\") pod \"55c96906-5dd4-484b-bafc-347cb7804bb2\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " Sep 17 15:42:20.756594 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.756504 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-prometheus-trusted-ca-bundle\") pod \"55c96906-5dd4-484b-bafc-347cb7804bb2\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " Sep 17 15:42:20.756594 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.756529 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/55c96906-5dd4-484b-bafc-347cb7804bb2-prometheus-k8s-db\") pod \"55c96906-5dd4-484b-bafc-347cb7804bb2\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " Sep 17 15:42:20.756594 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.756559 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"55c96906-5dd4-484b-bafc-347cb7804bb2\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " Sep 17 15:42:20.756848 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.756594 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"55c96906-5dd4-484b-bafc-347cb7804bb2\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " Sep 17 15:42:20.756848 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.756627 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-web-config\") pod \"55c96906-5dd4-484b-bafc-347cb7804bb2\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " Sep 17 15:42:20.756848 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.756667 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-prometheus-k8s-rulefiles-0\") pod \"55c96906-5dd4-484b-bafc-347cb7804bb2\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " Sep 17 15:42:20.756848 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.756691 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtp7q\" (UniqueName: \"kubernetes.io/projected/55c96906-5dd4-484b-bafc-347cb7804bb2-kube-api-access-vtp7q\") pod \"55c96906-5dd4-484b-bafc-347cb7804bb2\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " Sep 17 15:42:20.756848 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.756722 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-configmap-kubelet-serving-ca-bundle\") pod \"55c96906-5dd4-484b-bafc-347cb7804bb2\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " Sep 17 15:42:20.756848 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.756758 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-secret-metrics-client-certs\") pod \"55c96906-5dd4-484b-bafc-347cb7804bb2\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " Sep 17 15:42:20.756848 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.756783 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-prometheus-k8s-rulefiles-2\") pod \"55c96906-5dd4-484b-bafc-347cb7804bb2\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " Sep 17 15:42:20.756848 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.756829 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-secret-grpc-tls\") pod \"55c96906-5dd4-484b-bafc-347cb7804bb2\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " Sep 17 15:42:20.757202 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.756861 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-secret-prometheus-k8s-tls\") pod \"55c96906-5dd4-484b-bafc-347cb7804bb2\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " Sep 17 15:42:20.757202 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.756917 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-configmap-serving-certs-ca-bundle\") pod \"55c96906-5dd4-484b-bafc-347cb7804bb2\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " Sep 17 15:42:20.757202 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.756935 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-thanos-prometheus-http-client-file\") pod \"55c96906-5dd4-484b-bafc-347cb7804bb2\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " Sep 17 15:42:20.757202 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.756953 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-secret-kube-rbac-proxy\") pod \"55c96906-5dd4-484b-bafc-347cb7804bb2\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " Sep 17 15:42:20.757202 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.756988 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-prometheus-k8s-rulefiles-1\") pod \"55c96906-5dd4-484b-bafc-347cb7804bb2\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " Sep 17 15:42:20.757202 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.757010 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-config\") pod \"55c96906-5dd4-484b-bafc-347cb7804bb2\" (UID: \"55c96906-5dd4-484b-bafc-347cb7804bb2\") " Sep 17 15:42:20.758266 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.757798 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "55c96906-5dd4-484b-bafc-347cb7804bb2" (UID: "55c96906-5dd4-484b-bafc-347cb7804bb2"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 15:42:20.758266 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.757847 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "55c96906-5dd4-484b-bafc-347cb7804bb2" (UID: "55c96906-5dd4-484b-bafc-347cb7804bb2"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 15:42:20.758266 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.757937 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55c96906-5dd4-484b-bafc-347cb7804bb2-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "55c96906-5dd4-484b-bafc-347cb7804bb2" (UID: "55c96906-5dd4-484b-bafc-347cb7804bb2"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 15:42:20.758616 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.758582 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "55c96906-5dd4-484b-bafc-347cb7804bb2" (UID: "55c96906-5dd4-484b-bafc-347cb7804bb2"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 15:42:20.758981 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.758954 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "55c96906-5dd4-484b-bafc-347cb7804bb2" (UID: "55c96906-5dd4-484b-bafc-347cb7804bb2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 15:42:20.759073 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.759049 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "55c96906-5dd4-484b-bafc-347cb7804bb2" (UID: "55c96906-5dd4-484b-bafc-347cb7804bb2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 15:42:20.760155 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.759717 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "55c96906-5dd4-484b-bafc-347cb7804bb2" (UID: "55c96906-5dd4-484b-bafc-347cb7804bb2"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 15:42:20.760155 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.759877 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55c96906-5dd4-484b-bafc-347cb7804bb2-config-out" (OuterVolumeSpecName: "config-out") pod "55c96906-5dd4-484b-bafc-347cb7804bb2" (UID: "55c96906-5dd4-484b-bafc-347cb7804bb2"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 15:42:20.762510 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.762485 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "55c96906-5dd4-484b-bafc-347cb7804bb2" (UID: "55c96906-5dd4-484b-bafc-347cb7804bb2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 15:42:20.762869 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.762811 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "55c96906-5dd4-484b-bafc-347cb7804bb2" (UID: "55c96906-5dd4-484b-bafc-347cb7804bb2"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 15:42:20.763564 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.763540 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "55c96906-5dd4-484b-bafc-347cb7804bb2" (UID: "55c96906-5dd4-484b-bafc-347cb7804bb2"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 15:42:20.763649 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.763544 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55c96906-5dd4-484b-bafc-347cb7804bb2-kube-api-access-vtp7q" (OuterVolumeSpecName: "kube-api-access-vtp7q") pod "55c96906-5dd4-484b-bafc-347cb7804bb2" (UID: "55c96906-5dd4-484b-bafc-347cb7804bb2"). InnerVolumeSpecName "kube-api-access-vtp7q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 15:42:20.765614 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.765560 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "55c96906-5dd4-484b-bafc-347cb7804bb2" (UID: "55c96906-5dd4-484b-bafc-347cb7804bb2"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 15:42:20.765849 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.765809 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55c96906-5dd4-484b-bafc-347cb7804bb2-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "55c96906-5dd4-484b-bafc-347cb7804bb2" (UID: "55c96906-5dd4-484b-bafc-347cb7804bb2"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 15:42:20.766166 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.766056 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "55c96906-5dd4-484b-bafc-347cb7804bb2" (UID: "55c96906-5dd4-484b-bafc-347cb7804bb2"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 15:42:20.766166 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.766130 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "55c96906-5dd4-484b-bafc-347cb7804bb2" (UID: "55c96906-5dd4-484b-bafc-347cb7804bb2"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 15:42:20.766333 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.766190 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-config" (OuterVolumeSpecName: "config") pod "55c96906-5dd4-484b-bafc-347cb7804bb2" (UID: "55c96906-5dd4-484b-bafc-347cb7804bb2"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 15:42:20.766333 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.766247 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "55c96906-5dd4-484b-bafc-347cb7804bb2" (UID: "55c96906-5dd4-484b-bafc-347cb7804bb2"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 15:42:20.766333 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.766273 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "55c96906-5dd4-484b-bafc-347cb7804bb2" (UID: "55c96906-5dd4-484b-bafc-347cb7804bb2"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 15:42:20.776224 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.776194 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-web-config" (OuterVolumeSpecName: "web-config") pod "55c96906-5dd4-484b-bafc-347cb7804bb2" (UID: "55c96906-5dd4-484b-bafc-347cb7804bb2"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 15:42:20.858239 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.858206 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:42:20.858239 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.858237 2581 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-config\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:42:20.858239 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.858246 2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55c96906-5dd4-484b-bafc-347cb7804bb2-config-out\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:42:20.858468 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.858255 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-configmap-metrics-client-ca\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:42:20.858468 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.858264 2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55c96906-5dd4-484b-bafc-347cb7804bb2-tls-assets\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:42:20.858468 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.858272 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:42:20.858468 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.858280 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/55c96906-5dd4-484b-bafc-347cb7804bb2-prometheus-k8s-db\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:42:20.858468 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.858290 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:42:20.858468 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.858299 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:42:20.858468 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.858309 2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-web-config\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:42:20.858468 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.858318 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:42:20.858468 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.858336 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtp7q\" (UniqueName: \"kubernetes.io/projected/55c96906-5dd4-484b-bafc-347cb7804bb2-kube-api-access-vtp7q\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:42:20.858468 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.858345 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:42:20.858468 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.858354 2581 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-secret-metrics-client-certs\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:42:20.858468 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.858362 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:42:20.858468 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.858371 2581 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-secret-grpc-tls\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:42:20.858468 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.858379 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:42:20.858468 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.858387 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55c96906-5dd4-484b-bafc-347cb7804bb2-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:42:20.858468 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.858395 2581 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:42:20.858468 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:20.858404 2581 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55c96906-5dd4-484b-bafc-347cb7804bb2-secret-kube-rbac-proxy\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:42:21.204632 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.204595 2581 generic.go:356] "Generic (PLEG): container finished" podID="55c96906-5dd4-484b-bafc-347cb7804bb2" containerID="e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851" exitCode=0 Sep 17 15:42:21.204632 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.204621 2581 generic.go:356] "Generic (PLEG): container finished" podID="55c96906-5dd4-484b-bafc-347cb7804bb2" containerID="19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784" exitCode=0 Sep 17 15:42:21.204632 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.204630 2581 generic.go:356] "Generic (PLEG): container finished" podID="55c96906-5dd4-484b-bafc-347cb7804bb2" containerID="702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954" exitCode=0 Sep 17 15:42:21.204632 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.204639 2581 generic.go:356] "Generic (PLEG): container finished" podID="55c96906-5dd4-484b-bafc-347cb7804bb2" containerID="f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7" exitCode=0 Sep 17 15:42:21.204882 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.204646 2581 generic.go:356] "Generic (PLEG): container finished" podID="55c96906-5dd4-484b-bafc-347cb7804bb2" containerID="79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2" exitCode=0 Sep 17 15:42:21.204882 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.204655 2581 generic.go:356] "Generic (PLEG): container finished" podID="55c96906-5dd4-484b-bafc-347cb7804bb2" containerID="204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f" exitCode=0 Sep 17 15:42:21.204882 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.204656 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55c96906-5dd4-484b-bafc-347cb7804bb2","Type":"ContainerDied","Data":"e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851"} Sep 17 15:42:21.204882 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.204673 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.204882 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.204735 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55c96906-5dd4-484b-bafc-347cb7804bb2","Type":"ContainerDied","Data":"19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784"} Sep 17 15:42:21.204882 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.204775 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55c96906-5dd4-484b-bafc-347cb7804bb2","Type":"ContainerDied","Data":"702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954"} Sep 17 15:42:21.204882 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.204798 2581 scope.go:117] "RemoveContainer" containerID="e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851" Sep 17 15:42:21.204882 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.204813 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55c96906-5dd4-484b-bafc-347cb7804bb2","Type":"ContainerDied","Data":"f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7"} Sep 17 15:42:21.204882 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.204853 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55c96906-5dd4-484b-bafc-347cb7804bb2","Type":"ContainerDied","Data":"79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2"} Sep 17 15:42:21.205246 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.204909 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55c96906-5dd4-484b-bafc-347cb7804bb2","Type":"ContainerDied","Data":"204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f"} Sep 17 15:42:21.205246 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.204950 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55c96906-5dd4-484b-bafc-347cb7804bb2","Type":"ContainerDied","Data":"71b21cd7ea77caecfb368fcab81d519b93226d1f3944ca3592e8d70887e6337b"} Sep 17 15:42:21.215504 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.215480 2581 scope.go:117] "RemoveContainer" containerID="19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784" Sep 17 15:42:21.223791 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.223771 2581 scope.go:117] "RemoveContainer" containerID="702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954" Sep 17 15:42:21.231837 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.231801 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 15:42:21.234282 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.234181 2581 scope.go:117] "RemoveContainer" containerID="f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7" Sep 17 15:42:21.236485 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.236464 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 15:42:21.242073 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.242054 2581 scope.go:117] "RemoveContainer" containerID="79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2" Sep 17 15:42:21.249445 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.249423 2581 scope.go:117] "RemoveContainer" containerID="204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f" Sep 17 15:42:21.257105 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.257087 2581 scope.go:117] "RemoveContainer" containerID="823031bbc5a5d1cadd7a4d1a131429eece7461ed2910f959e55552372b7d0c6e" Sep 17 15:42:21.264464 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.264444 2581 scope.go:117] "RemoveContainer" containerID="e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851" Sep 17 15:42:21.264789 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:42:21.264769 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851\": container with ID starting with e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851 not found: ID does not exist" containerID="e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851" Sep 17 15:42:21.264831 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.264800 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851"} err="failed to get container status \"e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851\": rpc error: code = NotFound desc = could not find container \"e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851\": container with ID starting with e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851 not found: ID does not exist" Sep 17 15:42:21.264871 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.264833 2581 scope.go:117] "RemoveContainer" containerID="19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784" Sep 17 15:42:21.265067 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.265049 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 15:42:21.265128 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:42:21.265106 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784\": container with ID starting with 19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784 not found: ID does not exist" containerID="19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784" Sep 17 15:42:21.265159 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.265132 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784"} err="failed to get container status \"19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784\": rpc error: code = NotFound desc = could not find container \"19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784\": container with ID starting with 19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784 not found: ID does not exist" Sep 17 15:42:21.265159 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.265154 2581 scope.go:117] "RemoveContainer" containerID="702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954" Sep 17 15:42:21.265413 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:42:21.265395 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954\": container with ID starting with 702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954 not found: ID does not exist" containerID="702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954" Sep 17 15:42:21.265451 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.265409 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55c96906-5dd4-484b-bafc-347cb7804bb2" containerName="init-config-reloader" Sep 17 15:42:21.265451 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.265422 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="55c96906-5dd4-484b-bafc-347cb7804bb2" containerName="init-config-reloader" Sep 17 15:42:21.265451 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.265419 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954"} err="failed to get container status \"702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954\": rpc error: code = NotFound desc = could not find container \"702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954\": container with ID starting with 702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954 not found: ID does not exist" Sep 17 15:42:21.265451 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.265430 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55c96906-5dd4-484b-bafc-347cb7804bb2" containerName="config-reloader" Sep 17 15:42:21.265451 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.265432 2581 scope.go:117] "RemoveContainer" containerID="f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7" Sep 17 15:42:21.265451 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.265436 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="55c96906-5dd4-484b-bafc-347cb7804bb2" containerName="config-reloader" Sep 17 15:42:21.265451 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.265443 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55c96906-5dd4-484b-bafc-347cb7804bb2" containerName="prometheus" Sep 17 15:42:21.265451 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.265449 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="55c96906-5dd4-484b-bafc-347cb7804bb2" containerName="prometheus" Sep 17 15:42:21.265749 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.265456 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55c96906-5dd4-484b-bafc-347cb7804bb2" containerName="kube-rbac-proxy" Sep 17 15:42:21.265749 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.265463 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="55c96906-5dd4-484b-bafc-347cb7804bb2" containerName="kube-rbac-proxy" Sep 17 15:42:21.265749 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.265468 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55c96906-5dd4-484b-bafc-347cb7804bb2" containerName="kube-rbac-proxy-thanos" Sep 17 15:42:21.265749 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.265473 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="55c96906-5dd4-484b-bafc-347cb7804bb2" containerName="kube-rbac-proxy-thanos" Sep 17 15:42:21.265749 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.265484 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55c96906-5dd4-484b-bafc-347cb7804bb2" containerName="thanos-sidecar" Sep 17 15:42:21.265749 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.265488 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="55c96906-5dd4-484b-bafc-347cb7804bb2" containerName="thanos-sidecar" Sep 17 15:42:21.265749 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.265497 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55c96906-5dd4-484b-bafc-347cb7804bb2" containerName="kube-rbac-proxy-web" Sep 17 15:42:21.265749 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.265501 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="55c96906-5dd4-484b-bafc-347cb7804bb2" containerName="kube-rbac-proxy-web" Sep 17 15:42:21.265749 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.265563 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="55c96906-5dd4-484b-bafc-347cb7804bb2" containerName="thanos-sidecar" Sep 17 15:42:21.265749 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.265572 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="55c96906-5dd4-484b-bafc-347cb7804bb2" containerName="kube-rbac-proxy" Sep 17 15:42:21.265749 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.265578 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="55c96906-5dd4-484b-bafc-347cb7804bb2" containerName="config-reloader" Sep 17 15:42:21.265749 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.265585 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="55c96906-5dd4-484b-bafc-347cb7804bb2" containerName="kube-rbac-proxy-thanos" Sep 17 15:42:21.265749 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.265595 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="55c96906-5dd4-484b-bafc-347cb7804bb2" containerName="prometheus" Sep 17 15:42:21.265749 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.265602 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="55c96906-5dd4-484b-bafc-347cb7804bb2" containerName="kube-rbac-proxy-web" Sep 17 15:42:21.265749 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:42:21.265660 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7\": container with ID starting with f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7 not found: ID does not exist" containerID="f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7" Sep 17 15:42:21.265749 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.265677 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7"} err="failed to get container status \"f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7\": rpc error: code = NotFound desc = could not find container \"f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7\": container with ID starting with f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7 not found: ID does not exist" Sep 17 15:42:21.265749 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.265695 2581 scope.go:117] "RemoveContainer" containerID="79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2" Sep 17 15:42:21.266412 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:42:21.265968 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2\": container with ID starting with 79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2 not found: ID does not exist" containerID="79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2" Sep 17 15:42:21.266412 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.265988 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2"} err="failed to get container status \"79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2\": rpc error: code = NotFound desc = could not find container \"79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2\": container with ID starting with 79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2 not found: ID does not exist" Sep 17 15:42:21.266412 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.266000 2581 scope.go:117] "RemoveContainer" containerID="204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f" Sep 17 15:42:21.266412 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:42:21.266230 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f\": container with ID starting with 204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f not found: ID does not exist" containerID="204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f" Sep 17 15:42:21.266412 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.266248 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f"} err="failed to get container status \"204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f\": rpc error: code = NotFound desc = could not find container \"204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f\": container with ID starting with 204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f not found: ID does not exist" Sep 17 15:42:21.266412 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.266262 2581 scope.go:117] "RemoveContainer" containerID="823031bbc5a5d1cadd7a4d1a131429eece7461ed2910f959e55552372b7d0c6e" Sep 17 15:42:21.266621 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:42:21.266484 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"823031bbc5a5d1cadd7a4d1a131429eece7461ed2910f959e55552372b7d0c6e\": container with ID starting with 823031bbc5a5d1cadd7a4d1a131429eece7461ed2910f959e55552372b7d0c6e not found: ID does not exist" containerID="823031bbc5a5d1cadd7a4d1a131429eece7461ed2910f959e55552372b7d0c6e" Sep 17 15:42:21.266621 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.266500 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"823031bbc5a5d1cadd7a4d1a131429eece7461ed2910f959e55552372b7d0c6e"} err="failed to get container status \"823031bbc5a5d1cadd7a4d1a131429eece7461ed2910f959e55552372b7d0c6e\": rpc error: code = NotFound desc = could not find container \"823031bbc5a5d1cadd7a4d1a131429eece7461ed2910f959e55552372b7d0c6e\": container with ID starting with 823031bbc5a5d1cadd7a4d1a131429eece7461ed2910f959e55552372b7d0c6e not found: ID does not exist" Sep 17 15:42:21.266621 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.266511 2581 scope.go:117] "RemoveContainer" containerID="e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851" Sep 17 15:42:21.266723 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.266691 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851"} err="failed to get container status \"e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851\": rpc error: code = NotFound desc = could not find container \"e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851\": container with ID starting with e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851 not found: ID does not exist" Sep 17 15:42:21.266723 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.266704 2581 scope.go:117] "RemoveContainer" containerID="19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784" Sep 17 15:42:21.266983 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.266963 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784"} err="failed to get container status \"19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784\": rpc error: code = NotFound desc = could not find container \"19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784\": container with ID starting with 19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784 not found: ID does not exist" Sep 17 15:42:21.267062 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.266985 2581 scope.go:117] "RemoveContainer" containerID="702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954" Sep 17 15:42:21.267237 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.267221 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954"} err="failed to get container status \"702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954\": rpc error: code = NotFound desc = could not find container \"702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954\": container with ID starting with 702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954 not found: ID does not exist" Sep 17 15:42:21.267288 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.267237 2581 scope.go:117] "RemoveContainer" containerID="f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7" Sep 17 15:42:21.267448 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.267433 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7"} err="failed to get container status \"f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7\": rpc error: code = NotFound desc = could not find container \"f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7\": container with ID starting with f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7 not found: ID does not exist" Sep 17 15:42:21.267492 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.267448 2581 scope.go:117] "RemoveContainer" containerID="79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2" Sep 17 15:42:21.267636 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.267617 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2"} err="failed to get container status \"79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2\": rpc error: code = NotFound desc = could not find container \"79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2\": container with ID starting with 79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2 not found: ID does not exist" Sep 17 15:42:21.267693 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.267638 2581 scope.go:117] "RemoveContainer" containerID="204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f" Sep 17 15:42:21.267843 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.267827 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f"} err="failed to get container status \"204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f\": rpc error: code = NotFound desc = could not find container \"204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f\": container with ID starting with 204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f not found: ID does not exist" Sep 17 15:42:21.267886 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.267842 2581 scope.go:117] "RemoveContainer" containerID="823031bbc5a5d1cadd7a4d1a131429eece7461ed2910f959e55552372b7d0c6e" Sep 17 15:42:21.268081 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.268062 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"823031bbc5a5d1cadd7a4d1a131429eece7461ed2910f959e55552372b7d0c6e"} err="failed to get container status \"823031bbc5a5d1cadd7a4d1a131429eece7461ed2910f959e55552372b7d0c6e\": rpc error: code = NotFound desc = could not find container \"823031bbc5a5d1cadd7a4d1a131429eece7461ed2910f959e55552372b7d0c6e\": container with ID starting with 823031bbc5a5d1cadd7a4d1a131429eece7461ed2910f959e55552372b7d0c6e not found: ID does not exist" Sep 17 15:42:21.268122 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.268083 2581 scope.go:117] "RemoveContainer" containerID="e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851" Sep 17 15:42:21.268320 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.268301 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851"} err="failed to get container status \"e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851\": rpc error: code = NotFound desc = could not find container \"e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851\": container with ID starting with e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851 not found: ID does not exist" Sep 17 15:42:21.268377 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.268321 2581 scope.go:117] "RemoveContainer" containerID="19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784" Sep 17 15:42:21.268524 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.268507 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784"} err="failed to get container status \"19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784\": rpc error: code = NotFound desc = could not find container \"19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784\": container with ID starting with 19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784 not found: ID does not exist" Sep 17 15:42:21.268588 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.268526 2581 scope.go:117] "RemoveContainer" containerID="702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954" Sep 17 15:42:21.268749 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.268731 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954"} err="failed to get container status \"702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954\": rpc error: code = NotFound desc = could not find container \"702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954\": container with ID starting with 702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954 not found: ID does not exist" Sep 17 15:42:21.268803 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.268748 2581 scope.go:117] "RemoveContainer" containerID="f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7" Sep 17 15:42:21.269000 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.268976 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7"} err="failed to get container status \"f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7\": rpc error: code = NotFound desc = could not find container \"f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7\": container with ID starting with f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7 not found: ID does not exist" Sep 17 15:42:21.269000 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.268998 2581 scope.go:117] "RemoveContainer" containerID="79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2" Sep 17 15:42:21.269270 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.269245 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2"} err="failed to get container status \"79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2\": rpc error: code = NotFound desc = could not find container \"79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2\": container with ID starting with 79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2 not found: ID does not exist" Sep 17 15:42:21.269369 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.269271 2581 scope.go:117] "RemoveContainer" containerID="204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f" Sep 17 15:42:21.269582 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.269552 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f"} err="failed to get container status \"204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f\": rpc error: code = NotFound desc = could not find container \"204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f\": container with ID starting with 204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f not found: ID does not exist" Sep 17 15:42:21.269666 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.269583 2581 scope.go:117] "RemoveContainer" containerID="823031bbc5a5d1cadd7a4d1a131429eece7461ed2910f959e55552372b7d0c6e" Sep 17 15:42:21.269882 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.269864 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"823031bbc5a5d1cadd7a4d1a131429eece7461ed2910f959e55552372b7d0c6e"} err="failed to get container status \"823031bbc5a5d1cadd7a4d1a131429eece7461ed2910f959e55552372b7d0c6e\": rpc error: code = NotFound desc = could not find container \"823031bbc5a5d1cadd7a4d1a131429eece7461ed2910f959e55552372b7d0c6e\": container with ID starting with 823031bbc5a5d1cadd7a4d1a131429eece7461ed2910f959e55552372b7d0c6e not found: ID does not exist" Sep 17 15:42:21.269882 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.269884 2581 scope.go:117] "RemoveContainer" containerID="e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851" Sep 17 15:42:21.270293 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.270274 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851"} err="failed to get container status \"e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851\": rpc error: code = NotFound desc = could not find container \"e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851\": container with ID starting with e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851 not found: ID does not exist" Sep 17 15:42:21.270356 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.270294 2581 scope.go:117] "RemoveContainer" containerID="19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784" Sep 17 15:42:21.270570 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.270545 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784"} err="failed to get container status \"19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784\": rpc error: code = NotFound desc = could not find container \"19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784\": container with ID starting with 19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784 not found: ID does not exist" Sep 17 15:42:21.270613 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.270571 2581 scope.go:117] "RemoveContainer" containerID="702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954" Sep 17 15:42:21.270815 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.270797 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954"} err="failed to get container status \"702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954\": rpc error: code = NotFound desc = could not find container \"702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954\": container with ID starting with 702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954 not found: ID does not exist" Sep 17 15:42:21.270815 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.270816 2581 scope.go:117] "RemoveContainer" containerID="f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7" Sep 17 15:42:21.270962 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.270878 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.271282 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.271079 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7"} err="failed to get container status \"f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7\": rpc error: code = NotFound desc = could not find container \"f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7\": container with ID starting with f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7 not found: ID does not exist" Sep 17 15:42:21.271282 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.271101 2581 scope.go:117] "RemoveContainer" containerID="79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2" Sep 17 15:42:21.271560 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.271534 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2"} err="failed to get container status \"79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2\": rpc error: code = NotFound desc = could not find container \"79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2\": container with ID starting with 79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2 not found: ID does not exist" Sep 17 15:42:21.271560 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.271557 2581 scope.go:117] "RemoveContainer" containerID="204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f" Sep 17 15:42:21.271848 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.271827 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f"} err="failed to get container status \"204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f\": rpc error: code = NotFound desc = could not find container \"204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f\": container with ID starting with 204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f not found: ID does not exist" Sep 17 15:42:21.271848 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.271849 2581 scope.go:117] "RemoveContainer" containerID="823031bbc5a5d1cadd7a4d1a131429eece7461ed2910f959e55552372b7d0c6e" Sep 17 15:42:21.272113 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.272091 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"823031bbc5a5d1cadd7a4d1a131429eece7461ed2910f959e55552372b7d0c6e"} err="failed to get container status \"823031bbc5a5d1cadd7a4d1a131429eece7461ed2910f959e55552372b7d0c6e\": rpc error: code = NotFound desc = could not find container \"823031bbc5a5d1cadd7a4d1a131429eece7461ed2910f959e55552372b7d0c6e\": container with ID starting with 823031bbc5a5d1cadd7a4d1a131429eece7461ed2910f959e55552372b7d0c6e not found: ID does not exist" Sep 17 15:42:21.272192 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.272114 2581 scope.go:117] "RemoveContainer" containerID="e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851" Sep 17 15:42:21.272368 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.272345 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851"} err="failed to get container status \"e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851\": rpc error: code = NotFound desc = could not find container \"e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851\": container with ID starting with e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851 not found: ID does not exist" Sep 17 15:42:21.272433 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.272369 2581 scope.go:117] "RemoveContainer" containerID="19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784" Sep 17 15:42:21.272659 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.272639 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784"} err="failed to get container status \"19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784\": rpc error: code = NotFound desc = could not find container \"19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784\": container with ID starting with 19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784 not found: ID does not exist" Sep 17 15:42:21.272739 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.272659 2581 scope.go:117] "RemoveContainer" containerID="702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954" Sep 17 15:42:21.272935 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.272913 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954"} err="failed to get container status \"702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954\": rpc error: code = NotFound desc = could not find container \"702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954\": container with ID starting with 702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954 not found: ID does not exist" Sep 17 15:42:21.272935 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.272934 2581 scope.go:117] "RemoveContainer" containerID="f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7" Sep 17 15:42:21.273203 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.273180 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7"} err="failed to get container status \"f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7\": rpc error: code = NotFound desc = could not find container \"f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7\": container with ID starting with f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7 not found: ID does not exist" Sep 17 15:42:21.273271 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.273206 2581 scope.go:117] "RemoveContainer" containerID="79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2" Sep 17 15:42:21.273271 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.273257 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 17 15:42:21.273369 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.273332 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 17 15:42:21.273421 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.273388 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 17 15:42:21.273489 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.273467 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2"} err="failed to get container status \"79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2\": rpc error: code = NotFound desc = could not find container \"79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2\": container with ID starting with 79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2 not found: ID does not exist" Sep 17 15:42:21.273489 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.273488 2581 scope.go:117] "RemoveContainer" containerID="204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f" Sep 17 15:42:21.273946 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.273743 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-54p99\"" Sep 17 15:42:21.273946 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.273770 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f"} err="failed to get container status \"204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f\": rpc error: code = NotFound desc = could not find container \"204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f\": container with ID starting with 204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f not found: ID does not exist" Sep 17 15:42:21.273946 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.273793 2581 scope.go:117] "RemoveContainer" containerID="823031bbc5a5d1cadd7a4d1a131429eece7461ed2910f959e55552372b7d0c6e" Sep 17 15:42:21.273946 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.273743 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 17 15:42:21.273946 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.273848 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5a033cjadritb\"" Sep 17 15:42:21.273946 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.273884 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 17 15:42:21.274321 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.273969 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 17 15:42:21.274321 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.274005 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 17 15:42:21.274321 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.274251 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 17 15:42:21.274321 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.274299 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 17 15:42:21.274573 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.274411 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"823031bbc5a5d1cadd7a4d1a131429eece7461ed2910f959e55552372b7d0c6e"} err="failed to get container status \"823031bbc5a5d1cadd7a4d1a131429eece7461ed2910f959e55552372b7d0c6e\": rpc error: code = NotFound desc = could not find container \"823031bbc5a5d1cadd7a4d1a131429eece7461ed2910f959e55552372b7d0c6e\": container with ID starting with 823031bbc5a5d1cadd7a4d1a131429eece7461ed2910f959e55552372b7d0c6e not found: ID does not exist" Sep 17 15:42:21.274573 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.274433 2581 scope.go:117] "RemoveContainer" containerID="e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851" Sep 17 15:42:21.274573 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.274463 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 17 15:42:21.274819 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.274797 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851"} err="failed to get container status \"e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851\": rpc error: code = NotFound desc = could not find container \"e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851\": container with ID starting with e4a4d7c7040cd49c0c9cd73154355a4541c09ef30d997b08fb6c7bf260a45851 not found: ID does not exist" Sep 17 15:42:21.274819 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.274819 2581 scope.go:117] "RemoveContainer" containerID="19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784" Sep 17 15:42:21.276448 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.276409 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 17 15:42:21.276631 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.276594 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 17 15:42:21.276729 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.276645 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 17 15:42:21.276928 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.276830 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784"} err="failed to get container status \"19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784\": rpc error: code = NotFound desc = could not find container \"19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784\": container with ID starting with 19efa334fbab1515865789fad3404beb2c09e8bbaf251ef3e06c959c2ba6c784 not found: ID does not exist" Sep 17 15:42:21.277073 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.276927 2581 scope.go:117] "RemoveContainer" containerID="702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954" Sep 17 15:42:21.277774 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.277750 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954"} err="failed to get container status \"702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954\": rpc error: code = NotFound desc = could not find container \"702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954\": container with ID starting with 702bce18e222938329334a5660d5e3d637e791a3143674bcef4ae4176a756954 not found: ID does not exist" Sep 17 15:42:21.277877 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.277774 2581 scope.go:117] "RemoveContainer" containerID="f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7" Sep 17 15:42:21.277877 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.277800 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 17 15:42:21.278145 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.278127 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7"} err="failed to get container status \"f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7\": rpc error: code = NotFound desc = could not find container \"f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7\": container with ID starting with f14149e739f3d3a628ca0b6b554678657f8dc0d92f12b55524c10acc146593b7 not found: ID does not exist" Sep 17 15:42:21.278145 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.278147 2581 scope.go:117] "RemoveContainer" containerID="79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2" Sep 17 15:42:21.278469 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.278446 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2"} err="failed to get container status \"79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2\": rpc error: code = NotFound desc = could not find container \"79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2\": container with ID starting with 79298b1797a3c1c0670fe77d3b9cef5fc66543fa8f939b201fb1b2efdbe334e2 not found: ID does not exist" Sep 17 15:42:21.278553 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.278469 2581 scope.go:117] "RemoveContainer" containerID="204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f" Sep 17 15:42:21.278781 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.278755 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f"} err="failed to get container status \"204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f\": rpc error: code = NotFound desc = could not find container \"204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f\": container with ID starting with 204fee1727203af19e15a427ba1cd0fdfbda3ee077414e83122af1d87b6c9f3f not found: ID does not exist" Sep 17 15:42:21.278781 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.278782 2581 scope.go:117] "RemoveContainer" containerID="823031bbc5a5d1cadd7a4d1a131429eece7461ed2910f959e55552372b7d0c6e" Sep 17 15:42:21.279186 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.279148 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"823031bbc5a5d1cadd7a4d1a131429eece7461ed2910f959e55552372b7d0c6e"} err="failed to get container status \"823031bbc5a5d1cadd7a4d1a131429eece7461ed2910f959e55552372b7d0c6e\": rpc error: code = NotFound desc = could not find container \"823031bbc5a5d1cadd7a4d1a131429eece7461ed2910f959e55552372b7d0c6e\": container with ID starting with 823031bbc5a5d1cadd7a4d1a131429eece7461ed2910f959e55552372b7d0c6e not found: ID does not exist" Sep 17 15:42:21.280837 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.280648 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 17 15:42:21.304833 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.304799 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 15:42:21.362248 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.362208 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.362248 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.362248 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.362508 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.362277 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.362508 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.362298 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.362508 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.362332 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.362508 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.362360 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.362508 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.362388 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-config-out\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.362508 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.362440 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.362508 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.362462 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.362508 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.362496 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.362830 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.362518 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.362830 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.362553 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.362830 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.362582 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnfrs\" (UniqueName: \"kubernetes.io/projected/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-kube-api-access-hnfrs\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.362830 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.362619 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-config\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.362830 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.362643 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.362830 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.362677 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.362830 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.362716 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-web-config\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.362830 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.362736 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.362830 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.362763 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.362830 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.362790 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.463381 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.463349 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.463809 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.463385 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnfrs\" (UniqueName: \"kubernetes.io/projected/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-kube-api-access-hnfrs\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.463809 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.463407 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-config\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.463809 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.463423 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.463809 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.463439 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.463809 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.463458 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-web-config\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.463809 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.463593 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.463809 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.463657 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.463809 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.463694 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.463809 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.463723 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.463809 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.463749 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.463809 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.463778 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.463809 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.463801 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.464403 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.463824 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.464403 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.463856 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.464403 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.463886 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-config-out\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.464403 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.463980 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.464403 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.464006 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.464403 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.464047 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.464403 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.464071 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.464720 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.464541 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.467405 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.466931 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.467405 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.466954 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.467405 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.466971 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.467405 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.467230 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.467405 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.467329 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-config\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.467405 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.467386 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.467761 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.467682 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.467977 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.467868 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.467977 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.467936 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.468857 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.468424 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.468857 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.468683 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.468857 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.468814 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.469091 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.468956 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.469091 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.469048 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-web-config\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.469953 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.469935 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.470139 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.470121 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-config-out\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.470491 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.470461 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.470725 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.470707 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.473572 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.473549 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnfrs\" (UniqueName: \"kubernetes.io/projected/8252c2f9-859c-46f3-a35a-64a3ca1dcb3e-kube-api-access-hnfrs\") pod \"prometheus-k8s-0\" (UID: \"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.584069 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.584014 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:42:21.873170 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:21.873138 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 15:42:21.875565 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:42:21.875539 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8252c2f9_859c_46f3_a35a_64a3ca1dcb3e.slice/crio-ee1420439cf49765afea7c700adb8c6997c5a8a9dd1cf425cc17c3d358aed367 WatchSource:0}: Error finding container ee1420439cf49765afea7c700adb8c6997c5a8a9dd1cf425cc17c3d358aed367: Status 404 returned error can't find the container with id ee1420439cf49765afea7c700adb8c6997c5a8a9dd1cf425cc17c3d358aed367 Sep 17 15:42:22.210866 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:22.210782 2581 generic.go:356] "Generic (PLEG): container finished" podID="8252c2f9-859c-46f3-a35a-64a3ca1dcb3e" containerID="0e5fb387074b0dad5d16ffb32d4116880766fc0e8255f466c76286ac499cc108" exitCode=0 Sep 17 15:42:22.210866 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:22.210838 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e","Type":"ContainerDied","Data":"0e5fb387074b0dad5d16ffb32d4116880766fc0e8255f466c76286ac499cc108"} Sep 17 15:42:22.211068 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:22.210916 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e","Type":"ContainerStarted","Data":"ee1420439cf49765afea7c700adb8c6997c5a8a9dd1cf425cc17c3d358aed367"} Sep 17 15:42:23.140326 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:23.140287 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55c96906-5dd4-484b-bafc-347cb7804bb2" path="/var/lib/kubelet/pods/55c96906-5dd4-484b-bafc-347cb7804bb2/volumes" Sep 17 15:42:23.218093 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:23.218055 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e","Type":"ContainerStarted","Data":"67e43279a63fc3666d0765fc58660a5061cbbc2e22b3e9e8554efcdf96b9e9f9"} Sep 17 15:42:23.218243 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:23.218116 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e","Type":"ContainerStarted","Data":"68b90896b103350d8eda33f0eaf13c26e26105ebce06f8d9c55f832972106cae"} Sep 17 15:42:23.218243 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:23.218143 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e","Type":"ContainerStarted","Data":"b4cc815cef89711c0f08e51413a72bbd04756c36529b06d80cd5751d86903a42"} Sep 17 15:42:23.218243 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:23.218170 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e","Type":"ContainerStarted","Data":"817ce390a2bcf0f4fea3976f6f10fe1bf628ef381bbff4a843a901eb96531be4"} Sep 17 15:42:23.218243 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:23.218199 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e","Type":"ContainerStarted","Data":"db68591ccfafc7406d0b0140cb9f0a23739699c50fe323491f1c1a027a6887e6"} Sep 17 15:42:23.218243 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:23.218227 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8252c2f9-859c-46f3-a35a-64a3ca1dcb3e","Type":"ContainerStarted","Data":"d3296be22e49a9199942d102846eb2d938d74e03a91e12325b4e5348d9feb914"} Sep 17 15:42:23.257717 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:23.257660 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.238902275 podStartE2EDuration="2.257641416s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.739141ms" isStatefulPod=false podCreationTimestamp="2026-09-17 15:42:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:42:23.256051659 +0000 UTC m=+198.650018530" watchObservedRunningTime="2026-09-17 15:42:23.257641416 +0000 UTC m=+198.651608287" Sep 17 15:42:26.584511 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:42:26.584468 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:43:21.584496 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:43:21.584440 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:43:21.601010 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:43:21.600980 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:43:22.464838 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:43:22.464803 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 15:44:05.039659 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:44:05.039631 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvbm6_9eb875df-5cc6-40f5-978e-f0adf0b823d5/ovn-acl-logging/0.log" Sep 17 15:44:05.043367 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:44:05.043331 2581 kubelet.go:1648] "Image garbage collection succeeded" Sep 17 15:44:05.049557 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:44:05.049532 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvbm6_9eb875df-5cc6-40f5-978e-f0adf0b823d5/ovn-acl-logging/0.log" Sep 17 15:47:25.747553 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:47:25.747513 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-9lpcx"] Sep 17 15:47:25.751025 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:47:25.751008 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-9lpcx" Sep 17 15:47:25.754078 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:47:25.754051 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Sep 17 15:47:25.754078 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:47:25.754071 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Sep 17 15:47:25.754725 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:47:25.754709 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-t55m2\"" Sep 17 15:47:25.754811 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:47:25.754741 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"hf-token\"" Sep 17 15:47:25.754811 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:47:25.754763 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Sep 17 15:47:25.765753 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:47:25.765727 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-9lpcx"] Sep 17 15:47:25.871477 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:47:25.871442 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6d8675b-e076-4f58-976a-7ad73adcb3a8-model-cache\") pod \"s3-init-9lpcx\" (UID: \"b6d8675b-e076-4f58-976a-7ad73adcb3a8\") " pod="kserve/s3-init-9lpcx" Sep 17 15:47:25.871477 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:47:25.871479 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wxvj\" (UniqueName: \"kubernetes.io/projected/b6d8675b-e076-4f58-976a-7ad73adcb3a8-kube-api-access-8wxvj\") pod \"s3-init-9lpcx\" (UID: \"b6d8675b-e076-4f58-976a-7ad73adcb3a8\") " pod="kserve/s3-init-9lpcx" Sep 17 15:47:25.972559 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:47:25.972517 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6d8675b-e076-4f58-976a-7ad73adcb3a8-model-cache\") pod \"s3-init-9lpcx\" (UID: \"b6d8675b-e076-4f58-976a-7ad73adcb3a8\") " pod="kserve/s3-init-9lpcx" Sep 17 15:47:25.972559 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:47:25.972554 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wxvj\" (UniqueName: \"kubernetes.io/projected/b6d8675b-e076-4f58-976a-7ad73adcb3a8-kube-api-access-8wxvj\") pod \"s3-init-9lpcx\" (UID: \"b6d8675b-e076-4f58-976a-7ad73adcb3a8\") " pod="kserve/s3-init-9lpcx" Sep 17 15:47:25.972951 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:47:25.972929 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6d8675b-e076-4f58-976a-7ad73adcb3a8-model-cache\") pod \"s3-init-9lpcx\" (UID: \"b6d8675b-e076-4f58-976a-7ad73adcb3a8\") " pod="kserve/s3-init-9lpcx" Sep 17 15:47:25.982397 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:47:25.982369 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wxvj\" (UniqueName: \"kubernetes.io/projected/b6d8675b-e076-4f58-976a-7ad73adcb3a8-kube-api-access-8wxvj\") pod \"s3-init-9lpcx\" (UID: \"b6d8675b-e076-4f58-976a-7ad73adcb3a8\") " pod="kserve/s3-init-9lpcx" Sep 17 15:47:26.071079 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:47:26.070997 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-9lpcx" Sep 17 15:47:26.351210 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:47:26.351183 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-9lpcx"] Sep 17 15:47:26.353146 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:47:26.353119 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6d8675b_e076_4f58_976a_7ad73adcb3a8.slice/crio-b86e9e20a3268e6eab754ba730d52f4a4984165499bb0d24e267ac96e7ffaf2a WatchSource:0}: Error finding container b86e9e20a3268e6eab754ba730d52f4a4984165499bb0d24e267ac96e7ffaf2a: Status 404 returned error can't find the container with id b86e9e20a3268e6eab754ba730d52f4a4984165499bb0d24e267ac96e7ffaf2a Sep 17 15:47:26.355189 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:47:26.355169 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 15:47:26.373854 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:47:26.373817 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-9lpcx" event={"ID":"b6d8675b-e076-4f58-976a-7ad73adcb3a8","Type":"ContainerStarted","Data":"b86e9e20a3268e6eab754ba730d52f4a4984165499bb0d24e267ac96e7ffaf2a"} Sep 17 15:47:30.393911 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:47:30.393859 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-9lpcx" event={"ID":"b6d8675b-e076-4f58-976a-7ad73adcb3a8","Type":"ContainerStarted","Data":"3edfd3b5d6579afdbea81320382967703c8425f6bb62293e318383e6f4f0cecc"} Sep 17 15:47:32.404036 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:47:32.403998 2581 generic.go:356] "Generic (PLEG): container finished" podID="b6d8675b-e076-4f58-976a-7ad73adcb3a8" containerID="3edfd3b5d6579afdbea81320382967703c8425f6bb62293e318383e6f4f0cecc" exitCode=0 Sep 17 15:47:32.404435 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:47:32.404073 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-9lpcx" event={"ID":"b6d8675b-e076-4f58-976a-7ad73adcb3a8","Type":"ContainerDied","Data":"3edfd3b5d6579afdbea81320382967703c8425f6bb62293e318383e6f4f0cecc"} Sep 17 15:47:37.428551 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:47:37.428515 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-9lpcx" event={"ID":"b6d8675b-e076-4f58-976a-7ad73adcb3a8","Type":"ContainerStarted","Data":"acfd7b4b9b813aac281a90e56ade833f9c9919adb84c6ccdb8301d6dbd10bf13"} Sep 17 15:47:37.450407 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:47:37.450352 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-9lpcx" podStartSLOduration=2.396749711 podStartE2EDuration="12.450335704s" totalImagesPullingTime="8.043238852s" totalInitContainerRuntime="2.010347141s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:47:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:47:37.448246785 +0000 UTC m=+512.842213661" watchObservedRunningTime="2026-09-17 15:47:37.450335704 +0000 UTC m=+512.844302576" Sep 17 15:48:42.691325 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:42.691286 2581 generic.go:356] "Generic (PLEG): container finished" podID="b6d8675b-e076-4f58-976a-7ad73adcb3a8" containerID="acfd7b4b9b813aac281a90e56ade833f9c9919adb84c6ccdb8301d6dbd10bf13" exitCode=0 Sep 17 15:48:42.691843 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:42.691365 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-9lpcx" event={"ID":"b6d8675b-e076-4f58-976a-7ad73adcb3a8","Type":"ContainerDied","Data":"acfd7b4b9b813aac281a90e56ade833f9c9919adb84c6ccdb8301d6dbd10bf13"} Sep 17 15:48:43.817489 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:43.817466 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-9lpcx" Sep 17 15:48:43.938014 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:43.937976 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wxvj\" (UniqueName: \"kubernetes.io/projected/b6d8675b-e076-4f58-976a-7ad73adcb3a8-kube-api-access-8wxvj\") pod \"b6d8675b-e076-4f58-976a-7ad73adcb3a8\" (UID: \"b6d8675b-e076-4f58-976a-7ad73adcb3a8\") " Sep 17 15:48:43.938182 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:43.938051 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6d8675b-e076-4f58-976a-7ad73adcb3a8-model-cache\") pod \"b6d8675b-e076-4f58-976a-7ad73adcb3a8\" (UID: \"b6d8675b-e076-4f58-976a-7ad73adcb3a8\") " Sep 17 15:48:43.940365 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:43.940336 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6d8675b-e076-4f58-976a-7ad73adcb3a8-kube-api-access-8wxvj" (OuterVolumeSpecName: "kube-api-access-8wxvj") pod "b6d8675b-e076-4f58-976a-7ad73adcb3a8" (UID: "b6d8675b-e076-4f58-976a-7ad73adcb3a8"). InnerVolumeSpecName "kube-api-access-8wxvj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 15:48:43.956391 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:43.956362 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6d8675b-e076-4f58-976a-7ad73adcb3a8-model-cache" (OuterVolumeSpecName: "model-cache") pod "b6d8675b-e076-4f58-976a-7ad73adcb3a8" (UID: "b6d8675b-e076-4f58-976a-7ad73adcb3a8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 15:48:44.038864 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:44.038826 2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6d8675b-e076-4f58-976a-7ad73adcb3a8-model-cache\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:48:44.038864 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:44.038857 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wxvj\" (UniqueName: \"kubernetes.io/projected/b6d8675b-e076-4f58-976a-7ad73adcb3a8-kube-api-access-8wxvj\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:48:44.700024 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:44.699986 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-9lpcx" event={"ID":"b6d8675b-e076-4f58-976a-7ad73adcb3a8","Type":"ContainerDied","Data":"b86e9e20a3268e6eab754ba730d52f4a4984165499bb0d24e267ac96e7ffaf2a"} Sep 17 15:48:44.700024 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:44.700028 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b86e9e20a3268e6eab754ba730d52f4a4984165499bb0d24e267ac96e7ffaf2a" Sep 17 15:48:44.700024 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:44.700029 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-9lpcx" Sep 17 15:48:57.514700 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:57.514660 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68"] Sep 17 15:48:57.515182 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:57.514972 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6d8675b-e076-4f58-976a-7ad73adcb3a8" containerName="s3-init" Sep 17 15:48:57.515182 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:57.514984 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6d8675b-e076-4f58-976a-7ad73adcb3a8" containerName="s3-init" Sep 17 15:48:57.515182 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:57.515002 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6d8675b-e076-4f58-976a-7ad73adcb3a8" containerName="download-hf-model" Sep 17 15:48:57.515182 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:57.515008 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6d8675b-e076-4f58-976a-7ad73adcb3a8" containerName="download-hf-model" Sep 17 15:48:57.515182 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:57.515059 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6d8675b-e076-4f58-976a-7ad73adcb3a8" containerName="s3-init" Sep 17 15:48:57.518113 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:57.518097 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" Sep 17 15:48:57.521564 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:57.521536 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Sep 17 15:48:57.521700 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:57.521636 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\"" Sep 17 15:48:57.521700 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:57.521637 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-predictor-serving-cert\"" Sep 17 15:48:57.521820 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:57.521791 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\"" Sep 17 15:48:57.522063 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:57.522046 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-9nh5v\"" Sep 17 15:48:57.522167 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:57.522068 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Sep 17 15:48:57.522299 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:57.522285 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\"" Sep 17 15:48:57.533739 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:57.533714 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68"] Sep 17 15:48:57.654729 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:57.654698 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9gc4\" (UniqueName: \"kubernetes.io/projected/c8808bd6-4637-418d-a429-1b645909a933-kube-api-access-j9gc4\") pod \"isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68\" (UID: \"c8808bd6-4637-418d-a429-1b645909a933\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" Sep 17 15:48:57.654729 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:57.654736 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c8808bd6-4637-418d-a429-1b645909a933-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68\" (UID: \"c8808bd6-4637-418d-a429-1b645909a933\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" Sep 17 15:48:57.655011 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:57.654772 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c8808bd6-4637-418d-a429-1b645909a933-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68\" (UID: \"c8808bd6-4637-418d-a429-1b645909a933\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" Sep 17 15:48:57.655011 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:57.654859 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c8808bd6-4637-418d-a429-1b645909a933-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68\" (UID: \"c8808bd6-4637-418d-a429-1b645909a933\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" Sep 17 15:48:57.655011 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:57.654985 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c8808bd6-4637-418d-a429-1b645909a933-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68\" (UID: \"c8808bd6-4637-418d-a429-1b645909a933\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" Sep 17 15:48:57.755944 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:57.755907 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c8808bd6-4637-418d-a429-1b645909a933-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68\" (UID: \"c8808bd6-4637-418d-a429-1b645909a933\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" Sep 17 15:48:57.756152 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:57.755964 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c8808bd6-4637-418d-a429-1b645909a933-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68\" (UID: \"c8808bd6-4637-418d-a429-1b645909a933\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" Sep 17 15:48:57.756152 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:57.756016 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c8808bd6-4637-418d-a429-1b645909a933-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68\" (UID: \"c8808bd6-4637-418d-a429-1b645909a933\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" Sep 17 15:48:57.756152 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:57.756054 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9gc4\" (UniqueName: \"kubernetes.io/projected/c8808bd6-4637-418d-a429-1b645909a933-kube-api-access-j9gc4\") pod \"isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68\" (UID: \"c8808bd6-4637-418d-a429-1b645909a933\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" Sep 17 15:48:57.756152 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:57.756081 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c8808bd6-4637-418d-a429-1b645909a933-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68\" (UID: \"c8808bd6-4637-418d-a429-1b645909a933\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" Sep 17 15:48:57.756514 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:57.756489 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c8808bd6-4637-418d-a429-1b645909a933-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68\" (UID: \"c8808bd6-4637-418d-a429-1b645909a933\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" Sep 17 15:48:57.756793 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:57.756773 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c8808bd6-4637-418d-a429-1b645909a933-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68\" (UID: \"c8808bd6-4637-418d-a429-1b645909a933\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" Sep 17 15:48:57.756859 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:57.756775 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c8808bd6-4637-418d-a429-1b645909a933-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68\" (UID: \"c8808bd6-4637-418d-a429-1b645909a933\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" Sep 17 15:48:57.758645 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:57.758624 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c8808bd6-4637-418d-a429-1b645909a933-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68\" (UID: \"c8808bd6-4637-418d-a429-1b645909a933\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" Sep 17 15:48:57.773580 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:57.773516 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9gc4\" (UniqueName: \"kubernetes.io/projected/c8808bd6-4637-418d-a429-1b645909a933-kube-api-access-j9gc4\") pod \"isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68\" (UID: \"c8808bd6-4637-418d-a429-1b645909a933\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" Sep 17 15:48:57.828487 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:57.828447 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" Sep 17 15:48:57.890281 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:57.888876 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh"] Sep 17 15:48:57.893127 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:57.893049 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" Sep 17 15:48:57.895786 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:57.895612 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-kube-rbac-proxy-sar-config\"" Sep 17 15:48:57.896681 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:57.896572 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-predictor-serving-cert\"" Sep 17 15:48:57.906711 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:57.906686 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh"] Sep 17 15:48:58.059058 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.058962 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5skhq\" (UniqueName: \"kubernetes.io/projected/3726fbaf-3984-4a4c-b08b-14ce2a1f3099-kube-api-access-5skhq\") pod \"isvc-xgboost-graph-predictor-555fc69d56-4slgh\" (UID: \"3726fbaf-3984-4a4c-b08b-14ce2a1f3099\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" Sep 17 15:48:58.059058 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.058998 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3726fbaf-3984-4a4c-b08b-14ce2a1f3099-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-4slgh\" (UID: \"3726fbaf-3984-4a4c-b08b-14ce2a1f3099\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" Sep 17 15:48:58.059058 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.059025 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3726fbaf-3984-4a4c-b08b-14ce2a1f3099-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-4slgh\" (UID: \"3726fbaf-3984-4a4c-b08b-14ce2a1f3099\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" Sep 17 15:48:58.059058 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.059046 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3726fbaf-3984-4a4c-b08b-14ce2a1f3099-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-4slgh\" (UID: \"3726fbaf-3984-4a4c-b08b-14ce2a1f3099\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" Sep 17 15:48:58.059348 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.059154 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/3726fbaf-3984-4a4c-b08b-14ce2a1f3099-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-4slgh\" (UID: \"3726fbaf-3984-4a4c-b08b-14ce2a1f3099\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" Sep 17 15:48:58.129421 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.129390 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68"] Sep 17 15:48:58.130092 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:48:58.130062 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8808bd6_4637_418d_a429_1b645909a933.slice/crio-c4daa9799ae1012dc18dc54f770a405a9dfbce9fc0d7612292171b16f807ecad WatchSource:0}: Error finding container c4daa9799ae1012dc18dc54f770a405a9dfbce9fc0d7612292171b16f807ecad: Status 404 returned error can't find the container with id c4daa9799ae1012dc18dc54f770a405a9dfbce9fc0d7612292171b16f807ecad Sep 17 15:48:58.159827 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.159802 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3726fbaf-3984-4a4c-b08b-14ce2a1f3099-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-4slgh\" (UID: \"3726fbaf-3984-4a4c-b08b-14ce2a1f3099\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" Sep 17 15:48:58.159977 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.159846 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3726fbaf-3984-4a4c-b08b-14ce2a1f3099-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-4slgh\" (UID: \"3726fbaf-3984-4a4c-b08b-14ce2a1f3099\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" Sep 17 15:48:58.159977 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.159927 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/3726fbaf-3984-4a4c-b08b-14ce2a1f3099-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-4slgh\" (UID: \"3726fbaf-3984-4a4c-b08b-14ce2a1f3099\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" Sep 17 15:48:58.160087 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.160007 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5skhq\" (UniqueName: \"kubernetes.io/projected/3726fbaf-3984-4a4c-b08b-14ce2a1f3099-kube-api-access-5skhq\") pod \"isvc-xgboost-graph-predictor-555fc69d56-4slgh\" (UID: \"3726fbaf-3984-4a4c-b08b-14ce2a1f3099\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" Sep 17 15:48:58.160087 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.160035 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3726fbaf-3984-4a4c-b08b-14ce2a1f3099-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-4slgh\" (UID: \"3726fbaf-3984-4a4c-b08b-14ce2a1f3099\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" Sep 17 15:48:58.160253 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.160232 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3726fbaf-3984-4a4c-b08b-14ce2a1f3099-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-4slgh\" (UID: \"3726fbaf-3984-4a4c-b08b-14ce2a1f3099\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" Sep 17 15:48:58.160545 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.160523 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3726fbaf-3984-4a4c-b08b-14ce2a1f3099-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-4slgh\" (UID: \"3726fbaf-3984-4a4c-b08b-14ce2a1f3099\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" Sep 17 15:48:58.160741 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.160716 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/3726fbaf-3984-4a4c-b08b-14ce2a1f3099-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-4slgh\" (UID: \"3726fbaf-3984-4a4c-b08b-14ce2a1f3099\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" Sep 17 15:48:58.161414 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.161394 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb"] Sep 17 15:48:58.162395 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.162377 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3726fbaf-3984-4a4c-b08b-14ce2a1f3099-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-4slgh\" (UID: \"3726fbaf-3984-4a4c-b08b-14ce2a1f3099\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" Sep 17 15:48:58.166178 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.166156 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" Sep 17 15:48:58.170884 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.170868 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-predictor-serving-cert\"" Sep 17 15:48:58.174921 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.174905 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\"" Sep 17 15:48:58.183508 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.183481 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5skhq\" (UniqueName: \"kubernetes.io/projected/3726fbaf-3984-4a4c-b08b-14ce2a1f3099-kube-api-access-5skhq\") pod \"isvc-xgboost-graph-predictor-555fc69d56-4slgh\" (UID: \"3726fbaf-3984-4a4c-b08b-14ce2a1f3099\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" Sep 17 15:48:58.190771 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.190748 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb"] Sep 17 15:48:58.207413 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.207382 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" Sep 17 15:48:58.260692 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.260654 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4a7b91d8-4f26-4041-a594-e867ec93d1ec-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb\" (UID: \"4a7b91d8-4f26-4041-a594-e867ec93d1ec\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" Sep 17 15:48:58.260885 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.260861 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4a7b91d8-4f26-4041-a594-e867ec93d1ec-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb\" (UID: \"4a7b91d8-4f26-4041-a594-e867ec93d1ec\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" Sep 17 15:48:58.261029 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.261008 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4a7b91d8-4f26-4041-a594-e867ec93d1ec-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb\" (UID: \"4a7b91d8-4f26-4041-a594-e867ec93d1ec\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" Sep 17 15:48:58.261109 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.261056 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcgh7\" (UniqueName: \"kubernetes.io/projected/4a7b91d8-4f26-4041-a594-e867ec93d1ec-kube-api-access-vcgh7\") pod \"isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb\" (UID: \"4a7b91d8-4f26-4041-a594-e867ec93d1ec\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" Sep 17 15:48:58.261109 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.261097 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4a7b91d8-4f26-4041-a594-e867ec93d1ec-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb\" (UID: \"4a7b91d8-4f26-4041-a594-e867ec93d1ec\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" Sep 17 15:48:58.361491 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.361456 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4a7b91d8-4f26-4041-a594-e867ec93d1ec-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb\" (UID: \"4a7b91d8-4f26-4041-a594-e867ec93d1ec\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" Sep 17 15:48:58.361680 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.361511 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4a7b91d8-4f26-4041-a594-e867ec93d1ec-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb\" (UID: \"4a7b91d8-4f26-4041-a594-e867ec93d1ec\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" Sep 17 15:48:58.361680 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.361539 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcgh7\" (UniqueName: \"kubernetes.io/projected/4a7b91d8-4f26-4041-a594-e867ec93d1ec-kube-api-access-vcgh7\") pod \"isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb\" (UID: \"4a7b91d8-4f26-4041-a594-e867ec93d1ec\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" Sep 17 15:48:58.361680 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.361572 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4a7b91d8-4f26-4041-a594-e867ec93d1ec-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb\" (UID: \"4a7b91d8-4f26-4041-a594-e867ec93d1ec\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" Sep 17 15:48:58.361859 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.361769 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4a7b91d8-4f26-4041-a594-e867ec93d1ec-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb\" (UID: \"4a7b91d8-4f26-4041-a594-e867ec93d1ec\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" Sep 17 15:48:58.361949 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.361867 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4a7b91d8-4f26-4041-a594-e867ec93d1ec-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb\" (UID: \"4a7b91d8-4f26-4041-a594-e867ec93d1ec\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" Sep 17 15:48:58.362224 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.362204 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4a7b91d8-4f26-4041-a594-e867ec93d1ec-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb\" (UID: \"4a7b91d8-4f26-4041-a594-e867ec93d1ec\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" Sep 17 15:48:58.362377 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.362355 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4a7b91d8-4f26-4041-a594-e867ec93d1ec-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb\" (UID: \"4a7b91d8-4f26-4041-a594-e867ec93d1ec\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" Sep 17 15:48:58.364256 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.364238 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4a7b91d8-4f26-4041-a594-e867ec93d1ec-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb\" (UID: \"4a7b91d8-4f26-4041-a594-e867ec93d1ec\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" Sep 17 15:48:58.385563 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.385531 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcgh7\" (UniqueName: \"kubernetes.io/projected/4a7b91d8-4f26-4041-a594-e867ec93d1ec-kube-api-access-vcgh7\") pod \"isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb\" (UID: \"4a7b91d8-4f26-4041-a594-e867ec93d1ec\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" Sep 17 15:48:58.488160 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.488110 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" Sep 17 15:48:58.499881 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.499749 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh"] Sep 17 15:48:58.502734 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:48:58.502692 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3726fbaf_3984_4a4c_b08b_14ce2a1f3099.slice/crio-085cd3d46d6519cd96344ef77ff1abc4e03b78c04d1e58a36944b5a1210ab75f WatchSource:0}: Error finding container 085cd3d46d6519cd96344ef77ff1abc4e03b78c04d1e58a36944b5a1210ab75f: Status 404 returned error can't find the container with id 085cd3d46d6519cd96344ef77ff1abc4e03b78c04d1e58a36944b5a1210ab75f Sep 17 15:48:58.756332 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.756234 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" event={"ID":"c8808bd6-4637-418d-a429-1b645909a933","Type":"ContainerStarted","Data":"0beb7e02a18e417daa900b871f673f1cc1fed9b4eb331e582a93ee74d1a0e9a7"} Sep 17 15:48:58.756332 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.756312 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" event={"ID":"c8808bd6-4637-418d-a429-1b645909a933","Type":"ContainerStarted","Data":"c4daa9799ae1012dc18dc54f770a405a9dfbce9fc0d7612292171b16f807ecad"} Sep 17 15:48:58.758249 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.758205 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" event={"ID":"3726fbaf-3984-4a4c-b08b-14ce2a1f3099","Type":"ContainerStarted","Data":"a81ef94bac62f7f122c319d49821b43eca29ad34d02ee7271f0dcf7e2aecfad6"} Sep 17 15:48:58.758409 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.758281 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" event={"ID":"3726fbaf-3984-4a4c-b08b-14ce2a1f3099","Type":"ContainerStarted","Data":"085cd3d46d6519cd96344ef77ff1abc4e03b78c04d1e58a36944b5a1210ab75f"} Sep 17 15:48:58.785878 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:58.785848 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb"] Sep 17 15:48:58.789761 ip-10-0-132-207 kubenswrapper[2581]: W0917 15:48:58.789724 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a7b91d8_4f26_4041_a594_e867ec93d1ec.slice/crio-60812051b960b4c3d239ba2ee6b3105cf84cdc079da28b7cf269197e2aad6cc8 WatchSource:0}: Error finding container 60812051b960b4c3d239ba2ee6b3105cf84cdc079da28b7cf269197e2aad6cc8: Status 404 returned error can't find the container with id 60812051b960b4c3d239ba2ee6b3105cf84cdc079da28b7cf269197e2aad6cc8 Sep 17 15:48:59.764419 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:59.764380 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" event={"ID":"4a7b91d8-4f26-4041-a594-e867ec93d1ec","Type":"ContainerStarted","Data":"baff410df784eed0247d8e212f68624e5db669692fac8f464d3c168aa67a55b5"} Sep 17 15:48:59.764787 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:48:59.764449 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" event={"ID":"4a7b91d8-4f26-4041-a594-e867ec93d1ec","Type":"ContainerStarted","Data":"60812051b960b4c3d239ba2ee6b3105cf84cdc079da28b7cf269197e2aad6cc8"} Sep 17 15:49:02.778115 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:02.778077 2581 generic.go:356] "Generic (PLEG): container finished" podID="4a7b91d8-4f26-4041-a594-e867ec93d1ec" containerID="baff410df784eed0247d8e212f68624e5db669692fac8f464d3c168aa67a55b5" exitCode=0 Sep 17 15:49:02.778537 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:02.778152 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" event={"ID":"4a7b91d8-4f26-4041-a594-e867ec93d1ec","Type":"ContainerDied","Data":"baff410df784eed0247d8e212f68624e5db669692fac8f464d3c168aa67a55b5"} Sep 17 15:49:02.779999 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:02.779973 2581 generic.go:356] "Generic (PLEG): container finished" podID="c8808bd6-4637-418d-a429-1b645909a933" containerID="0beb7e02a18e417daa900b871f673f1cc1fed9b4eb331e582a93ee74d1a0e9a7" exitCode=0 Sep 17 15:49:02.780097 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:02.780011 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" event={"ID":"c8808bd6-4637-418d-a429-1b645909a933","Type":"ContainerDied","Data":"0beb7e02a18e417daa900b871f673f1cc1fed9b4eb331e582a93ee74d1a0e9a7"} Sep 17 15:49:02.781718 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:02.781698 2581 generic.go:356] "Generic (PLEG): container finished" podID="3726fbaf-3984-4a4c-b08b-14ce2a1f3099" containerID="a81ef94bac62f7f122c319d49821b43eca29ad34d02ee7271f0dcf7e2aecfad6" exitCode=0 Sep 17 15:49:02.781774 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:02.781727 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" event={"ID":"3726fbaf-3984-4a4c-b08b-14ce2a1f3099","Type":"ContainerDied","Data":"a81ef94bac62f7f122c319d49821b43eca29ad34d02ee7271f0dcf7e2aecfad6"} Sep 17 15:49:31.769242 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:31.769204 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvbm6_9eb875df-5cc6-40f5-978e-f0adf0b823d5/ovn-acl-logging/0.log" Sep 17 15:49:31.769703 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:31.769268 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvbm6_9eb875df-5cc6-40f5-978e-f0adf0b823d5/ovn-acl-logging/0.log" Sep 17 15:49:31.993589 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:31.993561 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" event={"ID":"c8808bd6-4637-418d-a429-1b645909a933","Type":"ContainerStarted","Data":"83df74ffadd3eed0ecc3977abc23f7f97b529a74ee09f73e96674e81060325da"} Sep 17 15:49:31.995499 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:31.995471 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" event={"ID":"3726fbaf-3984-4a4c-b08b-14ce2a1f3099","Type":"ContainerStarted","Data":"8f36d33fee12893c4f5dfbb181e9514f3c711680cfb01ca24815e280866b4c64"} Sep 17 15:49:31.997236 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:31.997214 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" event={"ID":"4a7b91d8-4f26-4041-a594-e867ec93d1ec","Type":"ContainerStarted","Data":"c617db007d15713a71baf5c3d7f9e5d5a340832ab85284c9d1f4e3df7d6221c4"} Sep 17 15:49:35.017717 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:35.017621 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" event={"ID":"3726fbaf-3984-4a4c-b08b-14ce2a1f3099","Type":"ContainerStarted","Data":"9f225f6d4fa5a24a81ba4aec781ab0a48db2a6d305bd55a41d05801cbc394b4a"} Sep 17 15:49:35.018217 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:35.017726 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" Sep 17 15:49:35.018217 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:35.017757 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" Sep 17 15:49:35.019472 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:35.019437 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" podUID="3726fbaf-3984-4a4c-b08b-14ce2a1f3099" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Sep 17 15:49:35.020154 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:35.020126 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" event={"ID":"4a7b91d8-4f26-4041-a594-e867ec93d1ec","Type":"ContainerStarted","Data":"04b2095e6bc86e4b09026b6cbd94f176890c58cf2bf66bd640019dca170c2953"} Sep 17 15:49:35.020262 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:35.020185 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" Sep 17 15:49:35.020262 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:35.020233 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" Sep 17 15:49:35.021481 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:35.021454 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" podUID="4a7b91d8-4f26-4041-a594-e867ec93d1ec" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Sep 17 15:49:35.022384 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:35.022366 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" event={"ID":"c8808bd6-4637-418d-a429-1b645909a933","Type":"ContainerStarted","Data":"0a6ac356415ead32bd6a39f7cbfbb238040d59ee88a3e76c5cc7dca65247158c"} Sep 17 15:49:35.022532 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:35.022519 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" Sep 17 15:49:35.051216 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:35.051163 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" podStartSLOduration=2.188228043 podStartE2EDuration="38.051146053s" totalImagesPullingTime="31.835983861s" totalInitContainerRuntime="4.026934149s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:48:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:49:35.050945998 +0000 UTC m=+630.444912871" watchObservedRunningTime="2026-09-17 15:49:35.051146053 +0000 UTC m=+630.445112924" Sep 17 15:49:35.086173 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:35.086114 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" podStartSLOduration=1.518213456 podStartE2EDuration="37.086096327s" totalImagesPullingTime="31.775695714s" totalInitContainerRuntime="3.792187157s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:48:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:49:35.084885005 +0000 UTC m=+630.478851876" watchObservedRunningTime="2026-09-17 15:49:35.086096327 +0000 UTC m=+630.480063198" Sep 17 15:49:35.117818 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:35.117759 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" podStartSLOduration=2.2584864 podStartE2EDuration="38.117741891s" totalImagesPullingTime="31.810293072s" totalInitContainerRuntime="4.048962419s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:48:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:49:35.115777112 +0000 UTC m=+630.509743983" watchObservedRunningTime="2026-09-17 15:49:35.117741891 +0000 UTC m=+630.511708763" Sep 17 15:49:36.026573 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:36.026527 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" podUID="3726fbaf-3984-4a4c-b08b-14ce2a1f3099" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Sep 17 15:49:36.027107 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:36.026631 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" podUID="4a7b91d8-4f26-4041-a594-e867ec93d1ec" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Sep 17 15:49:36.027107 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:36.026852 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" Sep 17 15:49:36.027922 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:36.027865 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" podUID="c8808bd6-4637-418d-a429-1b645909a933" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused" Sep 17 15:49:37.030970 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:37.030924 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" podUID="c8808bd6-4637-418d-a429-1b645909a933" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused" Sep 17 15:49:41.032272 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:41.032241 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" Sep 17 15:49:41.032659 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:41.032354 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" Sep 17 15:49:41.032729 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:41.032697 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" podUID="4a7b91d8-4f26-4041-a594-e867ec93d1ec" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Sep 17 15:49:41.032848 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:41.032822 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" podUID="3726fbaf-3984-4a4c-b08b-14ce2a1f3099" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Sep 17 15:49:42.034964 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:42.034924 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" Sep 17 15:49:42.035636 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:42.035607 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" podUID="c8808bd6-4637-418d-a429-1b645909a933" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused" Sep 17 15:49:51.032770 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:51.032728 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" podUID="4a7b91d8-4f26-4041-a594-e867ec93d1ec" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Sep 17 15:49:51.033214 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:51.032875 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" podUID="3726fbaf-3984-4a4c-b08b-14ce2a1f3099" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Sep 17 15:49:52.035624 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:49:52.035586 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" podUID="c8808bd6-4637-418d-a429-1b645909a933" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused" Sep 17 15:50:01.032914 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:50:01.032861 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" podUID="3726fbaf-3984-4a4c-b08b-14ce2a1f3099" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Sep 17 15:50:01.033318 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:50:01.032860 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" podUID="4a7b91d8-4f26-4041-a594-e867ec93d1ec" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Sep 17 15:50:02.035686 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:50:02.035646 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" podUID="c8808bd6-4637-418d-a429-1b645909a933" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused" Sep 17 15:50:11.033455 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:50:11.033418 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" podUID="3726fbaf-3984-4a4c-b08b-14ce2a1f3099" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Sep 17 15:50:11.033965 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:50:11.033423 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" podUID="4a7b91d8-4f26-4041-a594-e867ec93d1ec" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Sep 17 15:50:12.035735 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:50:12.035694 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" podUID="c8808bd6-4637-418d-a429-1b645909a933" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused" Sep 17 15:50:21.033161 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:50:21.033110 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" podUID="4a7b91d8-4f26-4041-a594-e867ec93d1ec" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Sep 17 15:50:21.033558 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:50:21.033119 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" podUID="3726fbaf-3984-4a4c-b08b-14ce2a1f3099" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Sep 17 15:50:22.036167 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:50:22.036130 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" podUID="c8808bd6-4637-418d-a429-1b645909a933" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused" Sep 17 15:50:31.032710 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:50:31.032667 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" podUID="4a7b91d8-4f26-4041-a594-e867ec93d1ec" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Sep 17 15:50:31.033155 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:50:31.032828 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" podUID="3726fbaf-3984-4a4c-b08b-14ce2a1f3099" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Sep 17 15:50:32.036260 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:50:32.036215 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" podUID="c8808bd6-4637-418d-a429-1b645909a933" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused" Sep 17 15:50:41.033220 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:50:41.033182 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" podUID="4a7b91d8-4f26-4041-a594-e867ec93d1ec" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Sep 17 15:50:41.033607 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:50:41.033182 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" podUID="3726fbaf-3984-4a4c-b08b-14ce2a1f3099" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Sep 17 15:50:42.036339 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:50:42.036297 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" podUID="c8808bd6-4637-418d-a429-1b645909a933" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused" Sep 17 15:50:51.033799 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:50:51.033768 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" Sep 17 15:50:51.034314 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:50:51.033853 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" Sep 17 15:50:52.036551 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:50:52.036525 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" Sep 17 15:51:27.808293 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:27.808259 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb"] Sep 17 15:51:27.808838 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:27.808497 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" podUID="4a7b91d8-4f26-4041-a594-e867ec93d1ec" containerName="kserve-container" containerID="cri-o://c617db007d15713a71baf5c3d7f9e5d5a340832ab85284c9d1f4e3df7d6221c4" gracePeriod=30 Sep 17 15:51:27.808838 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:27.808539 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" podUID="4a7b91d8-4f26-4041-a594-e867ec93d1ec" containerName="kube-rbac-proxy" containerID="cri-o://04b2095e6bc86e4b09026b6cbd94f176890c58cf2bf66bd640019dca170c2953" gracePeriod=30 Sep 17 15:51:27.887068 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:27.887034 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68"] Sep 17 15:51:27.887312 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:27.887286 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" podUID="c8808bd6-4637-418d-a429-1b645909a933" containerName="kserve-container" containerID="cri-o://83df74ffadd3eed0ecc3977abc23f7f97b529a74ee09f73e96674e81060325da" gracePeriod=30 Sep 17 15:51:27.887360 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:27.887317 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" podUID="c8808bd6-4637-418d-a429-1b645909a933" containerName="kube-rbac-proxy" containerID="cri-o://0a6ac356415ead32bd6a39f7cbfbb238040d59ee88a3e76c5cc7dca65247158c" gracePeriod=30 Sep 17 15:51:27.907847 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:27.907815 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh"] Sep 17 15:51:27.908082 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:27.908062 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" podUID="3726fbaf-3984-4a4c-b08b-14ce2a1f3099" containerName="kserve-container" containerID="cri-o://8f36d33fee12893c4f5dfbb181e9514f3c711680cfb01ca24815e280866b4c64" gracePeriod=30 Sep 17 15:51:27.908162 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:27.908138 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" podUID="3726fbaf-3984-4a4c-b08b-14ce2a1f3099" containerName="kube-rbac-proxy" containerID="cri-o://9f225f6d4fa5a24a81ba4aec781ab0a48db2a6d305bd55a41d05801cbc394b4a" gracePeriod=30 Sep 17 15:51:28.511230 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:28.511198 2581 generic.go:356] "Generic (PLEG): container finished" podID="3726fbaf-3984-4a4c-b08b-14ce2a1f3099" containerID="9f225f6d4fa5a24a81ba4aec781ab0a48db2a6d305bd55a41d05801cbc394b4a" exitCode=2 Sep 17 15:51:28.511437 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:28.511276 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" event={"ID":"3726fbaf-3984-4a4c-b08b-14ce2a1f3099","Type":"ContainerDied","Data":"9f225f6d4fa5a24a81ba4aec781ab0a48db2a6d305bd55a41d05801cbc394b4a"} Sep 17 15:51:28.513424 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:28.513401 2581 generic.go:356] "Generic (PLEG): container finished" podID="4a7b91d8-4f26-4041-a594-e867ec93d1ec" containerID="04b2095e6bc86e4b09026b6cbd94f176890c58cf2bf66bd640019dca170c2953" exitCode=2 Sep 17 15:51:28.513524 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:28.513472 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" event={"ID":"4a7b91d8-4f26-4041-a594-e867ec93d1ec","Type":"ContainerDied","Data":"04b2095e6bc86e4b09026b6cbd94f176890c58cf2bf66bd640019dca170c2953"} Sep 17 15:51:28.515577 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:28.515556 2581 generic.go:356] "Generic (PLEG): container finished" podID="c8808bd6-4637-418d-a429-1b645909a933" containerID="0a6ac356415ead32bd6a39f7cbfbb238040d59ee88a3e76c5cc7dca65247158c" exitCode=2 Sep 17 15:51:28.515676 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:28.515591 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" event={"ID":"c8808bd6-4637-418d-a429-1b645909a933","Type":"ContainerDied","Data":"0a6ac356415ead32bd6a39f7cbfbb238040d59ee88a3e76c5cc7dca65247158c"} Sep 17 15:51:31.027551 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:31.027495 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" podUID="4a7b91d8-4f26-4041-a594-e867ec93d1ec" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.24:8643/healthz\": dial tcp 10.133.0.24:8643: connect: connection refused" Sep 17 15:51:31.027941 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:31.027495 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" podUID="3726fbaf-3984-4a4c-b08b-14ce2a1f3099" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.23:8643/healthz\": dial tcp 10.133.0.23:8643: connect: connection refused" Sep 17 15:51:31.032885 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:31.032858 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" podUID="4a7b91d8-4f26-4041-a594-e867ec93d1ec" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Sep 17 15:51:31.032968 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:31.032859 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" podUID="3726fbaf-3984-4a4c-b08b-14ce2a1f3099" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Sep 17 15:51:32.031795 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:32.031756 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" podUID="c8808bd6-4637-418d-a429-1b645909a933" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.22:8643/healthz\": dial tcp 10.133.0.22:8643: connect: connection refused" Sep 17 15:51:32.036147 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:32.036116 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" podUID="c8808bd6-4637-418d-a429-1b645909a933" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused" Sep 17 15:51:32.540375 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:32.540342 2581 generic.go:356] "Generic (PLEG): container finished" podID="3726fbaf-3984-4a4c-b08b-14ce2a1f3099" containerID="8f36d33fee12893c4f5dfbb181e9514f3c711680cfb01ca24815e280866b4c64" exitCode=0 Sep 17 15:51:32.540534 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:32.540413 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" event={"ID":"3726fbaf-3984-4a4c-b08b-14ce2a1f3099","Type":"ContainerDied","Data":"8f36d33fee12893c4f5dfbb181e9514f3c711680cfb01ca24815e280866b4c64"} Sep 17 15:51:32.554390 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:32.554367 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" Sep 17 15:51:32.652719 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:32.652633 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3726fbaf-3984-4a4c-b08b-14ce2a1f3099-kube-rbac-proxy-sar-config\") pod \"3726fbaf-3984-4a4c-b08b-14ce2a1f3099\" (UID: \"3726fbaf-3984-4a4c-b08b-14ce2a1f3099\") " Sep 17 15:51:32.652719 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:32.652681 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/3726fbaf-3984-4a4c-b08b-14ce2a1f3099-cabundle-cert\") pod \"3726fbaf-3984-4a4c-b08b-14ce2a1f3099\" (UID: \"3726fbaf-3984-4a4c-b08b-14ce2a1f3099\") " Sep 17 15:51:32.652719 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:32.652711 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5skhq\" (UniqueName: \"kubernetes.io/projected/3726fbaf-3984-4a4c-b08b-14ce2a1f3099-kube-api-access-5skhq\") pod \"3726fbaf-3984-4a4c-b08b-14ce2a1f3099\" (UID: \"3726fbaf-3984-4a4c-b08b-14ce2a1f3099\") " Sep 17 15:51:32.652978 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:32.652734 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3726fbaf-3984-4a4c-b08b-14ce2a1f3099-kserve-provision-location\") pod \"3726fbaf-3984-4a4c-b08b-14ce2a1f3099\" (UID: \"3726fbaf-3984-4a4c-b08b-14ce2a1f3099\") " Sep 17 15:51:32.652978 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:32.652774 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3726fbaf-3984-4a4c-b08b-14ce2a1f3099-proxy-tls\") pod \"3726fbaf-3984-4a4c-b08b-14ce2a1f3099\" (UID: \"3726fbaf-3984-4a4c-b08b-14ce2a1f3099\") " Sep 17 15:51:32.653118 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:32.653091 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3726fbaf-3984-4a4c-b08b-14ce2a1f3099-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "3726fbaf-3984-4a4c-b08b-14ce2a1f3099" (UID: "3726fbaf-3984-4a4c-b08b-14ce2a1f3099"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 15:51:32.653118 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:32.653106 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3726fbaf-3984-4a4c-b08b-14ce2a1f3099-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "3726fbaf-3984-4a4c-b08b-14ce2a1f3099" (UID: "3726fbaf-3984-4a4c-b08b-14ce2a1f3099"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 15:51:32.653225 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:32.653135 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3726fbaf-3984-4a4c-b08b-14ce2a1f3099-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "3726fbaf-3984-4a4c-b08b-14ce2a1f3099" (UID: "3726fbaf-3984-4a4c-b08b-14ce2a1f3099"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 15:51:32.655228 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:32.655188 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3726fbaf-3984-4a4c-b08b-14ce2a1f3099-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "3726fbaf-3984-4a4c-b08b-14ce2a1f3099" (UID: "3726fbaf-3984-4a4c-b08b-14ce2a1f3099"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 15:51:32.655339 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:32.655283 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3726fbaf-3984-4a4c-b08b-14ce2a1f3099-kube-api-access-5skhq" (OuterVolumeSpecName: "kube-api-access-5skhq") pod "3726fbaf-3984-4a4c-b08b-14ce2a1f3099" (UID: "3726fbaf-3984-4a4c-b08b-14ce2a1f3099"). InnerVolumeSpecName "kube-api-access-5skhq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 15:51:32.754418 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:32.754374 2581 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/3726fbaf-3984-4a4c-b08b-14ce2a1f3099-cabundle-cert\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:51:32.754418 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:32.754412 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5skhq\" (UniqueName: \"kubernetes.io/projected/3726fbaf-3984-4a4c-b08b-14ce2a1f3099-kube-api-access-5skhq\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:51:32.754418 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:32.754422 2581 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3726fbaf-3984-4a4c-b08b-14ce2a1f3099-kserve-provision-location\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:51:32.754418 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:32.754431 2581 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3726fbaf-3984-4a4c-b08b-14ce2a1f3099-proxy-tls\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:51:32.754690 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:32.754440 2581 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3726fbaf-3984-4a4c-b08b-14ce2a1f3099-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:51:33.062117 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.062098 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" Sep 17 15:51:33.068605 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.068581 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" Sep 17 15:51:33.157588 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.157561 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4a7b91d8-4f26-4041-a594-e867ec93d1ec-cabundle-cert\") pod \"4a7b91d8-4f26-4041-a594-e867ec93d1ec\" (UID: \"4a7b91d8-4f26-4041-a594-e867ec93d1ec\") " Sep 17 15:51:33.157775 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.157600 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c8808bd6-4637-418d-a429-1b645909a933-kube-rbac-proxy-sar-config\") pod \"c8808bd6-4637-418d-a429-1b645909a933\" (UID: \"c8808bd6-4637-418d-a429-1b645909a933\") " Sep 17 15:51:33.157775 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.157617 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c8808bd6-4637-418d-a429-1b645909a933-cabundle-cert\") pod \"c8808bd6-4637-418d-a429-1b645909a933\" (UID: \"c8808bd6-4637-418d-a429-1b645909a933\") " Sep 17 15:51:33.157775 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.157644 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4a7b91d8-4f26-4041-a594-e867ec93d1ec-proxy-tls\") pod \"4a7b91d8-4f26-4041-a594-e867ec93d1ec\" (UID: \"4a7b91d8-4f26-4041-a594-e867ec93d1ec\") " Sep 17 15:51:33.157775 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.157697 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c8808bd6-4637-418d-a429-1b645909a933-kserve-provision-location\") pod \"c8808bd6-4637-418d-a429-1b645909a933\" (UID: \"c8808bd6-4637-418d-a429-1b645909a933\") " Sep 17 15:51:33.157775 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.157733 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9gc4\" (UniqueName: \"kubernetes.io/projected/c8808bd6-4637-418d-a429-1b645909a933-kube-api-access-j9gc4\") pod \"c8808bd6-4637-418d-a429-1b645909a933\" (UID: \"c8808bd6-4637-418d-a429-1b645909a933\") " Sep 17 15:51:33.157775 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.157766 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c8808bd6-4637-418d-a429-1b645909a933-proxy-tls\") pod \"c8808bd6-4637-418d-a429-1b645909a933\" (UID: \"c8808bd6-4637-418d-a429-1b645909a933\") " Sep 17 15:51:33.158105 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.157795 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcgh7\" (UniqueName: \"kubernetes.io/projected/4a7b91d8-4f26-4041-a594-e867ec93d1ec-kube-api-access-vcgh7\") pod \"4a7b91d8-4f26-4041-a594-e867ec93d1ec\" (UID: \"4a7b91d8-4f26-4041-a594-e867ec93d1ec\") " Sep 17 15:51:33.158105 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.157834 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4a7b91d8-4f26-4041-a594-e867ec93d1ec-kserve-provision-location\") pod \"4a7b91d8-4f26-4041-a594-e867ec93d1ec\" (UID: \"4a7b91d8-4f26-4041-a594-e867ec93d1ec\") " Sep 17 15:51:33.158105 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.157905 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4a7b91d8-4f26-4041-a594-e867ec93d1ec-kube-rbac-proxy-sar-config\") pod \"4a7b91d8-4f26-4041-a594-e867ec93d1ec\" (UID: \"4a7b91d8-4f26-4041-a594-e867ec93d1ec\") " Sep 17 15:51:33.158105 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.158021 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8808bd6-4637-418d-a429-1b645909a933-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "c8808bd6-4637-418d-a429-1b645909a933" (UID: "c8808bd6-4637-418d-a429-1b645909a933"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 15:51:33.158105 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.158026 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8808bd6-4637-418d-a429-1b645909a933-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "c8808bd6-4637-418d-a429-1b645909a933" (UID: "c8808bd6-4637-418d-a429-1b645909a933"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 15:51:33.158105 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.158021 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a7b91d8-4f26-4041-a594-e867ec93d1ec-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "4a7b91d8-4f26-4041-a594-e867ec93d1ec" (UID: "4a7b91d8-4f26-4041-a594-e867ec93d1ec"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 15:51:33.158416 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.158316 2581 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4a7b91d8-4f26-4041-a594-e867ec93d1ec-cabundle-cert\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:51:33.158416 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.158338 2581 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c8808bd6-4637-418d-a429-1b645909a933-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:51:33.158416 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.158353 2581 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c8808bd6-4637-418d-a429-1b645909a933-cabundle-cert\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:51:33.158416 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.158308 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8808bd6-4637-418d-a429-1b645909a933-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "c8808bd6-4637-418d-a429-1b645909a933" (UID: "c8808bd6-4637-418d-a429-1b645909a933"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 15:51:33.158416 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.158371 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a7b91d8-4f26-4041-a594-e867ec93d1ec-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "4a7b91d8-4f26-4041-a594-e867ec93d1ec" (UID: "4a7b91d8-4f26-4041-a594-e867ec93d1ec"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 15:51:33.158681 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.158422 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a7b91d8-4f26-4041-a594-e867ec93d1ec-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "4a7b91d8-4f26-4041-a594-e867ec93d1ec" (UID: "4a7b91d8-4f26-4041-a594-e867ec93d1ec"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 15:51:33.160625 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.160531 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a7b91d8-4f26-4041-a594-e867ec93d1ec-kube-api-access-vcgh7" (OuterVolumeSpecName: "kube-api-access-vcgh7") pod "4a7b91d8-4f26-4041-a594-e867ec93d1ec" (UID: "4a7b91d8-4f26-4041-a594-e867ec93d1ec"). InnerVolumeSpecName "kube-api-access-vcgh7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 15:51:33.160625 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.160597 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a7b91d8-4f26-4041-a594-e867ec93d1ec-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "4a7b91d8-4f26-4041-a594-e867ec93d1ec" (UID: "4a7b91d8-4f26-4041-a594-e867ec93d1ec"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 15:51:33.161029 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.161010 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8808bd6-4637-418d-a429-1b645909a933-kube-api-access-j9gc4" (OuterVolumeSpecName: "kube-api-access-j9gc4") pod "c8808bd6-4637-418d-a429-1b645909a933" (UID: "c8808bd6-4637-418d-a429-1b645909a933"). InnerVolumeSpecName "kube-api-access-j9gc4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 15:51:33.161104 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.161003 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8808bd6-4637-418d-a429-1b645909a933-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "c8808bd6-4637-418d-a429-1b645909a933" (UID: "c8808bd6-4637-418d-a429-1b645909a933"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 15:51:33.259680 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.259582 2581 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4a7b91d8-4f26-4041-a594-e867ec93d1ec-proxy-tls\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:51:33.259680 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.259622 2581 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c8808bd6-4637-418d-a429-1b645909a933-kserve-provision-location\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:51:33.259680 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.259633 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9gc4\" (UniqueName: \"kubernetes.io/projected/c8808bd6-4637-418d-a429-1b645909a933-kube-api-access-j9gc4\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:51:33.259680 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.259643 2581 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c8808bd6-4637-418d-a429-1b645909a933-proxy-tls\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:51:33.259680 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.259653 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcgh7\" (UniqueName: \"kubernetes.io/projected/4a7b91d8-4f26-4041-a594-e867ec93d1ec-kube-api-access-vcgh7\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:51:33.259680 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.259661 2581 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4a7b91d8-4f26-4041-a594-e867ec93d1ec-kserve-provision-location\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:51:33.259680 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.259669 2581 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4a7b91d8-4f26-4041-a594-e867ec93d1ec-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 15:51:33.547141 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.547055 2581 generic.go:356] "Generic (PLEG): container finished" podID="4a7b91d8-4f26-4041-a594-e867ec93d1ec" containerID="c617db007d15713a71baf5c3d7f9e5d5a340832ab85284c9d1f4e3df7d6221c4" exitCode=0 Sep 17 15:51:33.547297 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.547166 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" Sep 17 15:51:33.547297 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.547180 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" event={"ID":"4a7b91d8-4f26-4041-a594-e867ec93d1ec","Type":"ContainerDied","Data":"c617db007d15713a71baf5c3d7f9e5d5a340832ab85284c9d1f4e3df7d6221c4"} Sep 17 15:51:33.547297 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.547230 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb" event={"ID":"4a7b91d8-4f26-4041-a594-e867ec93d1ec","Type":"ContainerDied","Data":"60812051b960b4c3d239ba2ee6b3105cf84cdc079da28b7cf269197e2aad6cc8"} Sep 17 15:51:33.547297 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.547267 2581 scope.go:117] "RemoveContainer" containerID="04b2095e6bc86e4b09026b6cbd94f176890c58cf2bf66bd640019dca170c2953" Sep 17 15:51:33.549476 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.549445 2581 generic.go:356] "Generic (PLEG): container finished" podID="c8808bd6-4637-418d-a429-1b645909a933" containerID="83df74ffadd3eed0ecc3977abc23f7f97b529a74ee09f73e96674e81060325da" exitCode=0 Sep 17 15:51:33.549613 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.549491 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" Sep 17 15:51:33.549613 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.549516 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" event={"ID":"c8808bd6-4637-418d-a429-1b645909a933","Type":"ContainerDied","Data":"83df74ffadd3eed0ecc3977abc23f7f97b529a74ee09f73e96674e81060325da"} Sep 17 15:51:33.549613 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.549573 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68" event={"ID":"c8808bd6-4637-418d-a429-1b645909a933","Type":"ContainerDied","Data":"c4daa9799ae1012dc18dc54f770a405a9dfbce9fc0d7612292171b16f807ecad"} Sep 17 15:51:33.551964 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.551941 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" event={"ID":"3726fbaf-3984-4a4c-b08b-14ce2a1f3099","Type":"ContainerDied","Data":"085cd3d46d6519cd96344ef77ff1abc4e03b78c04d1e58a36944b5a1210ab75f"} Sep 17 15:51:33.552049 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.552000 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh" Sep 17 15:51:33.557705 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.557685 2581 scope.go:117] "RemoveContainer" containerID="c617db007d15713a71baf5c3d7f9e5d5a340832ab85284c9d1f4e3df7d6221c4" Sep 17 15:51:33.565774 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.565758 2581 scope.go:117] "RemoveContainer" containerID="baff410df784eed0247d8e212f68624e5db669692fac8f464d3c168aa67a55b5" Sep 17 15:51:33.573186 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.573169 2581 scope.go:117] "RemoveContainer" containerID="04b2095e6bc86e4b09026b6cbd94f176890c58cf2bf66bd640019dca170c2953" Sep 17 15:51:33.573470 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:51:33.573455 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04b2095e6bc86e4b09026b6cbd94f176890c58cf2bf66bd640019dca170c2953\": container with ID starting with 04b2095e6bc86e4b09026b6cbd94f176890c58cf2bf66bd640019dca170c2953 not found: ID does not exist" containerID="04b2095e6bc86e4b09026b6cbd94f176890c58cf2bf66bd640019dca170c2953" Sep 17 15:51:33.573511 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.573480 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04b2095e6bc86e4b09026b6cbd94f176890c58cf2bf66bd640019dca170c2953"} err="failed to get container status \"04b2095e6bc86e4b09026b6cbd94f176890c58cf2bf66bd640019dca170c2953\": rpc error: code = NotFound desc = could not find container \"04b2095e6bc86e4b09026b6cbd94f176890c58cf2bf66bd640019dca170c2953\": container with ID starting with 04b2095e6bc86e4b09026b6cbd94f176890c58cf2bf66bd640019dca170c2953 not found: ID does not exist" Sep 17 15:51:33.573511 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.573496 2581 scope.go:117] "RemoveContainer" containerID="c617db007d15713a71baf5c3d7f9e5d5a340832ab85284c9d1f4e3df7d6221c4" Sep 17 15:51:33.573775 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:51:33.573758 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c617db007d15713a71baf5c3d7f9e5d5a340832ab85284c9d1f4e3df7d6221c4\": container with ID starting with c617db007d15713a71baf5c3d7f9e5d5a340832ab85284c9d1f4e3df7d6221c4 not found: ID does not exist" containerID="c617db007d15713a71baf5c3d7f9e5d5a340832ab85284c9d1f4e3df7d6221c4" Sep 17 15:51:33.573821 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.573781 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c617db007d15713a71baf5c3d7f9e5d5a340832ab85284c9d1f4e3df7d6221c4"} err="failed to get container status \"c617db007d15713a71baf5c3d7f9e5d5a340832ab85284c9d1f4e3df7d6221c4\": rpc error: code = NotFound desc = could not find container \"c617db007d15713a71baf5c3d7f9e5d5a340832ab85284c9d1f4e3df7d6221c4\": container with ID starting with c617db007d15713a71baf5c3d7f9e5d5a340832ab85284c9d1f4e3df7d6221c4 not found: ID does not exist" Sep 17 15:51:33.573821 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.573797 2581 scope.go:117] "RemoveContainer" containerID="baff410df784eed0247d8e212f68624e5db669692fac8f464d3c168aa67a55b5" Sep 17 15:51:33.574050 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:51:33.574032 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"baff410df784eed0247d8e212f68624e5db669692fac8f464d3c168aa67a55b5\": container with ID starting with baff410df784eed0247d8e212f68624e5db669692fac8f464d3c168aa67a55b5 not found: ID does not exist" containerID="baff410df784eed0247d8e212f68624e5db669692fac8f464d3c168aa67a55b5" Sep 17 15:51:33.574115 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.574057 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baff410df784eed0247d8e212f68624e5db669692fac8f464d3c168aa67a55b5"} err="failed to get container status \"baff410df784eed0247d8e212f68624e5db669692fac8f464d3c168aa67a55b5\": rpc error: code = NotFound desc = could not find container \"baff410df784eed0247d8e212f68624e5db669692fac8f464d3c168aa67a55b5\": container with ID starting with baff410df784eed0247d8e212f68624e5db669692fac8f464d3c168aa67a55b5 not found: ID does not exist" Sep 17 15:51:33.574115 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.574080 2581 scope.go:117] "RemoveContainer" containerID="0a6ac356415ead32bd6a39f7cbfbb238040d59ee88a3e76c5cc7dca65247158c" Sep 17 15:51:33.581497 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.581472 2581 scope.go:117] "RemoveContainer" containerID="83df74ffadd3eed0ecc3977abc23f7f97b529a74ee09f73e96674e81060325da" Sep 17 15:51:33.583120 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.583099 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh"] Sep 17 15:51:33.588904 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.588869 2581 scope.go:117] "RemoveContainer" containerID="0beb7e02a18e417daa900b871f673f1cc1fed9b4eb331e582a93ee74d1a0e9a7" Sep 17 15:51:33.594464 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.594443 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4slgh"] Sep 17 15:51:33.597295 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.597276 2581 scope.go:117] "RemoveContainer" containerID="0a6ac356415ead32bd6a39f7cbfbb238040d59ee88a3e76c5cc7dca65247158c" Sep 17 15:51:33.597577 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:51:33.597557 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a6ac356415ead32bd6a39f7cbfbb238040d59ee88a3e76c5cc7dca65247158c\": container with ID starting with 0a6ac356415ead32bd6a39f7cbfbb238040d59ee88a3e76c5cc7dca65247158c not found: ID does not exist" containerID="0a6ac356415ead32bd6a39f7cbfbb238040d59ee88a3e76c5cc7dca65247158c" Sep 17 15:51:33.597645 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.597588 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a6ac356415ead32bd6a39f7cbfbb238040d59ee88a3e76c5cc7dca65247158c"} err="failed to get container status \"0a6ac356415ead32bd6a39f7cbfbb238040d59ee88a3e76c5cc7dca65247158c\": rpc error: code = NotFound desc = could not find container \"0a6ac356415ead32bd6a39f7cbfbb238040d59ee88a3e76c5cc7dca65247158c\": container with ID starting with 0a6ac356415ead32bd6a39f7cbfbb238040d59ee88a3e76c5cc7dca65247158c not found: ID does not exist" Sep 17 15:51:33.597645 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.597613 2581 scope.go:117] "RemoveContainer" containerID="83df74ffadd3eed0ecc3977abc23f7f97b529a74ee09f73e96674e81060325da" Sep 17 15:51:33.597882 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:51:33.597865 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83df74ffadd3eed0ecc3977abc23f7f97b529a74ee09f73e96674e81060325da\": container with ID starting with 83df74ffadd3eed0ecc3977abc23f7f97b529a74ee09f73e96674e81060325da not found: ID does not exist" containerID="83df74ffadd3eed0ecc3977abc23f7f97b529a74ee09f73e96674e81060325da" Sep 17 15:51:33.597950 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.597905 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83df74ffadd3eed0ecc3977abc23f7f97b529a74ee09f73e96674e81060325da"} err="failed to get container status \"83df74ffadd3eed0ecc3977abc23f7f97b529a74ee09f73e96674e81060325da\": rpc error: code = NotFound desc = could not find container \"83df74ffadd3eed0ecc3977abc23f7f97b529a74ee09f73e96674e81060325da\": container with ID starting with 83df74ffadd3eed0ecc3977abc23f7f97b529a74ee09f73e96674e81060325da not found: ID does not exist" Sep 17 15:51:33.597950 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.597921 2581 scope.go:117] "RemoveContainer" containerID="0beb7e02a18e417daa900b871f673f1cc1fed9b4eb331e582a93ee74d1a0e9a7" Sep 17 15:51:33.598197 ip-10-0-132-207 kubenswrapper[2581]: E0917 15:51:33.598179 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0beb7e02a18e417daa900b871f673f1cc1fed9b4eb331e582a93ee74d1a0e9a7\": container with ID starting with 0beb7e02a18e417daa900b871f673f1cc1fed9b4eb331e582a93ee74d1a0e9a7 not found: ID does not exist" containerID="0beb7e02a18e417daa900b871f673f1cc1fed9b4eb331e582a93ee74d1a0e9a7" Sep 17 15:51:33.598238 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.598210 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0beb7e02a18e417daa900b871f673f1cc1fed9b4eb331e582a93ee74d1a0e9a7"} err="failed to get container status \"0beb7e02a18e417daa900b871f673f1cc1fed9b4eb331e582a93ee74d1a0e9a7\": rpc error: code = NotFound desc = could not find container \"0beb7e02a18e417daa900b871f673f1cc1fed9b4eb331e582a93ee74d1a0e9a7\": container with ID starting with 0beb7e02a18e417daa900b871f673f1cc1fed9b4eb331e582a93ee74d1a0e9a7 not found: ID does not exist" Sep 17 15:51:33.598238 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.598225 2581 scope.go:117] "RemoveContainer" containerID="9f225f6d4fa5a24a81ba4aec781ab0a48db2a6d305bd55a41d05801cbc394b4a" Sep 17 15:51:33.605519 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.605503 2581 scope.go:117] "RemoveContainer" containerID="8f36d33fee12893c4f5dfbb181e9514f3c711680cfb01ca24815e280866b4c64" Sep 17 15:51:33.611013 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.610992 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb"] Sep 17 15:51:33.613306 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.613278 2581 scope.go:117] "RemoveContainer" containerID="a81ef94bac62f7f122c319d49821b43eca29ad34d02ee7271f0dcf7e2aecfad6" Sep 17 15:51:33.616379 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.616357 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-bd85d5cd8-qwxvb"] Sep 17 15:51:33.629527 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.629491 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68"] Sep 17 15:51:33.635931 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:33.635884 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c5c8df88c-4gn68"] Sep 17 15:51:35.139335 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:35.139295 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3726fbaf-3984-4a4c-b08b-14ce2a1f3099" path="/var/lib/kubelet/pods/3726fbaf-3984-4a4c-b08b-14ce2a1f3099/volumes" Sep 17 15:51:35.139792 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:35.139779 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a7b91d8-4f26-4041-a594-e867ec93d1ec" path="/var/lib/kubelet/pods/4a7b91d8-4f26-4041-a594-e867ec93d1ec/volumes" Sep 17 15:51:35.140542 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:51:35.140526 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8808bd6-4637-418d-a429-1b645909a933" path="/var/lib/kubelet/pods/c8808bd6-4637-418d-a429-1b645909a933/volumes" Sep 17 15:54:31.794152 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:54:31.794121 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvbm6_9eb875df-5cc6-40f5-978e-f0adf0b823d5/ovn-acl-logging/0.log" Sep 17 15:54:31.796628 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:54:31.796608 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvbm6_9eb875df-5cc6-40f5-978e-f0adf0b823d5/ovn-acl-logging/0.log" Sep 17 15:59:31.818731 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:59:31.818703 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvbm6_9eb875df-5cc6-40f5-978e-f0adf0b823d5/ovn-acl-logging/0.log" Sep 17 15:59:31.822470 ip-10-0-132-207 kubenswrapper[2581]: I0917 15:59:31.822450 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvbm6_9eb875df-5cc6-40f5-978e-f0adf0b823d5/ovn-acl-logging/0.log" Sep 17 16:04:31.843372 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:04:31.843283 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvbm6_9eb875df-5cc6-40f5-978e-f0adf0b823d5/ovn-acl-logging/0.log" Sep 17 16:04:31.848540 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:04:31.848518 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvbm6_9eb875df-5cc6-40f5-978e-f0adf0b823d5/ovn-acl-logging/0.log" Sep 17 16:09:31.869648 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:09:31.869620 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvbm6_9eb875df-5cc6-40f5-978e-f0adf0b823d5/ovn-acl-logging/0.log" Sep 17 16:09:31.875788 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:09:31.875766 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvbm6_9eb875df-5cc6-40f5-978e-f0adf0b823d5/ovn-acl-logging/0.log" Sep 17 16:14:31.895815 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:14:31.895786 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvbm6_9eb875df-5cc6-40f5-978e-f0adf0b823d5/ovn-acl-logging/0.log" Sep 17 16:14:31.902680 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:14:31.902660 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvbm6_9eb875df-5cc6-40f5-978e-f0adf0b823d5/ovn-acl-logging/0.log" Sep 17 16:19:31.922203 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:19:31.922071 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvbm6_9eb875df-5cc6-40f5-978e-f0adf0b823d5/ovn-acl-logging/0.log" Sep 17 16:19:31.934740 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:19:31.934716 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvbm6_9eb875df-5cc6-40f5-978e-f0adf0b823d5/ovn-acl-logging/0.log" Sep 17 16:24:31.952640 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:24:31.952522 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvbm6_9eb875df-5cc6-40f5-978e-f0adf0b823d5/ovn-acl-logging/0.log" Sep 17 16:24:31.960398 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:24:31.960370 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvbm6_9eb875df-5cc6-40f5-978e-f0adf0b823d5/ovn-acl-logging/0.log" Sep 17 16:28:28.932148 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:28.932061 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8bvb9/must-gather-ldgw6"] Sep 17 16:28:28.932668 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:28.932477 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8808bd6-4637-418d-a429-1b645909a933" containerName="storage-initializer" Sep 17 16:28:28.932668 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:28.932493 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8808bd6-4637-418d-a429-1b645909a933" containerName="storage-initializer" Sep 17 16:28:28.932668 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:28.932502 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a7b91d8-4f26-4041-a594-e867ec93d1ec" containerName="kube-rbac-proxy" Sep 17 16:28:28.932668 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:28.932509 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a7b91d8-4f26-4041-a594-e867ec93d1ec" containerName="kube-rbac-proxy" Sep 17 16:28:28.932668 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:28.932516 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3726fbaf-3984-4a4c-b08b-14ce2a1f3099" containerName="kube-rbac-proxy" Sep 17 16:28:28.932668 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:28.932522 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3726fbaf-3984-4a4c-b08b-14ce2a1f3099" containerName="kube-rbac-proxy" Sep 17 16:28:28.932668 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:28.932544 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3726fbaf-3984-4a4c-b08b-14ce2a1f3099" containerName="storage-initializer" Sep 17 16:28:28.932668 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:28.932552 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3726fbaf-3984-4a4c-b08b-14ce2a1f3099" containerName="storage-initializer" Sep 17 16:28:28.932668 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:28.932562 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8808bd6-4637-418d-a429-1b645909a933" containerName="kube-rbac-proxy" Sep 17 16:28:28.932668 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:28.932569 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8808bd6-4637-418d-a429-1b645909a933" containerName="kube-rbac-proxy" Sep 17 16:28:28.932668 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:28.932581 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8808bd6-4637-418d-a429-1b645909a933" containerName="kserve-container" Sep 17 16:28:28.932668 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:28.932587 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8808bd6-4637-418d-a429-1b645909a933" containerName="kserve-container" Sep 17 16:28:28.932668 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:28.932593 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3726fbaf-3984-4a4c-b08b-14ce2a1f3099" containerName="kserve-container" Sep 17 16:28:28.932668 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:28.932598 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3726fbaf-3984-4a4c-b08b-14ce2a1f3099" containerName="kserve-container" Sep 17 16:28:28.932668 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:28.932605 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a7b91d8-4f26-4041-a594-e867ec93d1ec" containerName="storage-initializer" Sep 17 16:28:28.932668 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:28.932609 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a7b91d8-4f26-4041-a594-e867ec93d1ec" containerName="storage-initializer" Sep 17 16:28:28.932668 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:28.932618 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a7b91d8-4f26-4041-a594-e867ec93d1ec" containerName="kserve-container" Sep 17 16:28:28.932668 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:28.932626 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a7b91d8-4f26-4041-a594-e867ec93d1ec" containerName="kserve-container" Sep 17 16:28:28.933354 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:28.932715 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3726fbaf-3984-4a4c-b08b-14ce2a1f3099" containerName="kserve-container" Sep 17 16:28:28.933354 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:28.932725 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8808bd6-4637-418d-a429-1b645909a933" containerName="kserve-container" Sep 17 16:28:28.933354 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:28.932735 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8808bd6-4637-418d-a429-1b645909a933" containerName="kube-rbac-proxy" Sep 17 16:28:28.933354 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:28.932744 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3726fbaf-3984-4a4c-b08b-14ce2a1f3099" containerName="kube-rbac-proxy" Sep 17 16:28:28.933354 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:28.932755 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a7b91d8-4f26-4041-a594-e867ec93d1ec" containerName="kube-rbac-proxy" Sep 17 16:28:28.933354 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:28.932764 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a7b91d8-4f26-4041-a594-e867ec93d1ec" containerName="kserve-container" Sep 17 16:28:28.936072 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:28.936056 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8bvb9/must-gather-ldgw6" Sep 17 16:28:28.938811 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:28.938790 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8bvb9\"/\"default-dockercfg-xgdxn\"" Sep 17 16:28:28.939489 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:28.939473 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8bvb9\"/\"openshift-service-ca.crt\"" Sep 17 16:28:28.939552 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:28.939473 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8bvb9\"/\"kube-root-ca.crt\"" Sep 17 16:28:28.950814 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:28.950787 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8bvb9/must-gather-ldgw6"] Sep 17 16:28:29.065026 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:29.064992 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3-must-gather-output\") pod \"must-gather-ldgw6\" (UID: \"a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3\") " pod="openshift-must-gather-8bvb9/must-gather-ldgw6" Sep 17 16:28:29.065216 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:29.065048 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hc89\" (UniqueName: \"kubernetes.io/projected/a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3-kube-api-access-7hc89\") pod \"must-gather-ldgw6\" (UID: \"a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3\") " pod="openshift-must-gather-8bvb9/must-gather-ldgw6" Sep 17 16:28:29.166073 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:29.166028 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3-must-gather-output\") pod \"must-gather-ldgw6\" (UID: \"a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3\") " pod="openshift-must-gather-8bvb9/must-gather-ldgw6" Sep 17 16:28:29.166253 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:29.166088 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hc89\" (UniqueName: \"kubernetes.io/projected/a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3-kube-api-access-7hc89\") pod \"must-gather-ldgw6\" (UID: \"a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3\") " pod="openshift-must-gather-8bvb9/must-gather-ldgw6" Sep 17 16:28:29.166419 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:29.166397 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3-must-gather-output\") pod \"must-gather-ldgw6\" (UID: \"a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3\") " pod="openshift-must-gather-8bvb9/must-gather-ldgw6" Sep 17 16:28:29.179590 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:29.179556 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hc89\" (UniqueName: \"kubernetes.io/projected/a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3-kube-api-access-7hc89\") pod \"must-gather-ldgw6\" (UID: \"a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3\") " pod="openshift-must-gather-8bvb9/must-gather-ldgw6" Sep 17 16:28:29.267272 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:29.267164 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8bvb9/must-gather-ldgw6" Sep 17 16:28:29.538394 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:29.538363 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8bvb9/must-gather-ldgw6"] Sep 17 16:28:29.541000 ip-10-0-132-207 kubenswrapper[2581]: W0917 16:28:29.540970 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda3a87673_04b4_4688_b7d1_ae4f9fe9f7c3.slice/crio-8bf97d20d07c6456d86d0c41125e56a1d97f11c4a1bcc24cae0aa467338fee6f WatchSource:0}: Error finding container 8bf97d20d07c6456d86d0c41125e56a1d97f11c4a1bcc24cae0aa467338fee6f: Status 404 returned error can't find the container with id 8bf97d20d07c6456d86d0c41125e56a1d97f11c4a1bcc24cae0aa467338fee6f Sep 17 16:28:29.542779 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:29.542762 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 16:28:30.202369 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:30.202324 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8bvb9/must-gather-ldgw6" event={"ID":"a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3","Type":"ContainerStarted","Data":"8bf97d20d07c6456d86d0c41125e56a1d97f11c4a1bcc24cae0aa467338fee6f"} Sep 17 16:28:36.230333 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:36.230229 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8bvb9/must-gather-ldgw6" event={"ID":"a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3","Type":"ContainerStarted","Data":"c8be65185c8c454dff4fe24edafa278936624bcd1cfe9d631b5efad09022a956"} Sep 17 16:28:36.230333 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:36.230282 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8bvb9/must-gather-ldgw6" event={"ID":"a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3","Type":"ContainerStarted","Data":"61030580dce02fd5d23ff57dcf45f1d14d11497ace24449384378eb6dcc075f2"} Sep 17 16:28:36.258586 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:36.258528 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8bvb9/must-gather-ldgw6" podStartSLOduration=2.080022637 podStartE2EDuration="8.258510104s" totalImagesPullingTime="6.178487467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:28:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:28:36.256380915 +0000 UTC m=+2971.650347789" watchObservedRunningTime="2026-09-17 16:28:36.258510104 +0000 UTC m=+2971.652476976" Sep 17 16:28:59.334297 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:59.334255 2581 generic.go:356] "Generic (PLEG): container finished" podID="a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3" containerID="61030580dce02fd5d23ff57dcf45f1d14d11497ace24449384378eb6dcc075f2" exitCode=0 Sep 17 16:28:59.334703 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:59.334329 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8bvb9/must-gather-ldgw6" event={"ID":"a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3","Type":"ContainerDied","Data":"61030580dce02fd5d23ff57dcf45f1d14d11497ace24449384378eb6dcc075f2"} Sep 17 16:28:59.334703 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:28:59.334654 2581 scope.go:117] "RemoveContainer" containerID="61030580dce02fd5d23ff57dcf45f1d14d11497ace24449384378eb6dcc075f2" Sep 17 16:29:00.133354 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:00.133315 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-8bvb9_must-gather-ldgw6_a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3/gather/0.log" Sep 17 16:29:04.333289 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:04.333254 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jtwf7_6841aae3-9f3e-439b-bc41-685e1c15baef/global-pull-secret-syncer/0.log" Sep 17 16:29:04.508766 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:04.508735 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qb2qz_46f93a66-b09c-41ef-8156-73ebc20ab303/konnectivity-agent/0.log" Sep 17 16:29:04.577480 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:04.577446 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-207.ec2.internal_5a6855b9b6b7591a9d6ab8882157cfaa/haproxy/0.log" Sep 17 16:29:05.714031 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:05.713991 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-8bvb9/must-gather-ldgw6"] Sep 17 16:29:05.714555 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:05.714233 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-8bvb9/must-gather-ldgw6" podUID="a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3" containerName="copy" containerID="cri-o://c8be65185c8c454dff4fe24edafa278936624bcd1cfe9d631b5efad09022a956" gracePeriod=2 Sep 17 16:29:05.716167 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:05.716132 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-8bvb9/must-gather-ldgw6"] Sep 17 16:29:05.718681 ip-10-0-132-207 kubenswrapper[2581]: E0917 16:29:05.717978 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-ldgw6\" is forbidden: User \"system:node:ip-10-0-132-207.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-8bvb9\": no relationship found between node 'ip-10-0-132-207.ec2.internal' and this object" podUID="a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3" pod="openshift-must-gather-8bvb9/must-gather-ldgw6" Sep 17 16:29:05.951000 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:05.950977 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-8bvb9_must-gather-ldgw6_a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3/copy/0.log" Sep 17 16:29:05.952632 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:05.952616 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8bvb9/must-gather-ldgw6" Sep 17 16:29:05.954728 ip-10-0-132-207 kubenswrapper[2581]: E0917 16:29:05.954702 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-ldgw6\" is forbidden: User \"system:node:ip-10-0-132-207.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-8bvb9\": no relationship found between node 'ip-10-0-132-207.ec2.internal' and this object" podUID="a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3" pod="openshift-must-gather-8bvb9/must-gather-ldgw6" Sep 17 16:29:05.977156 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:05.977094 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hc89\" (UniqueName: \"kubernetes.io/projected/a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3-kube-api-access-7hc89\") pod \"a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3\" (UID: \"a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3\") " Sep 17 16:29:05.977156 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:05.977134 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3-must-gather-output\") pod \"a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3\" (UID: \"a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3\") " Sep 17 16:29:05.978708 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:05.978677 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3" (UID: "a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 16:29:05.979920 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:05.979865 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3-kube-api-access-7hc89" (OuterVolumeSpecName: "kube-api-access-7hc89") pod "a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3" (UID: "a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3"). InnerVolumeSpecName "kube-api-access-7hc89". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 16:29:06.078335 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:06.078295 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hc89\" (UniqueName: \"kubernetes.io/projected/a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3-kube-api-access-7hc89\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 16:29:06.078335 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:06.078327 2581 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3-must-gather-output\") on node \"ip-10-0-132-207.ec2.internal\" DevicePath \"\"" Sep 17 16:29:06.364648 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:06.364619 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-8bvb9_must-gather-ldgw6_a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3/copy/0.log" Sep 17 16:29:06.365008 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:06.364985 2581 generic.go:356] "Generic (PLEG): container finished" podID="a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3" containerID="c8be65185c8c454dff4fe24edafa278936624bcd1cfe9d631b5efad09022a956" exitCode=143 Sep 17 16:29:06.365075 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:06.365035 2581 scope.go:117] "RemoveContainer" containerID="c8be65185c8c454dff4fe24edafa278936624bcd1cfe9d631b5efad09022a956" Sep 17 16:29:06.365075 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:06.365043 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8bvb9/must-gather-ldgw6" Sep 17 16:29:06.367295 ip-10-0-132-207 kubenswrapper[2581]: E0917 16:29:06.367265 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-ldgw6\" is forbidden: User \"system:node:ip-10-0-132-207.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-8bvb9\": no relationship found between node 'ip-10-0-132-207.ec2.internal' and this object" podUID="a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3" pod="openshift-must-gather-8bvb9/must-gather-ldgw6" Sep 17 16:29:06.373839 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:06.373817 2581 scope.go:117] "RemoveContainer" containerID="61030580dce02fd5d23ff57dcf45f1d14d11497ace24449384378eb6dcc075f2" Sep 17 16:29:06.376000 ip-10-0-132-207 kubenswrapper[2581]: E0917 16:29:06.375975 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-ldgw6\" is forbidden: User \"system:node:ip-10-0-132-207.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-8bvb9\": no relationship found between node 'ip-10-0-132-207.ec2.internal' and this object" podUID="a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3" pod="openshift-must-gather-8bvb9/must-gather-ldgw6" Sep 17 16:29:06.385808 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:06.385788 2581 scope.go:117] "RemoveContainer" containerID="c8be65185c8c454dff4fe24edafa278936624bcd1cfe9d631b5efad09022a956" Sep 17 16:29:06.386150 ip-10-0-132-207 kubenswrapper[2581]: E0917 16:29:06.386131 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8be65185c8c454dff4fe24edafa278936624bcd1cfe9d631b5efad09022a956\": container with ID starting with c8be65185c8c454dff4fe24edafa278936624bcd1cfe9d631b5efad09022a956 not found: ID does not exist" containerID="c8be65185c8c454dff4fe24edafa278936624bcd1cfe9d631b5efad09022a956" Sep 17 16:29:06.386222 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:06.386160 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8be65185c8c454dff4fe24edafa278936624bcd1cfe9d631b5efad09022a956"} err="failed to get container status \"c8be65185c8c454dff4fe24edafa278936624bcd1cfe9d631b5efad09022a956\": rpc error: code = NotFound desc = could not find container \"c8be65185c8c454dff4fe24edafa278936624bcd1cfe9d631b5efad09022a956\": container with ID starting with c8be65185c8c454dff4fe24edafa278936624bcd1cfe9d631b5efad09022a956 not found: ID does not exist" Sep 17 16:29:06.386222 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:06.386180 2581 scope.go:117] "RemoveContainer" containerID="61030580dce02fd5d23ff57dcf45f1d14d11497ace24449384378eb6dcc075f2" Sep 17 16:29:06.386485 ip-10-0-132-207 kubenswrapper[2581]: E0917 16:29:06.386462 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61030580dce02fd5d23ff57dcf45f1d14d11497ace24449384378eb6dcc075f2\": container with ID starting with 61030580dce02fd5d23ff57dcf45f1d14d11497ace24449384378eb6dcc075f2 not found: ID does not exist" containerID="61030580dce02fd5d23ff57dcf45f1d14d11497ace24449384378eb6dcc075f2" Sep 17 16:29:06.386527 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:06.386494 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61030580dce02fd5d23ff57dcf45f1d14d11497ace24449384378eb6dcc075f2"} err="failed to get container status \"61030580dce02fd5d23ff57dcf45f1d14d11497ace24449384378eb6dcc075f2\": rpc error: code = NotFound desc = could not find container \"61030580dce02fd5d23ff57dcf45f1d14d11497ace24449384378eb6dcc075f2\": container with ID starting with 61030580dce02fd5d23ff57dcf45f1d14d11497ace24449384378eb6dcc075f2 not found: ID does not exist" Sep 17 16:29:07.138649 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:07.138610 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3" path="/var/lib/kubelet/pods/a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3/volumes" Sep 17 16:29:09.001428 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:09.001341 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-kmtxk_f53e0493-b85b-431b-8900-39206abd62a1/monitoring-plugin/0.log" Sep 17 16:29:09.053460 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:09.053426 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cmkqv_70016297-ea47-4ce3-b4e0-ec282d319fb1/node-exporter/0.log" Sep 17 16:29:09.095144 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:09.095120 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cmkqv_70016297-ea47-4ce3-b4e0-ec282d319fb1/kube-rbac-proxy/0.log" Sep 17 16:29:09.139398 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:09.139364 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cmkqv_70016297-ea47-4ce3-b4e0-ec282d319fb1/init-textfile/0.log" Sep 17 16:29:09.569475 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:09.569446 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8252c2f9-859c-46f3-a35a-64a3ca1dcb3e/prometheus/0.log" Sep 17 16:29:09.608214 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:09.608177 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8252c2f9-859c-46f3-a35a-64a3ca1dcb3e/config-reloader/0.log" Sep 17 16:29:09.649384 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:09.649350 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8252c2f9-859c-46f3-a35a-64a3ca1dcb3e/thanos-sidecar/0.log" Sep 17 16:29:09.710171 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:09.710130 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8252c2f9-859c-46f3-a35a-64a3ca1dcb3e/kube-rbac-proxy-web/0.log" Sep 17 16:29:09.761352 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:09.761326 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8252c2f9-859c-46f3-a35a-64a3ca1dcb3e/kube-rbac-proxy/0.log" Sep 17 16:29:09.802688 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:09.802612 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8252c2f9-859c-46f3-a35a-64a3ca1dcb3e/kube-rbac-proxy-thanos/0.log" Sep 17 16:29:09.837276 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:09.837240 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8252c2f9-859c-46f3-a35a-64a3ca1dcb3e/init-config-reloader/0.log" Sep 17 16:29:09.878838 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:09.878801 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-wmt9l_b5505cdb-be20-46c1-b389-a53a49ada82f/prometheus-operator/0.log" Sep 17 16:29:09.919910 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:09.919871 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-wmt9l_b5505cdb-be20-46c1-b389-a53a49ada82f/kube-rbac-proxy/0.log" Sep 17 16:29:09.959524 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:09.959495 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-vhgtf_f3b3dbb9-f72a-4555-8073-81e17bb420c7/prometheus-operator-admission-webhook/0.log" Sep 17 16:29:09.997844 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:09.997818 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-65c6696c5f-6cscm_734fdefa-a1ad-4248-be54-0d3642d68065/telemeter-client/0.log" Sep 17 16:29:10.029252 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:10.029217 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-65c6696c5f-6cscm_734fdefa-a1ad-4248-be54-0d3642d68065/reload/0.log" Sep 17 16:29:10.060499 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:10.060415 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-65c6696c5f-6cscm_734fdefa-a1ad-4248-be54-0d3642d68065/kube-rbac-proxy/0.log" Sep 17 16:29:12.139999 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:12.139958 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-72p88/perf-node-gather-daemonset-rwp5n"] Sep 17 16:29:12.140481 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:12.140388 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3" containerName="copy" Sep 17 16:29:12.140481 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:12.140409 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3" containerName="copy" Sep 17 16:29:12.140481 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:12.140441 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3" containerName="gather" Sep 17 16:29:12.140481 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:12.140449 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3" containerName="gather" Sep 17 16:29:12.140692 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:12.140527 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3" containerName="gather" Sep 17 16:29:12.140692 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:12.140540 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3a87673-04b4-4688-b7d1-ae4f9fe9f7c3" containerName="copy" Sep 17 16:29:12.144640 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:12.144616 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-72p88/perf-node-gather-daemonset-rwp5n" Sep 17 16:29:12.148118 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:12.148095 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-72p88\"/\"openshift-service-ca.crt\"" Sep 17 16:29:12.148258 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:12.148121 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-72p88\"/\"default-dockercfg-vh8vv\"" Sep 17 16:29:12.148769 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:12.148752 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-72p88\"/\"kube-root-ca.crt\"" Sep 17 16:29:12.156731 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:12.156709 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-72p88/perf-node-gather-daemonset-rwp5n"] Sep 17 16:29:12.227593 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:12.227556 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc03f2bb-6dd9-4382-87c4-1d7e930ded54-sys\") pod \"perf-node-gather-daemonset-rwp5n\" (UID: \"bc03f2bb-6dd9-4382-87c4-1d7e930ded54\") " pod="openshift-must-gather-72p88/perf-node-gather-daemonset-rwp5n" Sep 17 16:29:12.227593 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:12.227590 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bc03f2bb-6dd9-4382-87c4-1d7e930ded54-podres\") pod \"perf-node-gather-daemonset-rwp5n\" (UID: \"bc03f2bb-6dd9-4382-87c4-1d7e930ded54\") " pod="openshift-must-gather-72p88/perf-node-gather-daemonset-rwp5n" Sep 17 16:29:12.227812 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:12.227620 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj585\" (UniqueName: \"kubernetes.io/projected/bc03f2bb-6dd9-4382-87c4-1d7e930ded54-kube-api-access-tj585\") pod \"perf-node-gather-daemonset-rwp5n\" (UID: \"bc03f2bb-6dd9-4382-87c4-1d7e930ded54\") " pod="openshift-must-gather-72p88/perf-node-gather-daemonset-rwp5n" Sep 17 16:29:12.227812 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:12.227698 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bc03f2bb-6dd9-4382-87c4-1d7e930ded54-proc\") pod \"perf-node-gather-daemonset-rwp5n\" (UID: \"bc03f2bb-6dd9-4382-87c4-1d7e930ded54\") " pod="openshift-must-gather-72p88/perf-node-gather-daemonset-rwp5n" Sep 17 16:29:12.227812 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:12.227754 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc03f2bb-6dd9-4382-87c4-1d7e930ded54-lib-modules\") pod \"perf-node-gather-daemonset-rwp5n\" (UID: \"bc03f2bb-6dd9-4382-87c4-1d7e930ded54\") " pod="openshift-must-gather-72p88/perf-node-gather-daemonset-rwp5n" Sep 17 16:29:12.328870 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:12.328826 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc03f2bb-6dd9-4382-87c4-1d7e930ded54-sys\") pod \"perf-node-gather-daemonset-rwp5n\" (UID: \"bc03f2bb-6dd9-4382-87c4-1d7e930ded54\") " pod="openshift-must-gather-72p88/perf-node-gather-daemonset-rwp5n" Sep 17 16:29:12.328870 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:12.328866 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bc03f2bb-6dd9-4382-87c4-1d7e930ded54-podres\") pod \"perf-node-gather-daemonset-rwp5n\" (UID: \"bc03f2bb-6dd9-4382-87c4-1d7e930ded54\") " pod="openshift-must-gather-72p88/perf-node-gather-daemonset-rwp5n" Sep 17 16:29:12.329137 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:12.328919 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tj585\" (UniqueName: \"kubernetes.io/projected/bc03f2bb-6dd9-4382-87c4-1d7e930ded54-kube-api-access-tj585\") pod \"perf-node-gather-daemonset-rwp5n\" (UID: \"bc03f2bb-6dd9-4382-87c4-1d7e930ded54\") " pod="openshift-must-gather-72p88/perf-node-gather-daemonset-rwp5n" Sep 17 16:29:12.329137 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:12.328946 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bc03f2bb-6dd9-4382-87c4-1d7e930ded54-proc\") pod \"perf-node-gather-daemonset-rwp5n\" (UID: \"bc03f2bb-6dd9-4382-87c4-1d7e930ded54\") " pod="openshift-must-gather-72p88/perf-node-gather-daemonset-rwp5n" Sep 17 16:29:12.329137 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:12.328987 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc03f2bb-6dd9-4382-87c4-1d7e930ded54-lib-modules\") pod \"perf-node-gather-daemonset-rwp5n\" (UID: \"bc03f2bb-6dd9-4382-87c4-1d7e930ded54\") " pod="openshift-must-gather-72p88/perf-node-gather-daemonset-rwp5n" Sep 17 16:29:12.329137 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:12.328997 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc03f2bb-6dd9-4382-87c4-1d7e930ded54-sys\") pod \"perf-node-gather-daemonset-rwp5n\" (UID: \"bc03f2bb-6dd9-4382-87c4-1d7e930ded54\") " pod="openshift-must-gather-72p88/perf-node-gather-daemonset-rwp5n" Sep 17 16:29:12.329137 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:12.329040 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bc03f2bb-6dd9-4382-87c4-1d7e930ded54-podres\") pod \"perf-node-gather-daemonset-rwp5n\" (UID: \"bc03f2bb-6dd9-4382-87c4-1d7e930ded54\") " pod="openshift-must-gather-72p88/perf-node-gather-daemonset-rwp5n" Sep 17 16:29:12.329137 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:12.329067 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bc03f2bb-6dd9-4382-87c4-1d7e930ded54-proc\") pod \"perf-node-gather-daemonset-rwp5n\" (UID: \"bc03f2bb-6dd9-4382-87c4-1d7e930ded54\") " pod="openshift-must-gather-72p88/perf-node-gather-daemonset-rwp5n" Sep 17 16:29:12.329137 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:12.329100 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc03f2bb-6dd9-4382-87c4-1d7e930ded54-lib-modules\") pod \"perf-node-gather-daemonset-rwp5n\" (UID: \"bc03f2bb-6dd9-4382-87c4-1d7e930ded54\") " pod="openshift-must-gather-72p88/perf-node-gather-daemonset-rwp5n" Sep 17 16:29:12.339526 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:12.339494 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj585\" (UniqueName: \"kubernetes.io/projected/bc03f2bb-6dd9-4382-87c4-1d7e930ded54-kube-api-access-tj585\") pod \"perf-node-gather-daemonset-rwp5n\" (UID: \"bc03f2bb-6dd9-4382-87c4-1d7e930ded54\") " pod="openshift-must-gather-72p88/perf-node-gather-daemonset-rwp5n" Sep 17 16:29:12.454568 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:12.454488 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-72p88/perf-node-gather-daemonset-rwp5n" Sep 17 16:29:12.733811 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:12.733785 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-72p88/perf-node-gather-daemonset-rwp5n"] Sep 17 16:29:12.736353 ip-10-0-132-207 kubenswrapper[2581]: W0917 16:29:12.736320 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbc03f2bb_6dd9_4382_87c4_1d7e930ded54.slice/crio-9da590793983c3278103718674aa2ac2b8e950b794e5dd0c56242c651dbb948d WatchSource:0}: Error finding container 9da590793983c3278103718674aa2ac2b8e950b794e5dd0c56242c651dbb948d: Status 404 returned error can't find the container with id 9da590793983c3278103718674aa2ac2b8e950b794e5dd0c56242c651dbb948d Sep 17 16:29:13.394707 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:13.394669 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-72p88/perf-node-gather-daemonset-rwp5n" event={"ID":"bc03f2bb-6dd9-4382-87c4-1d7e930ded54","Type":"ContainerStarted","Data":"e300eea2df84e15dfef4f4652a64fbe5e93726d540e90b8ce28f5c668169cd76"} Sep 17 16:29:13.395143 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:13.394856 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-72p88/perf-node-gather-daemonset-rwp5n" Sep 17 16:29:13.395143 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:13.394907 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-72p88/perf-node-gather-daemonset-rwp5n" event={"ID":"bc03f2bb-6dd9-4382-87c4-1d7e930ded54","Type":"ContainerStarted","Data":"9da590793983c3278103718674aa2ac2b8e950b794e5dd0c56242c651dbb948d"} Sep 17 16:29:13.420713 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:13.420658 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-72p88/perf-node-gather-daemonset-rwp5n" podStartSLOduration=1.420643345 podStartE2EDuration="1.420643345s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:29:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:29:13.420051087 +0000 UTC m=+3008.814017973" watchObservedRunningTime="2026-09-17 16:29:13.420643345 +0000 UTC m=+3008.814610239" Sep 17 16:29:14.162812 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:14.162780 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wfnvz_59d788c0-fef9-42d2-b6c3-f2626f39261d/dns/0.log" Sep 17 16:29:14.187905 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:14.187850 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wfnvz_59d788c0-fef9-42d2-b6c3-f2626f39261d/kube-rbac-proxy/0.log" Sep 17 16:29:14.252071 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:14.252044 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hrgrs_1683b9c0-ac32-4cb2-a099-ce62182f0bce/dns-node-resolver/0.log" Sep 17 16:29:14.866376 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:14.866340 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6gbcs_a7107e67-41ae-412b-851e-0b4c830adfd0/node-ca/0.log" Sep 17 16:29:15.799594 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:15.799567 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86d54f56b-d42z6_93ecf8b9-4484-4e06-a567-1d192fe5ce5e/router/0.log" Sep 17 16:29:16.203821 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:16.203790 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-56c9v_cd4c4e9b-c929-4dc5-8468-af8fb6cd29f8/serve-healthcheck-canary/0.log" Sep 17 16:29:16.721136 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:16.721107 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-hrmwr_d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48/insights-operator/0.log" Sep 17 16:29:16.722751 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:16.722730 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-hrmwr_d64fbb0e-4f31-4bc1-a6f6-f8d517fc0b48/insights-operator/1.log" Sep 17 16:29:16.757053 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:16.757025 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ntqk6_ef55fd00-44a9-4735-93d3-fb1f2cf2d01e/kube-rbac-proxy/0.log" Sep 17 16:29:16.790236 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:16.790207 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ntqk6_ef55fd00-44a9-4735-93d3-fb1f2cf2d01e/exporter/0.log" Sep 17 16:29:16.824093 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:16.824066 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ntqk6_ef55fd00-44a9-4735-93d3-fb1f2cf2d01e/extractor/0.log" Sep 17 16:29:19.409252 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:19.409226 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-72p88/perf-node-gather-daemonset-rwp5n" Sep 17 16:29:19.745604 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:19.745515 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-9lpcx_b6d8675b-e076-4f58-976a-7ad73adcb3a8/s3-init/0.log" Sep 17 16:29:19.767238 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:19.767210 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-9lpcx_b6d8675b-e076-4f58-976a-7ad73adcb3a8/download-hf-model/0.log" Sep 17 16:29:24.843468 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:24.843430 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-xvldp_b17688ff-c016-4fd1-9b35-c50ec5100d61/kube-storage-version-migrator-operator/1.log" Sep 17 16:29:24.844857 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:24.844803 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-xvldp_b17688ff-c016-4fd1-9b35-c50ec5100d61/kube-storage-version-migrator-operator/0.log" Sep 17 16:29:25.798062 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:25.798036 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dzqxm_fde60d54-dbed-4e5e-8103-4809b3074a8c/kube-multus-additional-cni-plugins/0.log" Sep 17 16:29:25.828786 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:25.828755 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dzqxm_fde60d54-dbed-4e5e-8103-4809b3074a8c/egress-router-binary-copy/0.log" Sep 17 16:29:25.863367 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:25.863323 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dzqxm_fde60d54-dbed-4e5e-8103-4809b3074a8c/cni-plugins/0.log" Sep 17 16:29:25.894182 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:25.894143 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dzqxm_fde60d54-dbed-4e5e-8103-4809b3074a8c/bond-cni-plugin/0.log" Sep 17 16:29:25.921077 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:25.921045 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dzqxm_fde60d54-dbed-4e5e-8103-4809b3074a8c/routeoverride-cni/0.log" Sep 17 16:29:25.948546 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:25.948507 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dzqxm_fde60d54-dbed-4e5e-8103-4809b3074a8c/whereabouts-cni-bincopy/0.log" Sep 17 16:29:25.975056 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:25.975023 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dzqxm_fde60d54-dbed-4e5e-8103-4809b3074a8c/whereabouts-cni/0.log" Sep 17 16:29:26.508477 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:26.508446 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rfcds_dbded374-06d6-4f90-b242-6b4f51e3ae11/kube-multus/0.log" Sep 17 16:29:26.599495 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:26.599465 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fjm5t_87031c7d-d4f1-4a4b-8691-e93c3698118a/network-metrics-daemon/0.log" Sep 17 16:29:26.629547 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:26.629521 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fjm5t_87031c7d-d4f1-4a4b-8691-e93c3698118a/kube-rbac-proxy/0.log" Sep 17 16:29:28.076662 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:28.076628 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvbm6_9eb875df-5cc6-40f5-978e-f0adf0b823d5/ovn-controller/0.log" Sep 17 16:29:28.096936 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:28.096907 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvbm6_9eb875df-5cc6-40f5-978e-f0adf0b823d5/ovn-acl-logging/1.log" Sep 17 16:29:28.097111 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:28.096956 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvbm6_9eb875df-5cc6-40f5-978e-f0adf0b823d5/ovn-acl-logging/0.log" Sep 17 16:29:28.121085 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:28.121055 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvbm6_9eb875df-5cc6-40f5-978e-f0adf0b823d5/kube-rbac-proxy-node/0.log" Sep 17 16:29:28.151836 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:28.151805 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvbm6_9eb875df-5cc6-40f5-978e-f0adf0b823d5/kube-rbac-proxy-ovn-metrics/0.log" Sep 17 16:29:28.174107 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:28.174080 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvbm6_9eb875df-5cc6-40f5-978e-f0adf0b823d5/northd/0.log" Sep 17 16:29:28.199029 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:28.199001 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvbm6_9eb875df-5cc6-40f5-978e-f0adf0b823d5/nbdb/0.log" Sep 17 16:29:28.224018 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:28.223988 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvbm6_9eb875df-5cc6-40f5-978e-f0adf0b823d5/sbdb/0.log" Sep 17 16:29:28.278698 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:28.278668 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvbm6_9eb875df-5cc6-40f5-978e-f0adf0b823d5/ovnkube-controller/0.log" Sep 17 16:29:29.394445 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:29.394360 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-6f8b768455-kjss7_9b63cb52-0a1c-4581-b605-9ecb5aee6d16/check-endpoints/0.log" Sep 17 16:29:29.451992 ip-10-0-132-207 kubenswrapper[2581]: I0917 16:29:29.451959 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-kcjnr_75d806d9-420d-4e93-bb55-a30b25dcd5b9/network-check-target-container/0.log"