Aug 05 17:12:27.604966 ip-10-0-137-104 systemd[1]: Starting Kubernetes Kubelet... Aug 05 17:12:27.994122 ip-10-0-137-104 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 05 17:12:27.994122 ip-10-0-137-104 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Aug 05 17:12:27.994122 ip-10-0-137-104 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 05 17:12:27.994122 ip-10-0-137-104 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Aug 05 17:12:27.994122 ip-10-0-137-104 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 05 17:12:27.995110 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:27.995022 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Aug 05 17:12:27.998609 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998592 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 17:12:27.998609 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998609 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 17:12:27.998685 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998613 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 17:12:27.998685 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998617 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 17:12:27.998685 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998621 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 17:12:27.998685 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998623 2562 feature_gate.go:328] unrecognized feature gate: Example Aug 05 17:12:27.998685 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998628 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 17:12:27.998685 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998632 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 17:12:27.998685 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998635 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 17:12:27.998685 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998638 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 17:12:27.998685 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998640 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 17:12:27.998685 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998643 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 17:12:27.998685 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998646 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 17:12:27.998685 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998648 2562 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 17:12:27.998685 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998651 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 17:12:27.998685 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998653 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 17:12:27.998685 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998657 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 17:12:27.998685 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998659 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 17:12:27.998685 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998662 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 17:12:27.998685 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998676 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 17:12:27.998685 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998679 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 17:12:27.998685 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998682 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 17:12:27.999160 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998685 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 17:12:27.999160 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998687 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 17:12:27.999160 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998690 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 17:12:27.999160 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998693 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 17:12:27.999160 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998696 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 17:12:27.999160 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998698 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 17:12:27.999160 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998701 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 17:12:27.999160 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998704 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 17:12:27.999160 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998706 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 17:12:27.999160 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998709 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 17:12:27.999160 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998712 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 17:12:27.999160 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998715 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 17:12:27.999160 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998718 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 17:12:27.999160 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998720 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 17:12:27.999160 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998723 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 17:12:27.999160 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998725 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 17:12:27.999160 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998728 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 17:12:27.999160 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998730 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 17:12:27.999160 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998733 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 17:12:27.999614 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998736 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 17:12:27.999614 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998738 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 17:12:27.999614 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998741 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 17:12:27.999614 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998744 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 17:12:27.999614 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998748 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 17:12:27.999614 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998751 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 17:12:27.999614 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998753 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 17:12:27.999614 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998756 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 17:12:27.999614 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998759 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 17:12:27.999614 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998762 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 17:12:27.999614 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998765 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 17:12:27.999614 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998768 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 17:12:27.999614 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998771 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 17:12:27.999614 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998774 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 17:12:27.999614 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998777 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 17:12:27.999614 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998779 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 17:12:27.999614 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998782 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 17:12:27.999614 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998785 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 17:12:27.999614 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998787 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 17:12:27.999614 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998790 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 17:12:28.000207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998793 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 17:12:28.000207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998796 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 17:12:28.000207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998799 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 17:12:28.000207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998802 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 17:12:28.000207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998804 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 17:12:28.000207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998807 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 17:12:28.000207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998809 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 17:12:28.000207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998812 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 17:12:28.000207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998815 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 17:12:28.000207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998817 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 17:12:28.000207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998819 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 17:12:28.000207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998822 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 17:12:28.000207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998825 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 17:12:28.000207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998827 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 17:12:28.000207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998830 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 17:12:28.000207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998832 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 17:12:28.000207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998835 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 17:12:28.000207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998838 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 17:12:28.000207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998841 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 17:12:28.000207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998843 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 17:12:28.000760 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998846 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 17:12:28.000760 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998849 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 17:12:28.000760 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998851 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 17:12:28.000760 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998854 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 17:12:28.000760 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998856 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 17:12:28.000760 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998859 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 17:12:28.000760 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998863 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 17:12:28.000760 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998865 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 17:12:28.000760 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998868 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 17:12:28.000760 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998870 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 17:12:28.000760 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998873 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 17:12:28.000760 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998876 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 17:12:28.000760 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998880 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 17:12:28.000760 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998883 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 17:12:28.000760 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998886 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 17:12:28.000760 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998889 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 17:12:28.000760 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998892 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 17:12:28.000760 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.998894 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 17:12:28.000760 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999609 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 17:12:28.001231 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999615 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 17:12:28.001231 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999619 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 17:12:28.001231 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999623 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 17:12:28.001231 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999626 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 17:12:28.001231 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999629 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 17:12:28.001231 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999631 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 17:12:28.001231 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999634 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 17:12:28.001231 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999637 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 17:12:28.001231 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999641 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 17:12:28.001231 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999644 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 17:12:28.001231 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999648 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 17:12:28.001231 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999650 2562 feature_gate.go:328] unrecognized feature gate: Example Aug 05 17:12:28.001231 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999653 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 17:12:28.001231 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999656 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 17:12:28.001231 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999659 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 17:12:28.001231 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999662 2562 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 17:12:28.001231 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999680 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 17:12:28.001231 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999683 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 17:12:28.001231 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999687 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 17:12:28.001710 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999690 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 17:12:28.001710 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999693 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 17:12:28.001710 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999695 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 17:12:28.001710 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999698 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 17:12:28.001710 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999701 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 17:12:28.001710 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999703 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 17:12:28.001710 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999706 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 17:12:28.001710 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999708 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 17:12:28.001710 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999711 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 17:12:28.001710 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999713 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 17:12:28.001710 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999716 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 17:12:28.001710 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999719 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 17:12:28.001710 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999721 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 17:12:28.001710 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999724 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 17:12:28.001710 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999727 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 17:12:28.001710 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999730 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 17:12:28.001710 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999732 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 17:12:28.001710 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999735 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 17:12:28.001710 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999738 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 17:12:28.001710 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999740 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 17:12:28.002207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999743 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 17:12:28.002207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999745 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 17:12:28.002207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999748 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 17:12:28.002207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999750 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 17:12:28.002207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999752 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 17:12:28.002207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999755 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 17:12:28.002207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999758 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 17:12:28.002207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999761 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 17:12:28.002207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999763 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 17:12:28.002207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999766 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 17:12:28.002207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999769 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 17:12:28.002207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999772 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 17:12:28.002207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999775 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 17:12:28.002207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999777 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 17:12:28.002207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999780 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 17:12:28.002207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999782 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 17:12:28.002207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999784 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 17:12:28.002207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999787 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 17:12:28.002207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999789 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 17:12:28.002207 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999792 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 17:12:28.002706 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999795 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 17:12:28.002706 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999797 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 17:12:28.002706 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999800 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 17:12:28.002706 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999802 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 17:12:28.002706 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999805 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 17:12:28.002706 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999807 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 17:12:28.002706 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999810 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 17:12:28.002706 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999812 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 17:12:28.002706 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999815 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 17:12:28.002706 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999819 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 17:12:28.002706 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999822 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 17:12:28.002706 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999825 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 17:12:28.002706 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999827 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 17:12:28.002706 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999830 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 17:12:28.002706 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999833 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 17:12:28.002706 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999835 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 17:12:28.002706 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999839 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 17:12:28.002706 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999841 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 17:12:28.002706 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999845 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 17:12:28.003169 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999848 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 17:12:28.003169 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999850 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 17:12:28.003169 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999853 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 17:12:28.003169 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999857 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 17:12:28.003169 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999860 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 17:12:28.003169 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999862 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 17:12:28.003169 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999865 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 17:12:28.003169 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999868 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 17:12:28.003169 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999870 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 17:12:28.003169 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999872 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 17:12:28.003169 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999875 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 17:12:28.003169 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999877 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 17:12:28.003169 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999880 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 17:12:28.003169 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999882 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 17:12:28.003169 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999885 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 17:12:28.003169 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999887 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 17:12:28.003169 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999889 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 17:12:28.003169 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999892 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 17:12:28.003169 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999895 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 17:12:28.003169 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:27.999897 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 17:12:28.003660 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000256 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 17:12:28.003660 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000260 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 17:12:28.003660 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000265 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 17:12:28.003660 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000269 2562 feature_gate.go:328] unrecognized feature gate: Example Aug 05 17:12:28.003660 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000273 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 17:12:28.003660 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000275 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 17:12:28.003660 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000279 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 17:12:28.003660 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000282 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 17:12:28.003660 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000284 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 17:12:28.003660 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000288 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 17:12:28.003660 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000291 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 17:12:28.003660 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000295 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 17:12:28.003660 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000298 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 17:12:28.003660 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000302 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 17:12:28.003660 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000305 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 17:12:28.003660 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000308 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 17:12:28.003660 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000311 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 17:12:28.003660 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000314 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 17:12:28.003660 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000316 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 17:12:28.004152 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000319 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 17:12:28.004152 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000322 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 17:12:28.004152 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000324 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 17:12:28.004152 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000327 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 17:12:28.004152 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000330 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 17:12:28.004152 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000333 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 17:12:28.004152 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000336 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 17:12:28.004152 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000338 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 17:12:28.004152 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000341 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 17:12:28.004152 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000343 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 17:12:28.004152 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000346 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 17:12:28.004152 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000349 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 17:12:28.004152 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000352 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 17:12:28.004152 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000354 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 17:12:28.004152 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000357 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 17:12:28.004152 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000359 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 17:12:28.004152 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000362 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 17:12:28.004152 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000365 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 17:12:28.004152 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000368 2562 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 17:12:28.004152 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000370 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 17:12:28.004653 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000373 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 17:12:28.004653 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000375 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 17:12:28.004653 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000379 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 17:12:28.004653 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000382 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 17:12:28.004653 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000384 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 17:12:28.004653 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000387 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 17:12:28.004653 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000390 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 17:12:28.004653 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000392 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 17:12:28.004653 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000395 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 17:12:28.004653 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000398 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 17:12:28.004653 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000400 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 17:12:28.004653 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000403 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 17:12:28.004653 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000405 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 17:12:28.004653 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000408 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 17:12:28.004653 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000410 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 17:12:28.004653 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000413 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 17:12:28.004653 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000415 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 17:12:28.004653 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000418 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 17:12:28.004653 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000420 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 17:12:28.004653 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000423 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 17:12:28.005150 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000425 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 17:12:28.005150 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000427 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 17:12:28.005150 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000430 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 17:12:28.005150 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000433 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 17:12:28.005150 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000436 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 17:12:28.005150 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000439 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 17:12:28.005150 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000441 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 17:12:28.005150 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000444 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 17:12:28.005150 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000446 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 17:12:28.005150 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000449 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 17:12:28.005150 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000451 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 17:12:28.005150 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000454 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 17:12:28.005150 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000457 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 17:12:28.005150 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000459 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 17:12:28.005150 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000462 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 17:12:28.005150 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000465 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 17:12:28.005150 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000467 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 17:12:28.005150 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000470 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 17:12:28.005150 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000473 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 17:12:28.005150 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000475 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 17:12:28.005695 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000478 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 17:12:28.005695 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000480 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 17:12:28.005695 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000483 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 17:12:28.005695 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000485 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 17:12:28.005695 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000488 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 17:12:28.005695 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000490 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 17:12:28.005695 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000493 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 17:12:28.005695 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000495 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 17:12:28.005695 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000498 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 17:12:28.005695 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000500 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 17:12:28.005695 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000503 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 17:12:28.005695 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000505 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 17:12:28.005695 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000508 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 17:12:28.005695 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000510 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 17:12:28.005695 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000512 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 17:12:28.005695 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000518 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 17:12:28.005695 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000521 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 17:12:28.005695 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000524 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 17:12:28.005695 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000526 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 17:12:28.005695 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.000529 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 17:12:28.006179 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000593 2562 flags.go:64] FLAG: --address="0.0.0.0" Aug 05 17:12:28.006179 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000606 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Aug 05 17:12:28.006179 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000612 2562 flags.go:64] FLAG: --anonymous-auth="true" Aug 05 17:12:28.006179 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000616 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Aug 05 17:12:28.006179 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000620 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Aug 05 17:12:28.006179 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000623 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Aug 05 17:12:28.006179 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000627 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Aug 05 17:12:28.006179 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000632 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Aug 05 17:12:28.006179 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000635 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Aug 05 17:12:28.006179 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000638 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Aug 05 17:12:28.006179 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000641 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Aug 05 17:12:28.006179 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000644 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Aug 05 17:12:28.006179 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000647 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Aug 05 17:12:28.006179 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000650 2562 flags.go:64] FLAG: --cgroup-root="" Aug 05 17:12:28.006179 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000653 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Aug 05 17:12:28.006179 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000657 2562 flags.go:64] FLAG: --client-ca-file="" Aug 05 17:12:28.006179 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000660 2562 flags.go:64] FLAG: --cloud-provider="external" Aug 05 17:12:28.006179 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000663 2562 flags.go:64] FLAG: --cluster-dns="[]" Aug 05 17:12:28.006179 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000679 2562 flags.go:64] FLAG: --cluster-domain="" Aug 05 17:12:28.006179 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000682 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Aug 05 17:12:28.006179 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000685 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Aug 05 17:12:28.006179 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000688 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Aug 05 17:12:28.006179 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000692 2562 flags.go:64] FLAG: --container-log-max-files="5" Aug 05 17:12:28.006179 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000695 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Aug 05 17:12:28.006765 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000698 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Aug 05 17:12:28.006765 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000702 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Aug 05 17:12:28.006765 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000705 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Aug 05 17:12:28.006765 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000709 2562 flags.go:64] FLAG: --contention-profiling="false" Aug 05 17:12:28.006765 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000713 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Aug 05 17:12:28.006765 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000718 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Aug 05 17:12:28.006765 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000721 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Aug 05 17:12:28.006765 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000723 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Aug 05 17:12:28.006765 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000727 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Aug 05 17:12:28.006765 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000731 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Aug 05 17:12:28.006765 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000734 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Aug 05 17:12:28.006765 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000736 2562 flags.go:64] FLAG: --enable-load-reader="false" Aug 05 17:12:28.006765 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000739 2562 flags.go:64] FLAG: --enable-server="true" Aug 05 17:12:28.006765 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000742 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Aug 05 17:12:28.006765 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000747 2562 flags.go:64] FLAG: --event-burst="100" Aug 05 17:12:28.006765 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000750 2562 flags.go:64] FLAG: --event-qps="50" Aug 05 17:12:28.006765 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000753 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Aug 05 17:12:28.006765 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000756 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Aug 05 17:12:28.006765 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000759 2562 flags.go:64] FLAG: --eviction-hard="" Aug 05 17:12:28.006765 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000763 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Aug 05 17:12:28.006765 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000766 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Aug 05 17:12:28.006765 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000770 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Aug 05 17:12:28.006765 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000773 2562 flags.go:64] FLAG: --eviction-soft="" Aug 05 17:12:28.006765 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000776 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Aug 05 17:12:28.006765 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000779 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Aug 05 17:12:28.007379 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000782 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Aug 05 17:12:28.007379 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000785 2562 flags.go:64] FLAG: --experimental-mounter-path="" Aug 05 17:12:28.007379 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000788 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Aug 05 17:12:28.007379 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000791 2562 flags.go:64] FLAG: --fail-swap-on="true" Aug 05 17:12:28.007379 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000794 2562 flags.go:64] FLAG: --feature-gates="" Aug 05 17:12:28.007379 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000798 2562 flags.go:64] FLAG: --file-check-frequency="20s" Aug 05 17:12:28.007379 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000801 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Aug 05 17:12:28.007379 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000804 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Aug 05 17:12:28.007379 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000807 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Aug 05 17:12:28.007379 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000810 2562 flags.go:64] FLAG: --healthz-port="10248" Aug 05 17:12:28.007379 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000814 2562 flags.go:64] FLAG: --help="false" Aug 05 17:12:28.007379 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000817 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-137-104.ec2.internal" Aug 05 17:12:28.007379 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000821 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Aug 05 17:12:28.007379 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000824 2562 flags.go:64] FLAG: --http-check-frequency="20s" Aug 05 17:12:28.007379 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000827 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Aug 05 17:12:28.007379 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000831 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Aug 05 17:12:28.007379 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000834 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Aug 05 17:12:28.007379 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000837 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Aug 05 17:12:28.007379 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000840 2562 flags.go:64] FLAG: --image-service-endpoint="" Aug 05 17:12:28.007379 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000843 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Aug 05 17:12:28.007379 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000846 2562 flags.go:64] FLAG: --kube-api-burst="100" Aug 05 17:12:28.007379 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000849 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Aug 05 17:12:28.007379 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000852 2562 flags.go:64] FLAG: --kube-api-qps="50" Aug 05 17:12:28.007379 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000855 2562 flags.go:64] FLAG: --kube-reserved="" Aug 05 17:12:28.008260 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000858 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Aug 05 17:12:28.008260 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000861 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Aug 05 17:12:28.008260 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000864 2562 flags.go:64] FLAG: --kubelet-cgroups="" Aug 05 17:12:28.008260 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000867 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Aug 05 17:12:28.008260 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000869 2562 flags.go:64] FLAG: --lock-file="" Aug 05 17:12:28.008260 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000872 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Aug 05 17:12:28.008260 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000875 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Aug 05 17:12:28.008260 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000878 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Aug 05 17:12:28.008260 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000884 2562 flags.go:64] FLAG: --log-json-split-stream="false" Aug 05 17:12:28.008260 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000887 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Aug 05 17:12:28.008260 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000890 2562 flags.go:64] FLAG: --log-text-split-stream="false" Aug 05 17:12:28.008260 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000893 2562 flags.go:64] FLAG: --logging-format="text" Aug 05 17:12:28.008260 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000896 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Aug 05 17:12:28.008260 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000899 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Aug 05 17:12:28.008260 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000902 2562 flags.go:64] FLAG: --manifest-url="" Aug 05 17:12:28.008260 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000905 2562 flags.go:64] FLAG: --manifest-url-header="" Aug 05 17:12:28.008260 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000909 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Aug 05 17:12:28.008260 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000911 2562 flags.go:64] FLAG: --max-open-files="1000000" Aug 05 17:12:28.008260 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000916 2562 flags.go:64] FLAG: --max-pods="110" Aug 05 17:12:28.008260 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000919 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Aug 05 17:12:28.008260 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000925 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Aug 05 17:12:28.008260 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000928 2562 flags.go:64] FLAG: --memory-manager-policy="None" Aug 05 17:12:28.008260 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000931 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Aug 05 17:12:28.008260 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000934 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Aug 05 17:12:28.008260 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000937 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Aug 05 17:12:28.009233 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000940 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Aug 05 17:12:28.009233 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000946 2562 flags.go:64] FLAG: --node-status-max-images="50" Aug 05 17:12:28.009233 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000950 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Aug 05 17:12:28.009233 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000953 2562 flags.go:64] FLAG: --oom-score-adj="-999" Aug 05 17:12:28.009233 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000956 2562 flags.go:64] FLAG: --pod-cidr="" Aug 05 17:12:28.009233 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000959 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8" Aug 05 17:12:28.009233 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000964 2562 flags.go:64] FLAG: --pod-manifest-path="" Aug 05 17:12:28.009233 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000966 2562 flags.go:64] FLAG: --pod-max-pids="-1" Aug 05 17:12:28.009233 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000969 2562 flags.go:64] FLAG: --pods-per-core="0" Aug 05 17:12:28.009233 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000972 2562 flags.go:64] FLAG: --port="10250" Aug 05 17:12:28.009233 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000975 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Aug 05 17:12:28.009233 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000978 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a566cddd91351ff4" Aug 05 17:12:28.009233 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000981 2562 flags.go:64] FLAG: --qos-reserved="" Aug 05 17:12:28.009233 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000984 2562 flags.go:64] FLAG: --read-only-port="10255" Aug 05 17:12:28.009233 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000987 2562 flags.go:64] FLAG: --register-node="true" Aug 05 17:12:28.009233 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000990 2562 flags.go:64] FLAG: --register-with-taints="" Aug 05 17:12:28.009233 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000994 2562 flags.go:64] FLAG: --registry-burst="10" Aug 05 17:12:28.009233 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.000997 2562 flags.go:64] FLAG: --registry-qps="5" Aug 05 17:12:28.009233 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.001000 2562 flags.go:64] FLAG: --reserved-cpus="" Aug 05 17:12:28.009233 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.001003 2562 flags.go:64] FLAG: --reserved-memory="" Aug 05 17:12:28.009233 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.001007 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Aug 05 17:12:28.009233 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.001010 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Aug 05 17:12:28.009233 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.001013 2562 flags.go:64] FLAG: --rotate-certificates="false" Aug 05 17:12:28.009233 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.001016 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Aug 05 17:12:28.009233 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.001019 2562 flags.go:64] FLAG: --runonce="false" Aug 05 17:12:28.009947 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.001022 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Aug 05 17:12:28.009947 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.001025 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Aug 05 17:12:28.009947 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.001028 2562 flags.go:64] FLAG: --seccomp-default="false" Aug 05 17:12:28.009947 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.001033 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Aug 05 17:12:28.009947 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.001036 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Aug 05 17:12:28.009947 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.001039 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Aug 05 17:12:28.009947 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.001042 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Aug 05 17:12:28.009947 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.001045 2562 flags.go:64] FLAG: --storage-driver-password="root" Aug 05 17:12:28.009947 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.001047 2562 flags.go:64] FLAG: --storage-driver-secure="false" Aug 05 17:12:28.009947 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.001051 2562 flags.go:64] FLAG: --storage-driver-table="stats" Aug 05 17:12:28.009947 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.001054 2562 flags.go:64] FLAG: --storage-driver-user="root" Aug 05 17:12:28.009947 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.001057 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Aug 05 17:12:28.009947 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.001060 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Aug 05 17:12:28.009947 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.001063 2562 flags.go:64] FLAG: --system-cgroups="" Aug 05 17:12:28.009947 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.001066 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Aug 05 17:12:28.009947 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.001071 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Aug 05 17:12:28.009947 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.001074 2562 flags.go:64] FLAG: --tls-cert-file="" Aug 05 17:12:28.009947 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.001077 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Aug 05 17:12:28.009947 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.001082 2562 flags.go:64] FLAG: --tls-min-version="" Aug 05 17:12:28.009947 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.001084 2562 flags.go:64] FLAG: --tls-private-key-file="" Aug 05 17:12:28.009947 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.001087 2562 flags.go:64] FLAG: --topology-manager-policy="none" Aug 05 17:12:28.009947 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.001090 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Aug 05 17:12:28.009947 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.001093 2562 flags.go:64] FLAG: --topology-manager-scope="container" Aug 05 17:12:28.009947 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.001096 2562 flags.go:64] FLAG: --v="2" Aug 05 17:12:28.009947 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.001100 2562 flags.go:64] FLAG: --version="false" Aug 05 17:12:28.010605 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.001104 2562 flags.go:64] FLAG: --vmodule="" Aug 05 17:12:28.010605 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.001108 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Aug 05 17:12:28.010605 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.001111 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Aug 05 17:12:28.010605 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001228 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 17:12:28.010605 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001233 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 17:12:28.010605 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001236 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 17:12:28.010605 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001239 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 17:12:28.010605 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001243 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 17:12:28.010605 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001246 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 17:12:28.010605 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001249 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 17:12:28.010605 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001253 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 17:12:28.010605 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001256 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 17:12:28.010605 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001258 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 17:12:28.010605 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001261 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 17:12:28.010605 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001264 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 17:12:28.010605 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001266 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 17:12:28.010605 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001269 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 17:12:28.010605 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001271 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 17:12:28.010605 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001274 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 17:12:28.010605 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001276 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 17:12:28.011116 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001280 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 17:12:28.011116 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001284 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 17:12:28.011116 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001287 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 17:12:28.011116 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001290 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 17:12:28.011116 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001293 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 17:12:28.011116 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001295 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 17:12:28.011116 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001298 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 17:12:28.011116 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001301 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 17:12:28.011116 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001303 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 17:12:28.011116 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001306 2562 feature_gate.go:328] unrecognized feature gate: Example Aug 05 17:12:28.011116 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001308 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 17:12:28.011116 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001311 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 17:12:28.011116 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001314 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 17:12:28.011116 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001316 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 17:12:28.011116 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001319 2562 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 17:12:28.011116 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001321 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 17:12:28.011116 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001324 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 17:12:28.011116 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001327 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 17:12:28.011116 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001332 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 17:12:28.011590 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001335 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 17:12:28.011590 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001337 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 17:12:28.011590 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001340 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 17:12:28.011590 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001344 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 17:12:28.011590 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001346 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 17:12:28.011590 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001349 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 17:12:28.011590 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001351 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 17:12:28.011590 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001354 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 17:12:28.011590 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001357 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 17:12:28.011590 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001359 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 17:12:28.011590 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001362 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 17:12:28.011590 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001365 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 17:12:28.011590 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001367 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 17:12:28.011590 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001370 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 17:12:28.011590 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001372 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 17:12:28.011590 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001375 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 17:12:28.011590 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001377 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 17:12:28.011590 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001380 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 17:12:28.011590 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001383 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 17:12:28.011590 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001385 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 17:12:28.012094 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001388 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 17:12:28.012094 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001390 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 17:12:28.012094 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001393 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 17:12:28.012094 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001396 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 17:12:28.012094 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001398 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 17:12:28.012094 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001401 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 17:12:28.012094 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001404 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 17:12:28.012094 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001407 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 17:12:28.012094 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001409 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 17:12:28.012094 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001412 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 17:12:28.012094 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001414 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 17:12:28.012094 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001418 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 17:12:28.012094 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001421 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 17:12:28.012094 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001424 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 17:12:28.012094 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001426 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 17:12:28.012094 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001430 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 17:12:28.012094 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001433 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 17:12:28.012094 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001436 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 17:12:28.012094 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001438 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 17:12:28.012094 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001441 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 17:12:28.012578 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001444 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 17:12:28.012578 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001446 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 17:12:28.012578 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001449 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 17:12:28.012578 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001451 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 17:12:28.012578 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001454 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 17:12:28.012578 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001456 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 17:12:28.012578 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001461 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 17:12:28.012578 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001464 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 17:12:28.012578 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001467 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 17:12:28.012578 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001470 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 17:12:28.012578 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001473 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 17:12:28.012578 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001475 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 17:12:28.012578 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001478 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 17:12:28.012578 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001481 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 17:12:28.012578 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001484 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 17:12:28.012578 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001487 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 17:12:28.012578 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001489 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 17:12:28.012578 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001492 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 17:12:28.012578 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001495 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 17:12:28.013051 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001498 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 17:12:28.013051 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001501 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 17:12:28.013051 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001503 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 17:12:28.013051 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.001506 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 17:12:28.013051 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.002043 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 05 17:12:28.013051 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.010411 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Aug 05 17:12:28.013051 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.010427 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Aug 05 17:12:28.013051 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.011236 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Aug 05 17:12:28.013051 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.011247 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Aug 05 17:12:28.013051 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011307 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 17:12:28.013051 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011314 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 17:12:28.013051 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011318 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 17:12:28.013051 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011321 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 17:12:28.013051 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011324 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 17:12:28.013407 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011327 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 17:12:28.013407 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011329 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 17:12:28.013407 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011332 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 17:12:28.013407 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011335 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 17:12:28.013407 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011337 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 17:12:28.013407 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011340 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 17:12:28.013407 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011342 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 17:12:28.013407 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011345 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 17:12:28.013407 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011348 2562 feature_gate.go:328] unrecognized feature gate: Example Aug 05 17:12:28.013407 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011352 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 17:12:28.013407 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011355 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 17:12:28.013407 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011359 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 17:12:28.013407 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011362 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 17:12:28.013407 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011365 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 17:12:28.013407 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011368 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 17:12:28.013407 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011371 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 17:12:28.013407 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011374 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 17:12:28.013407 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011377 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 17:12:28.013407 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011381 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 17:12:28.013876 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011384 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 17:12:28.013876 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011387 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 17:12:28.013876 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011390 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 17:12:28.013876 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011392 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 17:12:28.013876 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011395 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 17:12:28.013876 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011398 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 17:12:28.013876 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011401 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 17:12:28.013876 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011404 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 17:12:28.013876 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011407 2562 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 17:12:28.013876 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011409 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 17:12:28.013876 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011412 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 17:12:28.013876 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011415 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 17:12:28.013876 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011417 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 17:12:28.013876 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011420 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 17:12:28.013876 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011423 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 17:12:28.013876 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011425 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 17:12:28.013876 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011428 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 17:12:28.013876 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011430 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 17:12:28.013876 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011433 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 17:12:28.013876 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011435 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 17:12:28.014369 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011437 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 17:12:28.014369 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011440 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 17:12:28.014369 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011444 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 17:12:28.014369 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011447 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 17:12:28.014369 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011449 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 17:12:28.014369 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011452 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 17:12:28.014369 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011454 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 17:12:28.014369 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011457 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 17:12:28.014369 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011459 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 17:12:28.014369 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011463 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 17:12:28.014369 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011465 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 17:12:28.014369 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011468 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 17:12:28.014369 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011471 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 17:12:28.014369 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011473 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 17:12:28.014369 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011476 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 17:12:28.014369 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011478 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 17:12:28.014369 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011481 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 17:12:28.014369 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011484 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 17:12:28.014369 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011486 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 17:12:28.014369 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011489 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 17:12:28.014878 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011492 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 17:12:28.014878 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011494 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 17:12:28.014878 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011497 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 17:12:28.014878 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011499 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 17:12:28.014878 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011502 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 17:12:28.014878 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011505 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 17:12:28.014878 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011507 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 17:12:28.014878 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011510 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 17:12:28.014878 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011512 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 17:12:28.014878 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011514 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 17:12:28.014878 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011517 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 17:12:28.014878 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011520 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 17:12:28.014878 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011522 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 17:12:28.014878 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011525 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 17:12:28.014878 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011527 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 17:12:28.014878 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011531 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 17:12:28.014878 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011533 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 17:12:28.014878 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011536 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 17:12:28.014878 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011539 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 17:12:28.014878 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011541 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 17:12:28.015359 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011543 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 17:12:28.015359 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011548 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 17:12:28.015359 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011551 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 17:12:28.015359 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011555 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 17:12:28.015359 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011559 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 17:12:28.015359 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011562 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 17:12:28.015359 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011565 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 17:12:28.015359 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011567 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 17:12:28.015359 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011570 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 17:12:28.015359 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011573 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 17:12:28.015359 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011576 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 17:12:28.015359 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011579 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 17:12:28.015359 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011581 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 17:12:28.015359 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011584 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 17:12:28.015359 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011587 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 17:12:28.015741 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.011592 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 05 17:12:28.015741 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011720 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 17:12:28.015741 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011726 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 17:12:28.015741 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011729 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 17:12:28.015741 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011732 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 17:12:28.015741 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011735 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 17:12:28.015741 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011738 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 17:12:28.015741 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011741 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 17:12:28.015741 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011744 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 17:12:28.015741 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011749 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 17:12:28.015741 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011753 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 17:12:28.015741 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011756 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 17:12:28.015741 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011759 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 17:12:28.015741 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011763 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 17:12:28.016083 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011766 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 17:12:28.016083 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011769 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 17:12:28.016083 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011772 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 17:12:28.016083 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011774 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 17:12:28.016083 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011777 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 17:12:28.016083 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011780 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 17:12:28.016083 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011783 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 17:12:28.016083 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011786 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 17:12:28.016083 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011788 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 17:12:28.016083 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011791 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 17:12:28.016083 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011794 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 17:12:28.016083 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011797 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 17:12:28.016083 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011799 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 17:12:28.016083 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011802 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 17:12:28.016083 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011805 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 17:12:28.016083 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011808 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 17:12:28.016083 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011810 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 17:12:28.016083 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011813 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 17:12:28.016083 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011815 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 17:12:28.016083 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011818 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 17:12:28.016561 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011820 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 17:12:28.016561 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011823 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 17:12:28.016561 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011825 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 17:12:28.016561 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011828 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 17:12:28.016561 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011830 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 17:12:28.016561 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011833 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 17:12:28.016561 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011835 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 17:12:28.016561 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011838 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 17:12:28.016561 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011840 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 17:12:28.016561 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011843 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 17:12:28.016561 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011846 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 17:12:28.016561 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011848 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 17:12:28.016561 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011851 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 17:12:28.016561 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011854 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 17:12:28.016561 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011856 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 17:12:28.016561 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011860 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 17:12:28.016561 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011864 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 17:12:28.016561 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011866 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 17:12:28.016561 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011869 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 17:12:28.017146 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011871 2562 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 17:12:28.017146 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011874 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 17:12:28.017146 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011876 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 17:12:28.017146 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011879 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 17:12:28.017146 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011881 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 17:12:28.017146 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011884 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 17:12:28.017146 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011887 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 17:12:28.017146 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011889 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 17:12:28.017146 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011892 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 17:12:28.017146 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011894 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 17:12:28.017146 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011897 2562 feature_gate.go:328] unrecognized feature gate: Example Aug 05 17:12:28.017146 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011900 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 17:12:28.017146 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011902 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 17:12:28.017146 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011905 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 17:12:28.017146 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011907 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 17:12:28.017146 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011910 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 17:12:28.017146 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011912 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 17:12:28.017146 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011915 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 17:12:28.017146 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011917 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 17:12:28.017146 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011920 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 17:12:28.017693 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011923 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 17:12:28.017693 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011925 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 17:12:28.017693 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011928 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 17:12:28.017693 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011930 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 17:12:28.017693 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011933 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 17:12:28.017693 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011935 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 17:12:28.017693 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011938 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 17:12:28.017693 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011941 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 17:12:28.017693 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011944 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 17:12:28.017693 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011946 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 17:12:28.017693 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011948 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 17:12:28.017693 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011951 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 17:12:28.017693 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011953 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 17:12:28.017693 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011956 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 17:12:28.017693 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011960 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 17:12:28.017693 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011963 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 17:12:28.017693 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011965 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 17:12:28.017693 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011968 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 17:12:28.017693 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011971 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 17:12:28.018205 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011973 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 17:12:28.018205 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011976 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 17:12:28.018205 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011978 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 17:12:28.018205 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011981 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 17:12:28.018205 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011984 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 17:12:28.018205 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011986 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 17:12:28.018205 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011989 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 17:12:28.018205 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:28.011991 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 17:12:28.018205 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.011997 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 05 17:12:28.018205 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.012107 2562 server.go:962] "Client rotation is on, will bootstrap in background" Aug 05 17:12:28.018205 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.017153 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Aug 05 17:12:28.018513 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.018500 2562 server.go:1019] "Starting client certificate rotation" Aug 05 17:12:28.018617 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.018598 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Aug 05 17:12:28.018656 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.018636 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Aug 05 17:12:28.021057 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.021042 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Aug 05 17:12:28.022277 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.022263 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Aug 05 17:12:28.033250 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.033231 2562 log.go:25] "Validated CRI v1 runtime API" Aug 05 17:12:28.035446 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.035434 2562 log.go:25] "Validated CRI v1 image API" Aug 05 17:12:28.036167 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.036152 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Aug 05 17:12:28.039348 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.039330 2562 fs.go:135] Filesystem UUIDs: map[58e1fc30-263e-4f1a-ab50-7c76b59e5bb1:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d7a017fb-2d78-45bb-b286-d8e26d948855:/dev/nvme0n1p3] Aug 05 17:12:28.039399 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.039348 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Aug 05 17:12:28.046064 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.045936 2562 manager.go:216] Machine: {Timestamp:2026-08-05 17:12:28.045420916 +0000 UTC m=+0.322613037 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098718 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26632ac16d3d53ab3553cd61b7ad06 SystemUUID:ec26632a-c16d-3d53-ab35-53cd61b7ad06 BootID:48f6d908-deba-40e0-a83e-eb20bf5830ee Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c2:78:d9:46:bb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c2:78:d9:46:bb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:e6:44:b1:59:36 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Aug 05 17:12:28.046064 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.046050 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Aug 05 17:12:28.046218 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.046133 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Aug 05 17:12:28.048748 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.048720 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Aug 05 17:12:28.048891 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.048752 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-104.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Aug 05 17:12:28.049321 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.049307 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Aug 05 17:12:28.049447 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.049436 2562 topology_manager.go:138] "Creating topology manager with none policy" Aug 05 17:12:28.049477 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.049452 2562 container_manager_linux.go:309] "Creating device plugin manager" Aug 05 17:12:28.049477 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.049461 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Aug 05 17:12:28.049477 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.049475 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Aug 05 17:12:28.050346 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.050336 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Aug 05 17:12:28.053861 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.053849 2562 state_mem.go:36] "Initialized new in-memory state store" Aug 05 17:12:28.053999 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.053988 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Aug 05 17:12:28.054035 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.054020 2562 kubelet.go:486] "Attempting to sync node with API server" Aug 05 17:12:28.054035 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.054029 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Aug 05 17:12:28.054086 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.054048 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Aug 05 17:12:28.054086 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.054057 2562 kubelet.go:398] "Adding apiserver pod source" Aug 05 17:12:28.054086 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.054065 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Aug 05 17:12:28.054514 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.054500 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Aug 05 17:12:28.054514 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.054518 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Aug 05 17:12:28.056561 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.056545 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Aug 05 17:12:28.058227 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.058214 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Aug 05 17:12:28.058275 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.058244 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Aug 05 17:12:28.059474 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.059457 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Aug 05 17:12:28.059474 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.059473 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Aug 05 17:12:28.059474 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.059480 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Aug 05 17:12:28.059474 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.059485 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Aug 05 17:12:28.059750 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.059493 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Aug 05 17:12:28.059750 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.059499 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Aug 05 17:12:28.059750 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.059507 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Aug 05 17:12:28.059750 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.059512 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Aug 05 17:12:28.059750 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.059519 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Aug 05 17:12:28.059750 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.059537 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Aug 05 17:12:28.059750 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.059546 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Aug 05 17:12:28.059750 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.059551 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Aug 05 17:12:28.060320 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.060310 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Aug 05 17:12:28.060320 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.060319 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Aug 05 17:12:28.063455 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.063437 2562 server.go:1268] "Started kubelet" Aug 05 17:12:28.063580 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.063517 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Aug 05 17:12:28.064135 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.064074 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Aug 05 17:12:28.064242 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.064155 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Aug 05 17:12:28.064382 ip-10-0-137-104 systemd[1]: Started Kubernetes Kubelet. Aug 05 17:12:28.065705 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.065418 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Aug 05 17:12:28.065705 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:28.065564 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Aug 05 17:12:28.065705 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:28.065689 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Aug 05 17:12:28.065915 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.065847 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Aug 05 17:12:28.067789 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.067644 2562 server.go:310] "Adding debug handlers to kubelet server" Aug 05 17:12:28.070368 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:28.070351 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Aug 05 17:12:28.071092 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.071074 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Aug 05 17:12:28.071162 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.071074 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Aug 05 17:12:28.071318 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:28.071283 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-104.ec2.internal\" not found" Aug 05 17:12:28.071835 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.071817 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Aug 05 17:12:28.071835 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.071836 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Aug 05 17:12:28.072003 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.071990 2562 reconstruct.go:97] "Volume reconstruction finished" Aug 05 17:12:28.072003 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.072002 2562 reconciler.go:29] "Reconciler: start to sync state" Aug 05 17:12:28.072186 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.072170 2562 factory.go:55] Registering systemd factory Aug 05 17:12:28.072244 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.072191 2562 factory.go:223] Registration of the systemd container factory successfully Aug 05 17:12:28.072415 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.071815 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Aug 05 17:12:28.072550 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.072432 2562 factory.go:153] Registering CRI-O factory Aug 05 17:12:28.072550 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.072445 2562 factory.go:223] Registration of the crio container factory successfully Aug 05 17:12:28.072550 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.072482 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Aug 05 17:12:28.072550 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.072530 2562 factory.go:103] Registering Raw factory Aug 05 17:12:28.072550 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.072546 2562 manager.go:1196] Started watching for new ooms in manager Aug 05 17:12:28.073115 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.073103 2562 manager.go:349] Starting recovery of all containers Aug 05 17:12:28.073505 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:28.072349 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-104.ec2.internal.18c8f803f0f271e7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-104.ec2.internal,UID:ip-10-0-137-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-104.ec2.internal,},FirstTimestamp:2026-08-05 17:12:28.063412711 +0000 UTC m=+0.340604832,LastTimestamp:2026-08-05 17:12:28.063412711 +0000 UTC m=+0.340604832,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-104.ec2.internal,}" Aug 05 17:12:28.079425 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.079395 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c7hmx" Aug 05 17:12:28.080960 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:28.080337 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Aug 05 17:12:28.080960 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:28.080415 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Aug 05 17:12:28.081091 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.081046 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Aug 05 17:12:28.086646 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.086624 2562 manager.go:354] Recovery completed Aug 05 17:12:28.087575 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.087551 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c7hmx" Aug 05 17:12:28.091331 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.091318 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 17:12:28.093278 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.093263 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-104.ec2.internal" event="NodeHasSufficientMemory" Aug 05 17:12:28.093355 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.093292 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-104.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 17:12:28.093355 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.093303 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-104.ec2.internal" event="NodeHasSufficientPID" Aug 05 17:12:28.093916 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.093897 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Aug 05 17:12:28.094000 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.093914 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Aug 05 17:12:28.094000 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.093940 2562 state_mem.go:36] "Initialized new in-memory state store" Aug 05 17:12:28.094000 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.093964 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 17:12:28.094658 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.094644 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-104.ec2.internal" event="NodeHasSufficientMemory" Aug 05 17:12:28.094756 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.094684 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-104.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 17:12:28.094756 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.094699 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-104.ec2.internal" event="NodeHasSufficientPID" Aug 05 17:12:28.171993 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:28.171943 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-104.ec2.internal\" not found" Aug 05 17:12:28.286032 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:28.272300 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-104.ec2.internal\" not found" Aug 05 17:12:28.286032 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.285466 2562 policy_none.go:49] "None policy: Start" Aug 05 17:12:28.286032 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.285484 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Aug 05 17:12:28.286032 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.285497 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Aug 05 17:12:28.286741 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.286728 2562 policy_none.go:47] "Start" Aug 05 17:12:28.290199 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:28.290181 2562 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-104.ec2.internal\" not found" node="ip-10-0-137-104.ec2.internal" Aug 05 17:12:28.315383 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.315224 2562 manager.go:337] "Starting Device Plugin manager" Aug 05 17:12:28.315477 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:28.315400 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Aug 05 17:12:28.315477 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.315413 2562 server.go:87] "Starting device plugin registration server" Aug 05 17:12:28.315698 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.315682 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Aug 05 17:12:28.315796 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.315700 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Aug 05 17:12:28.315858 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.315799 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Aug 05 17:12:28.315910 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.315892 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Aug 05 17:12:28.315910 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.315904 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Aug 05 17:12:28.317892 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:28.317867 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Aug 05 17:12:28.317997 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:28.317920 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-104.ec2.internal\" not found" Aug 05 17:12:28.330046 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.330017 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Aug 05 17:12:28.330144 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.330055 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Aug 05 17:12:28.330144 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.330073 2562 kubelet.go:2448] "Starting kubelet main sync loop" Aug 05 17:12:28.330144 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:28.330102 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Aug 05 17:12:28.332951 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.332921 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 17:12:28.416165 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.416132 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 17:12:28.417146 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.417131 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-104.ec2.internal" event="NodeHasSufficientMemory" Aug 05 17:12:28.417227 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.417161 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-104.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 17:12:28.417227 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.417175 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-104.ec2.internal" event="NodeHasSufficientPID" Aug 05 17:12:28.417227 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.417203 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-104.ec2.internal" Aug 05 17:12:28.430509 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.430486 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-104.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-104.ec2.internal"] Aug 05 17:12:28.430579 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.430572 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 17:12:28.432107 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.432092 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-104.ec2.internal" event="NodeHasSufficientMemory" Aug 05 17:12:28.432183 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.432120 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-104.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 17:12:28.432183 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.432131 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-104.ec2.internal" event="NodeHasSufficientPID" Aug 05 17:12:28.433484 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.433472 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 17:12:28.433628 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.433614 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-104.ec2.internal" Aug 05 17:12:28.433678 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.433647 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 17:12:28.433678 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.433659 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-104.ec2.internal" Aug 05 17:12:28.433739 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:28.433690 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-104.ec2.internal\": node \"ip-10-0-137-104.ec2.internal\" not found" Aug 05 17:12:28.434195 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.434181 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-104.ec2.internal" event="NodeHasSufficientMemory" Aug 05 17:12:28.434267 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.434205 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-104.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 17:12:28.434267 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.434185 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-104.ec2.internal" event="NodeHasSufficientMemory" Aug 05 17:12:28.434267 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.434214 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-104.ec2.internal" event="NodeHasSufficientPID" Aug 05 17:12:28.434267 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.434230 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-104.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 17:12:28.434267 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.434241 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-104.ec2.internal" event="NodeHasSufficientPID" Aug 05 17:12:28.435301 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.435289 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-104.ec2.internal" Aug 05 17:12:28.435345 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.435311 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 17:12:28.435927 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.435911 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-104.ec2.internal" event="NodeHasSufficientMemory" Aug 05 17:12:28.435992 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.435941 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-104.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 17:12:28.435992 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.435956 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-104.ec2.internal" event="NodeHasSufficientPID" Aug 05 17:12:28.459684 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:28.459654 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-104.ec2.internal\" not found" Aug 05 17:12:28.463315 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:28.463300 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-104.ec2.internal\" not found" node="ip-10-0-137-104.ec2.internal" Aug 05 17:12:28.467711 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:28.467696 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-104.ec2.internal\" not found" node="ip-10-0-137-104.ec2.internal" Aug 05 17:12:28.474978 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.474959 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1796cf7b895d78ea0c300a45d5e0584b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-104.ec2.internal\" (UID: \"1796cf7b895d78ea0c300a45d5e0584b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-104.ec2.internal" Aug 05 17:12:28.475049 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.474984 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1796cf7b895d78ea0c300a45d5e0584b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-104.ec2.internal\" (UID: \"1796cf7b895d78ea0c300a45d5e0584b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-104.ec2.internal" Aug 05 17:12:28.475049 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.475003 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0acbb7bf884d892b9a77e039f147c1de-config\") pod \"kube-apiserver-proxy-ip-10-0-137-104.ec2.internal\" (UID: \"0acbb7bf884d892b9a77e039f147c1de\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-104.ec2.internal" Aug 05 17:12:28.560210 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:28.560131 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-104.ec2.internal\" not found" Aug 05 17:12:28.575725 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.575702 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1796cf7b895d78ea0c300a45d5e0584b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-104.ec2.internal\" (UID: \"1796cf7b895d78ea0c300a45d5e0584b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-104.ec2.internal" Aug 05 17:12:28.575725 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.575722 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1796cf7b895d78ea0c300a45d5e0584b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-104.ec2.internal\" (UID: \"1796cf7b895d78ea0c300a45d5e0584b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-104.ec2.internal" Aug 05 17:12:28.575883 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.575763 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1796cf7b895d78ea0c300a45d5e0584b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-104.ec2.internal\" (UID: \"1796cf7b895d78ea0c300a45d5e0584b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-104.ec2.internal" Aug 05 17:12:28.575883 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.575791 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0acbb7bf884d892b9a77e039f147c1de-config\") pod \"kube-apiserver-proxy-ip-10-0-137-104.ec2.internal\" (UID: \"0acbb7bf884d892b9a77e039f147c1de\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-104.ec2.internal" Aug 05 17:12:28.575883 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.575824 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0acbb7bf884d892b9a77e039f147c1de-config\") pod \"kube-apiserver-proxy-ip-10-0-137-104.ec2.internal\" (UID: \"0acbb7bf884d892b9a77e039f147c1de\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-104.ec2.internal" Aug 05 17:12:28.575883 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:28.575832 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1796cf7b895d78ea0c300a45d5e0584b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-104.ec2.internal\" (UID: \"1796cf7b895d78ea0c300a45d5e0584b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-104.ec2.internal" Aug 05 17:12:28.660660 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:28.660631 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-104.ec2.internal\" not found" Aug 05 17:12:29.865945 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:29.865917 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-104.ec2.internal\" not found" Aug 05 17:12:29.871089 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:29.871073 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-104.ec2.internal" Aug 05 17:12:29.875469 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:29.875441 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-104.ec2.internal" Aug 05 17:12:29.966417 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:29.966319 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-104.ec2.internal\" not found" Aug 05 17:12:30.066961 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:30.066929 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-104.ec2.internal\" not found" Aug 05 17:12:30.122549 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:30.122508 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Aug 05 17:12:30.123003 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:30.122694 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Aug 05 17:12:30.167983 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:30.167948 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-104.ec2.internal\" not found" Aug 05 17:12:30.198616 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:30.198568 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-04 17:07:29 +0000 UTC" deadline="2028-01-30 03:40:21.410028005 +0000 UTC" Aug 05 17:12:30.198616 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:30.198606 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13018h27m51.211424972s" Aug 05 17:12:30.268849 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:30.268761 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-104.ec2.internal\" not found" Aug 05 17:12:30.369410 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:30.369369 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-104.ec2.internal\" not found" Aug 05 17:12:30.470292 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:30.470254 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-104.ec2.internal\" not found" Aug 05 17:12:30.530451 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:30.530386 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 17:12:30.576579 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:30.576553 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-104.ec2.internal" Aug 05 17:12:30.589974 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:30.589951 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Aug 05 17:12:30.592027 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:30.592012 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-104.ec2.internal" Aug 05 17:12:30.599557 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:30.599539 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Aug 05 17:12:30.699539 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:30.699511 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 17:12:30.752858 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:30.752831 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 17:12:30.800737 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:30.800682 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1796cf7b895d78ea0c300a45d5e0584b.slice/crio-c2680a39f076dd1a8904e4d3695b29068b348f02d466e6ffd2660b669471f4d8 WatchSource:0}: Error finding container c2680a39f076dd1a8904e4d3695b29068b348f02d466e6ffd2660b669471f4d8: Status 404 returned error can't find the container with id c2680a39f076dd1a8904e4d3695b29068b348f02d466e6ffd2660b669471f4d8 Aug 05 17:12:30.801031 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:30.801000 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0acbb7bf884d892b9a77e039f147c1de.slice/crio-a15e81bff1118e6e1732e6318c9f774e470bb042577d986b3f53ba1b40b07d86 WatchSource:0}: Error finding container a15e81bff1118e6e1732e6318c9f774e470bb042577d986b3f53ba1b40b07d86: Status 404 returned error can't find the container with id a15e81bff1118e6e1732e6318c9f774e470bb042577d986b3f53ba1b40b07d86 Aug 05 17:12:30.806263 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:30.806243 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 05 17:12:31.159914 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.159830 2562 apiserver.go:52] "Watching apiserver" Aug 05 17:12:31.169978 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.169956 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Aug 05 17:12:31.170908 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.170887 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-lxfxq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-26f2c","openshift-dns/node-resolver-x92vq","openshift-image-registry/node-ca-hm4pp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-104.ec2.internal","openshift-network-diagnostics/network-check-target-rw5vc","openshift-network-operator/iptables-alerter-64bcn","kube-system/global-pull-secret-syncer-m67dg","kube-system/konnectivity-agent-bbhd8","kube-system/kube-apiserver-proxy-ip-10-0-137-104.ec2.internal","openshift-cluster-node-tuning-operator/tuned-5hfnl","openshift-multus/multus-additional-cni-plugins-nx4tc","openshift-multus/multus-qzp8m","openshift-multus/network-metrics-daemon-smhw9"] Aug 05 17:12:31.172919 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.172906 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-64bcn" Aug 05 17:12:31.174166 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.174149 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.175328 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.175315 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smhw9" Aug 05 17:12:31.175420 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:31.175402 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smhw9" podUID="4618f8d9-07bc-4de7-9c7c-b09d7fe9d923" Aug 05 17:12:31.176184 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.176171 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Aug 05 17:12:31.176542 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.176528 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hm4pp" Aug 05 17:12:31.177202 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.177184 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mf6jf\"" Aug 05 17:12:31.177319 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.177218 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Aug 05 17:12:31.177435 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.177416 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Aug 05 17:12:31.177702 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.177679 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67dg" Aug 05 17:12:31.177798 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.177709 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Aug 05 17:12:31.177798 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:31.177738 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67dg" podUID="4e046e80-1c3a-4186-9ba4-0c393f1a9d0e" Aug 05 17:12:31.177798 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.177776 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Aug 05 17:12:31.178099 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.178085 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Aug 05 17:12:31.178538 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.178519 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6rjrh\"" Aug 05 17:12:31.178956 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.178940 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rw5vc" Aug 05 17:12:31.179027 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:31.179007 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rw5vc" podUID="8e25eb68-7896-4157-a857-0c72022fc3ff" Aug 05 17:12:31.180023 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.180000 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Aug 05 17:12:31.180127 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.180002 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Aug 05 17:12:31.181644 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.181062 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-brj7n\"" Aug 05 17:12:31.181756 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.181735 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Aug 05 17:12:31.183812 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.183692 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.183922 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.183858 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bbhd8" Aug 05 17:12:31.185421 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.185404 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-26f2c" Aug 05 17:12:31.186230 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.186215 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Aug 05 17:12:31.186976 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.186846 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nx4tc" Aug 05 17:12:31.187731 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.187714 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-etc-tuned\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.187804 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.187739 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4618f8d9-07bc-4de7-9c7c-b09d7fe9d923-metrics-certs\") pod \"network-metrics-daemon-smhw9\" (UID: \"4618f8d9-07bc-4de7-9c7c-b09d7fe9d923\") " pod="openshift-multus/network-metrics-daemon-smhw9" Aug 05 17:12:31.187804 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.187769 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/202de948-1d6f-4d03-a580-2e38f89164a1-host\") pod \"node-ca-hm4pp\" (UID: \"202de948-1d6f-4d03-a580-2e38f89164a1\") " pod="openshift-image-registry/node-ca-hm4pp" Aug 05 17:12:31.187804 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.187792 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/202de948-1d6f-4d03-a580-2e38f89164a1-serviceca\") pod \"node-ca-hm4pp\" (UID: \"202de948-1d6f-4d03-a580-2e38f89164a1\") " pod="openshift-image-registry/node-ca-hm4pp" Aug 05 17:12:31.187930 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.187841 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-run\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.187930 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.187869 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-sys\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.187930 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.187902 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f4596021-3f10-4dcb-812c-5d9cdcfa8373-iptables-alerter-script\") pod \"iptables-alerter-64bcn\" (UID: \"f4596021-3f10-4dcb-812c-5d9cdcfa8373\") " pod="openshift-network-operator/iptables-alerter-64bcn" Aug 05 17:12:31.188082 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.187927 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-etc-sysctl-conf\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.188082 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.187953 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-lib-modules\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.188082 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.187975 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4e046e80-1c3a-4186-9ba4-0c393f1a9d0e-kubelet-config\") pod \"global-pull-secret-syncer-m67dg\" (UID: \"4e046e80-1c3a-4186-9ba4-0c393f1a9d0e\") " pod="kube-system/global-pull-secret-syncer-m67dg" Aug 05 17:12:31.188082 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.187998 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4596021-3f10-4dcb-812c-5d9cdcfa8373-host-slash\") pod \"iptables-alerter-64bcn\" (UID: \"f4596021-3f10-4dcb-812c-5d9cdcfa8373\") " pod="openshift-network-operator/iptables-alerter-64bcn" Aug 05 17:12:31.188082 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.188020 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccp52\" (UniqueName: \"kubernetes.io/projected/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-kube-api-access-ccp52\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.188082 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.188042 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65w8c\" (UniqueName: \"kubernetes.io/projected/202de948-1d6f-4d03-a580-2e38f89164a1-kube-api-access-65w8c\") pod \"node-ca-hm4pp\" (UID: \"202de948-1d6f-4d03-a580-2e38f89164a1\") " pod="openshift-image-registry/node-ca-hm4pp" Aug 05 17:12:31.188082 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.188070 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e046e80-1c3a-4186-9ba4-0c393f1a9d0e-original-pull-secret\") pod \"global-pull-secret-syncer-m67dg\" (UID: \"4e046e80-1c3a-4186-9ba4-0c393f1a9d0e\") " pod="kube-system/global-pull-secret-syncer-m67dg" Aug 05 17:12:31.188483 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.188101 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-etc-systemd\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.188483 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.188120 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgzf6\" (UniqueName: \"kubernetes.io/projected/f4596021-3f10-4dcb-812c-5d9cdcfa8373-kube-api-access-mgzf6\") pod \"iptables-alerter-64bcn\" (UID: \"f4596021-3f10-4dcb-812c-5d9cdcfa8373\") " pod="openshift-network-operator/iptables-alerter-64bcn" Aug 05 17:12:31.188483 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.188135 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-etc-modprobe-d\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.188483 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.188149 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-etc-sysctl-d\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.188483 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.188164 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-tmp\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.188483 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.188179 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mbmm\" (UniqueName: \"kubernetes.io/projected/4618f8d9-07bc-4de7-9c7c-b09d7fe9d923-kube-api-access-5mbmm\") pod \"network-metrics-daemon-smhw9\" (UID: \"4618f8d9-07bc-4de7-9c7c-b09d7fe9d923\") " pod="openshift-multus/network-metrics-daemon-smhw9" Aug 05 17:12:31.188483 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.188194 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4e046e80-1c3a-4186-9ba4-0c393f1a9d0e-dbus\") pod \"global-pull-secret-syncer-m67dg\" (UID: \"4e046e80-1c3a-4186-9ba4-0c393f1a9d0e\") " pod="kube-system/global-pull-secret-syncer-m67dg" Aug 05 17:12:31.188483 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.188209 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-etc-sysconfig\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.188483 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.188233 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-etc-kubernetes\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.188483 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.188237 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.188483 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.188263 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-var-lib-kubelet\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.188483 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.188288 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-host\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.188483 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.188365 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fd46s\"" Aug 05 17:12:31.189634 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.189611 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x92vq" Aug 05 17:12:31.189779 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.189763 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Aug 05 17:12:31.189856 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.189827 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Aug 05 17:12:31.190018 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.189997 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Aug 05 17:12:31.190106 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.190043 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Aug 05 17:12:31.190106 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.190056 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Aug 05 17:12:31.190106 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.190057 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Aug 05 17:12:31.190277 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.190106 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Aug 05 17:12:31.190277 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.190071 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wb6cr\"" Aug 05 17:12:31.190886 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.190868 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Aug 05 17:12:31.191123 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.191110 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Aug 05 17:12:31.191211 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.191181 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Aug 05 17:12:31.191251 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.191212 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hhbh6\"" Aug 05 17:12:31.191251 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.191230 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Aug 05 17:12:31.191430 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.191419 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Aug 05 17:12:31.191604 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.191581 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Aug 05 17:12:31.192716 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.192674 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Aug 05 17:12:31.193056 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.193042 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jg4k4\"" Aug 05 17:12:31.193137 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.193074 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Aug 05 17:12:31.193266 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.193251 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Aug 05 17:12:31.193353 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.193265 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kssvc\"" Aug 05 17:12:31.194778 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.194763 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Aug 05 17:12:31.194857 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.194777 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-trblj\"" Aug 05 17:12:31.196369 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.196353 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Aug 05 17:12:31.198776 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.198759 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Aug 05 17:12:31.214141 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.214123 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wfmg2" Aug 05 17:12:31.222956 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.222941 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wfmg2" Aug 05 17:12:31.278076 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.278055 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Aug 05 17:12:31.288949 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.288920 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71a8ffdb-65f6-4e21-9ebf-a37111978c48-tmp-dir\") pod \"node-resolver-x92vq\" (UID: \"71a8ffdb-65f6-4e21-9ebf-a37111978c48\") " pod="openshift-dns/node-resolver-x92vq" Aug 05 17:12:31.289072 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.288960 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-etc-systemd\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.289072 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.288988 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-systemd-units\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.289072 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.289013 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-host-cni-netd\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.289072 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.289044 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/13196e32-1d2a-474f-9055-6dd74b3d5b86-konnectivity-ca\") pod \"konnectivity-agent-bbhd8\" (UID: \"13196e32-1d2a-474f-9055-6dd74b3d5b86\") " pod="kube-system/konnectivity-agent-bbhd8" Aug 05 17:12:31.289072 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.289069 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-var-lib-kubelet\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.289298 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.289074 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-etc-systemd\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.289298 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.289094 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4618f8d9-07bc-4de7-9c7c-b09d7fe9d923-metrics-certs\") pod \"network-metrics-daemon-smhw9\" (UID: \"4618f8d9-07bc-4de7-9c7c-b09d7fe9d923\") " pod="openshift-multus/network-metrics-daemon-smhw9" Aug 05 17:12:31.289298 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.289135 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-var-lib-kubelet\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.289298 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.289145 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-run-systemd\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.289298 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.289188 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97da412c-62d1-470d-a056-aeac249c73f7-cnibin\") pod \"multus-additional-cni-plugins-nx4tc\" (UID: \"97da412c-62d1-470d-a056-aeac249c73f7\") " pod="openshift-multus/multus-additional-cni-plugins-nx4tc" Aug 05 17:12:31.289298 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:31.289197 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:31.289298 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.289214 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97da412c-62d1-470d-a056-aeac249c73f7-cni-binary-copy\") pod \"multus-additional-cni-plugins-nx4tc\" (UID: \"97da412c-62d1-470d-a056-aeac249c73f7\") " pod="openshift-multus/multus-additional-cni-plugins-nx4tc" Aug 05 17:12:31.289298 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:31.289257 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4618f8d9-07bc-4de7-9c7c-b09d7fe9d923-metrics-certs podName:4618f8d9-07bc-4de7-9c7c-b09d7fe9d923 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:31.789229504 +0000 UTC m=+2.961753397 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4618f8d9-07bc-4de7-9c7c-b09d7fe9d923-metrics-certs") pod "network-metrics-daemon-smhw9" (UID: "4618f8d9-07bc-4de7-9c7c-b09d7fe9d923") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:31.289298 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.289275 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnj7v\" (UniqueName: \"kubernetes.io/projected/cca3acc3-94b8-4f10-8804-719ac52f1537-kube-api-access-bnj7v\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.289636 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.289301 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f8ft\" (UniqueName: \"kubernetes.io/projected/7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89-kube-api-access-9f8ft\") pod \"aws-ebs-csi-driver-node-26f2c\" (UID: \"7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-26f2c" Aug 05 17:12:31.289636 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.289350 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-log-socket\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.289636 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.289378 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-multus-socket-dir-parent\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.289636 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.289422 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-node-log\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.289636 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.289470 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-host-run-ovn-kubernetes\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.289636 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.289520 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/97da412c-62d1-470d-a056-aeac249c73f7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nx4tc\" (UID: \"97da412c-62d1-470d-a056-aeac249c73f7\") " pod="openshift-multus/multus-additional-cni-plugins-nx4tc" Aug 05 17:12:31.289636 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.289559 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e046e80-1c3a-4186-9ba4-0c393f1a9d0e-original-pull-secret\") pod \"global-pull-secret-syncer-m67dg\" (UID: \"4e046e80-1c3a-4186-9ba4-0c393f1a9d0e\") " pod="kube-system/global-pull-secret-syncer-m67dg" Aug 05 17:12:31.289636 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.289596 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-etc-sysctl-d\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.289636 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.289624 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mbmm\" (UniqueName: \"kubernetes.io/projected/4618f8d9-07bc-4de7-9c7c-b09d7fe9d923-kube-api-access-5mbmm\") pod \"network-metrics-daemon-smhw9\" (UID: \"4618f8d9-07bc-4de7-9c7c-b09d7fe9d923\") " pod="openshift-multus/network-metrics-daemon-smhw9" Aug 05 17:12:31.289636 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:31.289631 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:31.290040 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.289650 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-etc-kubernetes\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.290040 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:31.289675 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e046e80-1c3a-4186-9ba4-0c393f1a9d0e-original-pull-secret podName:4e046e80-1c3a-4186-9ba4-0c393f1a9d0e nodeName:}" failed. No retries permitted until 2026-08-05 17:12:31.789660415 +0000 UTC m=+2.962184318 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e046e80-1c3a-4186-9ba4-0c393f1a9d0e-original-pull-secret") pod "global-pull-secret-syncer-m67dg" (UID: "4e046e80-1c3a-4186-9ba4-0c393f1a9d0e") : object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:31.290040 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.289689 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-etc-sysctl-d\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.290040 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.289694 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89-registration-dir\") pod \"aws-ebs-csi-driver-node-26f2c\" (UID: \"7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-26f2c" Aug 05 17:12:31.290040 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.289721 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89-device-dir\") pod \"aws-ebs-csi-driver-node-26f2c\" (UID: \"7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-26f2c" Aug 05 17:12:31.290040 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.289744 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-run-ovn\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.290040 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.289764 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c85c5ba1-cee1-4308-a12c-8ab17a41b118-ovnkube-script-lib\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.290040 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.289781 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-etc-sysconfig\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.290040 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.289798 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-etc-kubernetes\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.290040 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.289820 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/202de948-1d6f-4d03-a580-2e38f89164a1-host\") pod \"node-ca-hm4pp\" (UID: \"202de948-1d6f-4d03-a580-2e38f89164a1\") " pod="openshift-image-registry/node-ca-hm4pp" Aug 05 17:12:31.290040 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.289857 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4e046e80-1c3a-4186-9ba4-0c393f1a9d0e-kubelet-config\") pod \"global-pull-secret-syncer-m67dg\" (UID: \"4e046e80-1c3a-4186-9ba4-0c393f1a9d0e\") " pod="kube-system/global-pull-secret-syncer-m67dg" Aug 05 17:12:31.290040 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.289870 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-etc-kubernetes\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.290040 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.289879 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-system-cni-dir\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.290040 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.289890 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-etc-sysconfig\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.290040 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.289913 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-host-var-lib-cni-bin\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.290040 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.289956 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/202de948-1d6f-4d03-a580-2e38f89164a1-host\") pod \"node-ca-hm4pp\" (UID: \"202de948-1d6f-4d03-a580-2e38f89164a1\") " pod="openshift-image-registry/node-ca-hm4pp" Aug 05 17:12:31.290768 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.290003 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4e046e80-1c3a-4186-9ba4-0c393f1a9d0e-kubelet-config\") pod \"global-pull-secret-syncer-m67dg\" (UID: \"4e046e80-1c3a-4186-9ba4-0c393f1a9d0e\") " pod="kube-system/global-pull-secret-syncer-m67dg" Aug 05 17:12:31.290768 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.290466 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-host-run-multus-certs\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.290768 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.290499 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78485\" (UniqueName: \"kubernetes.io/projected/8e25eb68-7896-4157-a857-0c72022fc3ff-kube-api-access-78485\") pod \"network-check-target-rw5vc\" (UID: \"8e25eb68-7896-4157-a857-0c72022fc3ff\") " pod="openshift-network-diagnostics/network-check-target-rw5vc" Aug 05 17:12:31.290768 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.290517 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-lib-modules\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.290768 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.290531 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-cnibin\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.290768 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.290545 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-host-var-lib-cni-multus\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.290768 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.290565 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97da412c-62d1-470d-a056-aeac249c73f7-system-cni-dir\") pod \"multus-additional-cni-plugins-nx4tc\" (UID: \"97da412c-62d1-470d-a056-aeac249c73f7\") " pod="openshift-multus/multus-additional-cni-plugins-nx4tc" Aug 05 17:12:31.291079 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.290588 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/97da412c-62d1-470d-a056-aeac249c73f7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nx4tc\" (UID: \"97da412c-62d1-470d-a056-aeac249c73f7\") " pod="openshift-multus/multus-additional-cni-plugins-nx4tc" Aug 05 17:12:31.291079 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.290950 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdvnh\" (UniqueName: \"kubernetes.io/projected/71a8ffdb-65f6-4e21-9ebf-a37111978c48-kube-api-access-wdvnh\") pod \"node-resolver-x92vq\" (UID: \"71a8ffdb-65f6-4e21-9ebf-a37111978c48\") " pod="openshift-dns/node-resolver-x92vq" Aug 05 17:12:31.291079 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.290982 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-lib-modules\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.291079 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.290992 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4596021-3f10-4dcb-812c-5d9cdcfa8373-host-slash\") pod \"iptables-alerter-64bcn\" (UID: \"f4596021-3f10-4dcb-812c-5d9cdcfa8373\") " pod="openshift-network-operator/iptables-alerter-64bcn" Aug 05 17:12:31.291262 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.291083 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cca3acc3-94b8-4f10-8804-719ac52f1537-multus-daemon-config\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.291262 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.291121 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/97da412c-62d1-470d-a056-aeac249c73f7-os-release\") pod \"multus-additional-cni-plugins-nx4tc\" (UID: \"97da412c-62d1-470d-a056-aeac249c73f7\") " pod="openshift-multus/multus-additional-cni-plugins-nx4tc" Aug 05 17:12:31.291262 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.291158 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-etc-modprobe-d\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.291262 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.291183 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4e046e80-1c3a-4186-9ba4-0c393f1a9d0e-dbus\") pod \"global-pull-secret-syncer-m67dg\" (UID: \"4e046e80-1c3a-4186-9ba4-0c393f1a9d0e\") " pod="kube-system/global-pull-secret-syncer-m67dg" Aug 05 17:12:31.291262 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.291251 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-run-openvswitch\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.291508 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.291282 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c85c5ba1-cee1-4308-a12c-8ab17a41b118-ovn-node-metrics-cert\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.291508 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.291325 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/202de948-1d6f-4d03-a580-2e38f89164a1-serviceca\") pod \"node-ca-hm4pp\" (UID: \"202de948-1d6f-4d03-a580-2e38f89164a1\") " pod="openshift-image-registry/node-ca-hm4pp" Aug 05 17:12:31.291508 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.291372 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-os-release\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.291508 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.291401 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-hostroot\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.291508 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.291418 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4e046e80-1c3a-4186-9ba4-0c393f1a9d0e-dbus\") pod \"global-pull-secret-syncer-m67dg\" (UID: \"4e046e80-1c3a-4186-9ba4-0c393f1a9d0e\") " pod="kube-system/global-pull-secret-syncer-m67dg" Aug 05 17:12:31.291508 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.291430 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.291508 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.291460 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c85c5ba1-cee1-4308-a12c-8ab17a41b118-env-overrides\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.291508 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.291494 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/13196e32-1d2a-474f-9055-6dd74b3d5b86-agent-certs\") pod \"konnectivity-agent-bbhd8\" (UID: \"13196e32-1d2a-474f-9055-6dd74b3d5b86\") " pod="kube-system/konnectivity-agent-bbhd8" Aug 05 17:12:31.291840 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.291527 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-run\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.291840 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.291554 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-sys\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.291840 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.291582 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f4596021-3f10-4dcb-812c-5d9cdcfa8373-iptables-alerter-script\") pod \"iptables-alerter-64bcn\" (UID: \"f4596021-3f10-4dcb-812c-5d9cdcfa8373\") " pod="openshift-network-operator/iptables-alerter-64bcn" Aug 05 17:12:31.291840 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.291524 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4596021-3f10-4dcb-812c-5d9cdcfa8373-host-slash\") pod \"iptables-alerter-64bcn\" (UID: \"f4596021-3f10-4dcb-812c-5d9cdcfa8373\") " pod="openshift-network-operator/iptables-alerter-64bcn" Aug 05 17:12:31.291840 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.291646 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-host-slash\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.291840 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.291733 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-etc-modprobe-d\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.291840 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.291788 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccp52\" (UniqueName: \"kubernetes.io/projected/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-kube-api-access-ccp52\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.291840 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.291824 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65w8c\" (UniqueName: \"kubernetes.io/projected/202de948-1d6f-4d03-a580-2e38f89164a1-kube-api-access-65w8c\") pod \"node-ca-hm4pp\" (UID: \"202de948-1d6f-4d03-a580-2e38f89164a1\") " pod="openshift-image-registry/node-ca-hm4pp" Aug 05 17:12:31.292168 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.291880 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-multus-conf-dir\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.292168 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.291914 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89-kubelet-dir\") pod \"aws-ebs-csi-driver-node-26f2c\" (UID: \"7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-26f2c" Aug 05 17:12:31.292168 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.291943 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89-etc-selinux\") pod \"aws-ebs-csi-driver-node-26f2c\" (UID: \"7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-26f2c" Aug 05 17:12:31.292168 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.291971 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/71a8ffdb-65f6-4e21-9ebf-a37111978c48-hosts-file\") pod \"node-resolver-x92vq\" (UID: \"71a8ffdb-65f6-4e21-9ebf-a37111978c48\") " pod="openshift-dns/node-resolver-x92vq" Aug 05 17:12:31.292168 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.292021 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgzf6\" (UniqueName: \"kubernetes.io/projected/f4596021-3f10-4dcb-812c-5d9cdcfa8373-kube-api-access-mgzf6\") pod \"iptables-alerter-64bcn\" (UID: \"f4596021-3f10-4dcb-812c-5d9cdcfa8373\") " pod="openshift-network-operator/iptables-alerter-64bcn" Aug 05 17:12:31.292168 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.292050 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-tmp\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.292168 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.292079 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-host-run-k8s-cni-cncf-io\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.292168 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.292091 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/202de948-1d6f-4d03-a580-2e38f89164a1-serviceca\") pod \"node-ca-hm4pp\" (UID: \"202de948-1d6f-4d03-a580-2e38f89164a1\") " pod="openshift-image-registry/node-ca-hm4pp" Aug 05 17:12:31.292168 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.292102 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-host-var-lib-kubelet\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.292168 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.292135 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89-sys-fs\") pod \"aws-ebs-csi-driver-node-26f2c\" (UID: \"7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-26f2c" Aug 05 17:12:31.292168 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.292164 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c85c5ba1-cee1-4308-a12c-8ab17a41b118-ovnkube-config\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.292647 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.292516 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Aug 05 17:12:31.292828 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.292806 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-sys\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.292892 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.292838 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlfrg\" (UniqueName: \"kubernetes.io/projected/97da412c-62d1-470d-a056-aeac249c73f7-kube-api-access-hlfrg\") pod \"multus-additional-cni-plugins-nx4tc\" (UID: \"97da412c-62d1-470d-a056-aeac249c73f7\") " pod="openshift-multus/multus-additional-cni-plugins-nx4tc" Aug 05 17:12:31.292943 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.292900 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-host\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.292943 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.292912 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f4596021-3f10-4dcb-812c-5d9cdcfa8373-iptables-alerter-script\") pod \"iptables-alerter-64bcn\" (UID: \"f4596021-3f10-4dcb-812c-5d9cdcfa8373\") " pod="openshift-network-operator/iptables-alerter-64bcn" Aug 05 17:12:31.292943 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.292934 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-etc-tuned\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.293379 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.293358 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-host-run-netns\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.293457 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.293404 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-host-cni-bin\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.293457 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.293440 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-etc-sysctl-conf\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.293553 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.293468 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-multus-cni-dir\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.293553 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.293491 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-host-run-netns\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.293553 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.293521 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89-socket-dir\") pod \"aws-ebs-csi-driver-node-26f2c\" (UID: \"7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-26f2c" Aug 05 17:12:31.293685 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.293551 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-host-kubelet\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.293685 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.293581 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97da412c-62d1-470d-a056-aeac249c73f7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nx4tc\" (UID: \"97da412c-62d1-470d-a056-aeac249c73f7\") " pod="openshift-multus/multus-additional-cni-plugins-nx4tc" Aug 05 17:12:31.293685 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.293612 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cca3acc3-94b8-4f10-8804-719ac52f1537-cni-binary-copy\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.293685 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.293635 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-var-lib-openvswitch\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.293685 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.293663 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-etc-openvswitch\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.293903 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.293835 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-run\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.293903 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.293876 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktf6t\" (UniqueName: \"kubernetes.io/projected/c85c5ba1-cee1-4308-a12c-8ab17a41b118-kube-api-access-ktf6t\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.294142 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.294117 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-host\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.294194 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.294177 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-etc-sysctl-conf\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.296397 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.296378 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-etc-tuned\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.296501 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.296422 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-tmp\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.303049 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.303029 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mbmm\" (UniqueName: \"kubernetes.io/projected/4618f8d9-07bc-4de7-9c7c-b09d7fe9d923-kube-api-access-5mbmm\") pod \"network-metrics-daemon-smhw9\" (UID: \"4618f8d9-07bc-4de7-9c7c-b09d7fe9d923\") " pod="openshift-multus/network-metrics-daemon-smhw9" Aug 05 17:12:31.308713 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.308687 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgzf6\" (UniqueName: \"kubernetes.io/projected/f4596021-3f10-4dcb-812c-5d9cdcfa8373-kube-api-access-mgzf6\") pod \"iptables-alerter-64bcn\" (UID: \"f4596021-3f10-4dcb-812c-5d9cdcfa8373\") " pod="openshift-network-operator/iptables-alerter-64bcn" Aug 05 17:12:31.309162 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.309141 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccp52\" (UniqueName: \"kubernetes.io/projected/efe99302-9b6f-4f5b-9fd4-9327d511cd6e-kube-api-access-ccp52\") pod \"tuned-5hfnl\" (UID: \"efe99302-9b6f-4f5b-9fd4-9327d511cd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.309277 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.309257 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65w8c\" (UniqueName: \"kubernetes.io/projected/202de948-1d6f-4d03-a580-2e38f89164a1-kube-api-access-65w8c\") pod \"node-ca-hm4pp\" (UID: \"202de948-1d6f-4d03-a580-2e38f89164a1\") " pod="openshift-image-registry/node-ca-hm4pp" Aug 05 17:12:31.394610 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.394574 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-etc-kubernetes\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.394805 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.394618 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89-registration-dir\") pod \"aws-ebs-csi-driver-node-26f2c\" (UID: \"7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-26f2c" Aug 05 17:12:31.394805 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.394645 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89-device-dir\") pod \"aws-ebs-csi-driver-node-26f2c\" (UID: \"7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-26f2c" Aug 05 17:12:31.394805 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.394676 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-run-ovn\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.394805 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.394687 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-etc-kubernetes\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.394805 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.394703 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c85c5ba1-cee1-4308-a12c-8ab17a41b118-ovnkube-script-lib\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.394805 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.394747 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-system-cni-dir\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.394805 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.394776 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-host-var-lib-cni-bin\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.394805 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.394800 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-host-run-multus-certs\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.395202 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.394825 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78485\" (UniqueName: \"kubernetes.io/projected/8e25eb68-7896-4157-a857-0c72022fc3ff-kube-api-access-78485\") pod \"network-check-target-rw5vc\" (UID: \"8e25eb68-7896-4157-a857-0c72022fc3ff\") " pod="openshift-network-diagnostics/network-check-target-rw5vc" Aug 05 17:12:31.395202 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.394852 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-cnibin\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.395202 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.394882 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-host-var-lib-cni-multus\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.395202 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.394906 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97da412c-62d1-470d-a056-aeac249c73f7-system-cni-dir\") pod \"multus-additional-cni-plugins-nx4tc\" (UID: \"97da412c-62d1-470d-a056-aeac249c73f7\") " pod="openshift-multus/multus-additional-cni-plugins-nx4tc" Aug 05 17:12:31.395202 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.394931 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/97da412c-62d1-470d-a056-aeac249c73f7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nx4tc\" (UID: \"97da412c-62d1-470d-a056-aeac249c73f7\") " pod="openshift-multus/multus-additional-cni-plugins-nx4tc" Aug 05 17:12:31.395202 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.394957 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdvnh\" (UniqueName: \"kubernetes.io/projected/71a8ffdb-65f6-4e21-9ebf-a37111978c48-kube-api-access-wdvnh\") pod \"node-resolver-x92vq\" (UID: \"71a8ffdb-65f6-4e21-9ebf-a37111978c48\") " pod="openshift-dns/node-resolver-x92vq" Aug 05 17:12:31.395202 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.394982 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cca3acc3-94b8-4f10-8804-719ac52f1537-multus-daemon-config\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.395202 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395005 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/97da412c-62d1-470d-a056-aeac249c73f7-os-release\") pod \"multus-additional-cni-plugins-nx4tc\" (UID: \"97da412c-62d1-470d-a056-aeac249c73f7\") " pod="openshift-multus/multus-additional-cni-plugins-nx4tc" Aug 05 17:12:31.395202 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395034 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-run-openvswitch\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.395202 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395077 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c85c5ba1-cee1-4308-a12c-8ab17a41b118-ovn-node-metrics-cert\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.395202 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395107 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-os-release\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.395202 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395198 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/97da412c-62d1-470d-a056-aeac249c73f7-os-release\") pod \"multus-additional-cni-plugins-nx4tc\" (UID: \"97da412c-62d1-470d-a056-aeac249c73f7\") " pod="openshift-multus/multus-additional-cni-plugins-nx4tc" Aug 05 17:12:31.395803 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395236 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-system-cni-dir\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.395803 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395250 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89-registration-dir\") pod \"aws-ebs-csi-driver-node-26f2c\" (UID: \"7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-26f2c" Aug 05 17:12:31.395803 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395289 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-host-var-lib-cni-bin\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.395803 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395329 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-host-run-multus-certs\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.395803 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395384 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c85c5ba1-cee1-4308-a12c-8ab17a41b118-ovnkube-script-lib\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.395803 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395400 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-host-var-lib-cni-multus\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.395803 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395199 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89-device-dir\") pod \"aws-ebs-csi-driver-node-26f2c\" (UID: \"7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-26f2c" Aug 05 17:12:31.395803 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395406 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-run-ovn\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.395803 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395423 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-hostroot\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.395803 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395454 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-run-openvswitch\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.395803 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395463 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-os-release\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.395803 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395453 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.395803 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395494 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-hostroot\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.395803 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395494 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.395803 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395513 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c85c5ba1-cee1-4308-a12c-8ab17a41b118-env-overrides\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.395803 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395531 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-cnibin\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.395803 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395541 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/13196e32-1d2a-474f-9055-6dd74b3d5b86-agent-certs\") pod \"konnectivity-agent-bbhd8\" (UID: \"13196e32-1d2a-474f-9055-6dd74b3d5b86\") " pod="kube-system/konnectivity-agent-bbhd8" Aug 05 17:12:31.395803 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395573 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-host-slash\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.396675 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395601 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-multus-conf-dir\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.396675 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395626 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89-kubelet-dir\") pod \"aws-ebs-csi-driver-node-26f2c\" (UID: \"7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-26f2c" Aug 05 17:12:31.396675 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395652 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89-etc-selinux\") pod \"aws-ebs-csi-driver-node-26f2c\" (UID: \"7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-26f2c" Aug 05 17:12:31.396675 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395675 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/71a8ffdb-65f6-4e21-9ebf-a37111978c48-hosts-file\") pod \"node-resolver-x92vq\" (UID: \"71a8ffdb-65f6-4e21-9ebf-a37111978c48\") " pod="openshift-dns/node-resolver-x92vq" Aug 05 17:12:31.396675 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395702 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-host-run-k8s-cni-cncf-io\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.396675 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395726 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-host-var-lib-kubelet\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.396675 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395750 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89-sys-fs\") pod \"aws-ebs-csi-driver-node-26f2c\" (UID: \"7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-26f2c" Aug 05 17:12:31.396675 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395774 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c85c5ba1-cee1-4308-a12c-8ab17a41b118-ovnkube-config\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.396675 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395791 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89-etc-selinux\") pod \"aws-ebs-csi-driver-node-26f2c\" (UID: \"7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-26f2c" Aug 05 17:12:31.396675 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395800 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlfrg\" (UniqueName: \"kubernetes.io/projected/97da412c-62d1-470d-a056-aeac249c73f7-kube-api-access-hlfrg\") pod \"multus-additional-cni-plugins-nx4tc\" (UID: \"97da412c-62d1-470d-a056-aeac249c73f7\") " pod="openshift-multus/multus-additional-cni-plugins-nx4tc" Aug 05 17:12:31.396675 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395826 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cca3acc3-94b8-4f10-8804-719ac52f1537-multus-daemon-config\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.396675 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395833 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-host-run-netns\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.396675 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395851 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/97da412c-62d1-470d-a056-aeac249c73f7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nx4tc\" (UID: \"97da412c-62d1-470d-a056-aeac249c73f7\") " pod="openshift-multus/multus-additional-cni-plugins-nx4tc" Aug 05 17:12:31.396675 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395875 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89-kubelet-dir\") pod \"aws-ebs-csi-driver-node-26f2c\" (UID: \"7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-26f2c" Aug 05 17:12:31.396675 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395918 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-host-cni-bin\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.396675 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395676 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-host-slash\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.396675 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395920 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97da412c-62d1-470d-a056-aeac249c73f7-system-cni-dir\") pod \"multus-additional-cni-plugins-nx4tc\" (UID: \"97da412c-62d1-470d-a056-aeac249c73f7\") " pod="openshift-multus/multus-additional-cni-plugins-nx4tc" Aug 05 17:12:31.397518 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395948 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c85c5ba1-cee1-4308-a12c-8ab17a41b118-env-overrides\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.397518 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395835 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-multus-conf-dir\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.397518 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395963 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/71a8ffdb-65f6-4e21-9ebf-a37111978c48-hosts-file\") pod \"node-resolver-x92vq\" (UID: \"71a8ffdb-65f6-4e21-9ebf-a37111978c48\") " pod="openshift-dns/node-resolver-x92vq" Aug 05 17:12:31.397518 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395920 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89-sys-fs\") pod \"aws-ebs-csi-driver-node-26f2c\" (UID: \"7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-26f2c" Aug 05 17:12:31.397518 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395858 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-host-cni-bin\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.397518 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.395977 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-host-run-k8s-cni-cncf-io\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.397518 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396006 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-multus-cni-dir\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.397518 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396014 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-host-run-netns\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.397518 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396032 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-host-run-netns\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.397518 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396069 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-multus-cni-dir\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.397518 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396056 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89-socket-dir\") pod \"aws-ebs-csi-driver-node-26f2c\" (UID: \"7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-26f2c" Aug 05 17:12:31.397518 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396084 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-host-run-netns\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.397518 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396105 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-host-kubelet\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.397518 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396128 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97da412c-62d1-470d-a056-aeac249c73f7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nx4tc\" (UID: \"97da412c-62d1-470d-a056-aeac249c73f7\") " pod="openshift-multus/multus-additional-cni-plugins-nx4tc" Aug 05 17:12:31.397518 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396169 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89-socket-dir\") pod \"aws-ebs-csi-driver-node-26f2c\" (UID: \"7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-26f2c" Aug 05 17:12:31.397518 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396174 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-host-kubelet\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.397518 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396211 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cca3acc3-94b8-4f10-8804-719ac52f1537-cni-binary-copy\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.397518 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396237 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-var-lib-openvswitch\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.398383 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396257 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-host-var-lib-kubelet\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.398383 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396266 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-etc-openvswitch\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.398383 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396291 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktf6t\" (UniqueName: \"kubernetes.io/projected/c85c5ba1-cee1-4308-a12c-8ab17a41b118-kube-api-access-ktf6t\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.398383 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396295 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-var-lib-openvswitch\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.398383 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396302 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-etc-openvswitch\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.398383 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396259 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97da412c-62d1-470d-a056-aeac249c73f7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nx4tc\" (UID: \"97da412c-62d1-470d-a056-aeac249c73f7\") " pod="openshift-multus/multus-additional-cni-plugins-nx4tc" Aug 05 17:12:31.398383 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396326 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71a8ffdb-65f6-4e21-9ebf-a37111978c48-tmp-dir\") pod \"node-resolver-x92vq\" (UID: \"71a8ffdb-65f6-4e21-9ebf-a37111978c48\") " pod="openshift-dns/node-resolver-x92vq" Aug 05 17:12:31.398383 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396374 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-systemd-units\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.398383 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396400 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-host-cni-netd\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.398383 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396424 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c85c5ba1-cee1-4308-a12c-8ab17a41b118-ovnkube-config\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.398383 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396424 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/13196e32-1d2a-474f-9055-6dd74b3d5b86-konnectivity-ca\") pod \"konnectivity-agent-bbhd8\" (UID: \"13196e32-1d2a-474f-9055-6dd74b3d5b86\") " pod="kube-system/konnectivity-agent-bbhd8" Aug 05 17:12:31.398383 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396479 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-run-systemd\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.398383 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396503 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97da412c-62d1-470d-a056-aeac249c73f7-cnibin\") pod \"multus-additional-cni-plugins-nx4tc\" (UID: \"97da412c-62d1-470d-a056-aeac249c73f7\") " pod="openshift-multus/multus-additional-cni-plugins-nx4tc" Aug 05 17:12:31.398383 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396528 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97da412c-62d1-470d-a056-aeac249c73f7-cni-binary-copy\") pod \"multus-additional-cni-plugins-nx4tc\" (UID: \"97da412c-62d1-470d-a056-aeac249c73f7\") " pod="openshift-multus/multus-additional-cni-plugins-nx4tc" Aug 05 17:12:31.398383 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396551 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnj7v\" (UniqueName: \"kubernetes.io/projected/cca3acc3-94b8-4f10-8804-719ac52f1537-kube-api-access-bnj7v\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.398383 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396556 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-systemd-units\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.398383 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396574 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f8ft\" (UniqueName: \"kubernetes.io/projected/7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89-kube-api-access-9f8ft\") pod \"aws-ebs-csi-driver-node-26f2c\" (UID: \"7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-26f2c" Aug 05 17:12:31.399191 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396605 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97da412c-62d1-470d-a056-aeac249c73f7-cnibin\") pod \"multus-additional-cni-plugins-nx4tc\" (UID: \"97da412c-62d1-470d-a056-aeac249c73f7\") " pod="openshift-multus/multus-additional-cni-plugins-nx4tc" Aug 05 17:12:31.399191 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396646 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-log-socket\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.399191 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396654 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-run-systemd\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.399191 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396671 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-multus-socket-dir-parent\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.399191 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396676 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-host-cni-netd\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.399191 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396696 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-node-log\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.399191 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396716 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cca3acc3-94b8-4f10-8804-719ac52f1537-cni-binary-copy\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.399191 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396721 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-host-run-ovn-kubernetes\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.399191 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396744 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/97da412c-62d1-470d-a056-aeac249c73f7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nx4tc\" (UID: \"97da412c-62d1-470d-a056-aeac249c73f7\") " pod="openshift-multus/multus-additional-cni-plugins-nx4tc" Aug 05 17:12:31.399191 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396764 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-log-socket\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.399191 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396618 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71a8ffdb-65f6-4e21-9ebf-a37111978c48-tmp-dir\") pod \"node-resolver-x92vq\" (UID: \"71a8ffdb-65f6-4e21-9ebf-a37111978c48\") " pod="openshift-dns/node-resolver-x92vq" Aug 05 17:12:31.399191 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396820 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-node-log\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.399191 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396867 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cca3acc3-94b8-4f10-8804-719ac52f1537-multus-socket-dir-parent\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.399191 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.396886 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c85c5ba1-cee1-4308-a12c-8ab17a41b118-host-run-ovn-kubernetes\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.399191 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.397152 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97da412c-62d1-470d-a056-aeac249c73f7-cni-binary-copy\") pod \"multus-additional-cni-plugins-nx4tc\" (UID: \"97da412c-62d1-470d-a056-aeac249c73f7\") " pod="openshift-multus/multus-additional-cni-plugins-nx4tc" Aug 05 17:12:31.399191 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.397231 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/97da412c-62d1-470d-a056-aeac249c73f7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nx4tc\" (UID: \"97da412c-62d1-470d-a056-aeac249c73f7\") " pod="openshift-multus/multus-additional-cni-plugins-nx4tc" Aug 05 17:12:31.399191 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.397501 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/13196e32-1d2a-474f-9055-6dd74b3d5b86-konnectivity-ca\") pod \"konnectivity-agent-bbhd8\" (UID: \"13196e32-1d2a-474f-9055-6dd74b3d5b86\") " pod="kube-system/konnectivity-agent-bbhd8" Aug 05 17:12:31.399754 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.399182 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/13196e32-1d2a-474f-9055-6dd74b3d5b86-agent-certs\") pod \"konnectivity-agent-bbhd8\" (UID: \"13196e32-1d2a-474f-9055-6dd74b3d5b86\") " pod="kube-system/konnectivity-agent-bbhd8" Aug 05 17:12:31.399754 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.399380 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c85c5ba1-cee1-4308-a12c-8ab17a41b118-ovn-node-metrics-cert\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.402520 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:31.402487 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 17:12:31.402520 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:31.402514 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 17:12:31.402725 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:31.402529 2562 projected.go:196] Error preparing data for projected volume kube-api-access-78485 for pod openshift-network-diagnostics/network-check-target-rw5vc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:31.402725 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:31.402604 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e25eb68-7896-4157-a857-0c72022fc3ff-kube-api-access-78485 podName:8e25eb68-7896-4157-a857-0c72022fc3ff nodeName:}" failed. No retries permitted until 2026-08-05 17:12:31.902586594 +0000 UTC m=+3.075110487 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-78485" (UniqueName: "kubernetes.io/projected/8e25eb68-7896-4157-a857-0c72022fc3ff-kube-api-access-78485") pod "network-check-target-rw5vc" (UID: "8e25eb68-7896-4157-a857-0c72022fc3ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:31.405075 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.405048 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlfrg\" (UniqueName: \"kubernetes.io/projected/97da412c-62d1-470d-a056-aeac249c73f7-kube-api-access-hlfrg\") pod \"multus-additional-cni-plugins-nx4tc\" (UID: \"97da412c-62d1-470d-a056-aeac249c73f7\") " pod="openshift-multus/multus-additional-cni-plugins-nx4tc" Aug 05 17:12:31.405323 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.405297 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdvnh\" (UniqueName: \"kubernetes.io/projected/71a8ffdb-65f6-4e21-9ebf-a37111978c48-kube-api-access-wdvnh\") pod \"node-resolver-x92vq\" (UID: \"71a8ffdb-65f6-4e21-9ebf-a37111978c48\") " pod="openshift-dns/node-resolver-x92vq" Aug 05 17:12:31.406157 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.406131 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktf6t\" (UniqueName: \"kubernetes.io/projected/c85c5ba1-cee1-4308-a12c-8ab17a41b118-kube-api-access-ktf6t\") pod \"ovnkube-node-lxfxq\" (UID: \"c85c5ba1-cee1-4308-a12c-8ab17a41b118\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.406681 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.406632 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f8ft\" (UniqueName: \"kubernetes.io/projected/7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89-kube-api-access-9f8ft\") pod \"aws-ebs-csi-driver-node-26f2c\" (UID: \"7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-26f2c" Aug 05 17:12:31.407050 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.407028 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnj7v\" (UniqueName: \"kubernetes.io/projected/cca3acc3-94b8-4f10-8804-719ac52f1537-kube-api-access-bnj7v\") pod \"multus-qzp8m\" (UID: \"cca3acc3-94b8-4f10-8804-719ac52f1537\") " pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.440366 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.440243 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-104.ec2.internal" event={"ID":"0acbb7bf884d892b9a77e039f147c1de","Type":"ContainerStarted","Data":"a15e81bff1118e6e1732e6318c9f774e470bb042577d986b3f53ba1b40b07d86"} Aug 05 17:12:31.442246 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.442187 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-104.ec2.internal" event={"ID":"1796cf7b895d78ea0c300a45d5e0584b","Type":"ContainerStarted","Data":"c2680a39f076dd1a8904e4d3695b29068b348f02d466e6ffd2660b669471f4d8"} Aug 05 17:12:31.484642 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.484615 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-64bcn" Aug 05 17:12:31.489851 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.489807 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" Aug 05 17:12:31.495811 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:31.495782 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4596021_3f10_4dcb_812c_5d9cdcfa8373.slice/crio-60ee3a0c1f42db0ea02b8d43cca0ceac3c15119fd82b01755b87143d9348c831 WatchSource:0}: Error finding container 60ee3a0c1f42db0ea02b8d43cca0ceac3c15119fd82b01755b87143d9348c831: Status 404 returned error can't find the container with id 60ee3a0c1f42db0ea02b8d43cca0ceac3c15119fd82b01755b87143d9348c831 Aug 05 17:12:31.496988 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.496808 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hm4pp" Aug 05 17:12:31.501152 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.500980 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qzp8m" Aug 05 17:12:31.501245 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:31.501178 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefe99302_9b6f_4f5b_9fd4_9327d511cd6e.slice/crio-7c6a10ff8fb0a99212077feaae94ec87261cf873e99d6d6869e0e511df8e574c WatchSource:0}: Error finding container 7c6a10ff8fb0a99212077feaae94ec87261cf873e99d6d6869e0e511df8e574c: Status 404 returned error can't find the container with id 7c6a10ff8fb0a99212077feaae94ec87261cf873e99d6d6869e0e511df8e574c Aug 05 17:12:31.507005 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.506969 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bbhd8" Aug 05 17:12:31.511214 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:31.510701 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod202de948_1d6f_4d03_a580_2e38f89164a1.slice/crio-6edc9646e383dd8f4c409b31ef65797b1d64212ef866491df2b609da7f92f923 WatchSource:0}: Error finding container 6edc9646e383dd8f4c409b31ef65797b1d64212ef866491df2b609da7f92f923: Status 404 returned error can't find the container with id 6edc9646e383dd8f4c409b31ef65797b1d64212ef866491df2b609da7f92f923 Aug 05 17:12:31.512099 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:31.512076 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcca3acc3_94b8_4f10_8804_719ac52f1537.slice/crio-7e9abb4db9f24b947d9818f90e2dd52d94010b8a805daf37efbcd1f8ae5bb161 WatchSource:0}: Error finding container 7e9abb4db9f24b947d9818f90e2dd52d94010b8a805daf37efbcd1f8ae5bb161: Status 404 returned error can't find the container with id 7e9abb4db9f24b947d9818f90e2dd52d94010b8a805daf37efbcd1f8ae5bb161 Aug 05 17:12:31.512921 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.512907 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-26f2c" Aug 05 17:12:31.518249 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.518229 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nx4tc" Aug 05 17:12:31.518810 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:31.518786 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13196e32_1d2a_474f_9055_6dd74b3d5b86.slice/crio-99fa1e9258b65ccdad73bee089e449a61d0d4a6dceff899fbcb58da3533d7fc8 WatchSource:0}: Error finding container 99fa1e9258b65ccdad73bee089e449a61d0d4a6dceff899fbcb58da3533d7fc8: Status 404 returned error can't find the container with id 99fa1e9258b65ccdad73bee089e449a61d0d4a6dceff899fbcb58da3533d7fc8 Aug 05 17:12:31.523574 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.523557 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:31.528155 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.528133 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x92vq" Aug 05 17:12:31.528576 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:31.528553 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97da412c_62d1_470d_a056_aeac249c73f7.slice/crio-893fc44f6b1303d6b300dc58483b58427c9156881f8117671742d1f041a75013 WatchSource:0}: Error finding container 893fc44f6b1303d6b300dc58483b58427c9156881f8117671742d1f041a75013: Status 404 returned error can't find the container with id 893fc44f6b1303d6b300dc58483b58427c9156881f8117671742d1f041a75013 Aug 05 17:12:31.536805 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:31.536770 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc85c5ba1_cee1_4308_a12c_8ab17a41b118.slice/crio-9f6831f29686bd9d90d9dd1a83ae4fddaa9a5bd352d2193acb4348dbe38a46f5 WatchSource:0}: Error finding container 9f6831f29686bd9d90d9dd1a83ae4fddaa9a5bd352d2193acb4348dbe38a46f5: Status 404 returned error can't find the container with id 9f6831f29686bd9d90d9dd1a83ae4fddaa9a5bd352d2193acb4348dbe38a46f5 Aug 05 17:12:31.544381 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:12:31.544355 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71a8ffdb_65f6_4e21_9ebf_a37111978c48.slice/crio-999d9b0064251f1425f764864894c9cf9444144e9701dce6f4e3eeacc8449e6a WatchSource:0}: Error finding container 999d9b0064251f1425f764864894c9cf9444144e9701dce6f4e3eeacc8449e6a: Status 404 returned error can't find the container with id 999d9b0064251f1425f764864894c9cf9444144e9701dce6f4e3eeacc8449e6a Aug 05 17:12:31.545038 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.545013 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 17:12:31.800084 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.799987 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4618f8d9-07bc-4de7-9c7c-b09d7fe9d923-metrics-certs\") pod \"network-metrics-daemon-smhw9\" (UID: \"4618f8d9-07bc-4de7-9c7c-b09d7fe9d923\") " pod="openshift-multus/network-metrics-daemon-smhw9" Aug 05 17:12:31.800084 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:31.800043 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e046e80-1c3a-4186-9ba4-0c393f1a9d0e-original-pull-secret\") pod \"global-pull-secret-syncer-m67dg\" (UID: \"4e046e80-1c3a-4186-9ba4-0c393f1a9d0e\") " pod="kube-system/global-pull-secret-syncer-m67dg" Aug 05 17:12:31.800312 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:31.800157 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:31.800312 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:31.800162 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:31.800312 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:31.800222 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e046e80-1c3a-4186-9ba4-0c393f1a9d0e-original-pull-secret podName:4e046e80-1c3a-4186-9ba4-0c393f1a9d0e nodeName:}" failed. No retries permitted until 2026-08-05 17:12:32.800204678 +0000 UTC m=+3.972728579 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e046e80-1c3a-4186-9ba4-0c393f1a9d0e-original-pull-secret") pod "global-pull-secret-syncer-m67dg" (UID: "4e046e80-1c3a-4186-9ba4-0c393f1a9d0e") : object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:31.800312 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:31.800241 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4618f8d9-07bc-4de7-9c7c-b09d7fe9d923-metrics-certs podName:4618f8d9-07bc-4de7-9c7c-b09d7fe9d923 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:32.800232248 +0000 UTC m=+3.972756143 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4618f8d9-07bc-4de7-9c7c-b09d7fe9d923-metrics-certs") pod "network-metrics-daemon-smhw9" (UID: "4618f8d9-07bc-4de7-9c7c-b09d7fe9d923") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:32.001682 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:32.001635 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78485\" (UniqueName: \"kubernetes.io/projected/8e25eb68-7896-4157-a857-0c72022fc3ff-kube-api-access-78485\") pod \"network-check-target-rw5vc\" (UID: \"8e25eb68-7896-4157-a857-0c72022fc3ff\") " pod="openshift-network-diagnostics/network-check-target-rw5vc" Aug 05 17:12:32.001855 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:32.001808 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 17:12:32.001855 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:32.001832 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 17:12:32.001855 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:32.001843 2562 projected.go:196] Error preparing data for projected volume kube-api-access-78485 for pod openshift-network-diagnostics/network-check-target-rw5vc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:32.001963 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:32.001903 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e25eb68-7896-4157-a857-0c72022fc3ff-kube-api-access-78485 podName:8e25eb68-7896-4157-a857-0c72022fc3ff nodeName:}" failed. No retries permitted until 2026-08-05 17:12:33.00188379 +0000 UTC m=+4.174407683 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-78485" (UniqueName: "kubernetes.io/projected/8e25eb68-7896-4157-a857-0c72022fc3ff-kube-api-access-78485") pod "network-check-target-rw5vc" (UID: "8e25eb68-7896-4157-a857-0c72022fc3ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:32.224819 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:32.224682 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-04 17:07:31 +0000 UTC" deadline="2028-01-18 17:42:51.510957584 +0000 UTC" Aug 05 17:12:32.224819 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:32.224759 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12744h30m19.286201556s" Aug 05 17:12:32.435882 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:32.435851 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67dg" Aug 05 17:12:32.436047 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:32.435858 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rw5vc" Aug 05 17:12:32.436047 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:32.435996 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smhw9" Aug 05 17:12:32.436047 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:32.435987 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67dg" podUID="4e046e80-1c3a-4186-9ba4-0c393f1a9d0e" Aug 05 17:12:32.436207 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:32.436114 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rw5vc" podUID="8e25eb68-7896-4157-a857-0c72022fc3ff" Aug 05 17:12:32.436260 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:32.436200 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smhw9" podUID="4618f8d9-07bc-4de7-9c7c-b09d7fe9d923" Aug 05 17:12:32.446863 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:32.446831 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qzp8m" event={"ID":"cca3acc3-94b8-4f10-8804-719ac52f1537","Type":"ContainerStarted","Data":"7e9abb4db9f24b947d9818f90e2dd52d94010b8a805daf37efbcd1f8ae5bb161"} Aug 05 17:12:32.448286 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:32.448259 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" event={"ID":"efe99302-9b6f-4f5b-9fd4-9327d511cd6e","Type":"ContainerStarted","Data":"7c6a10ff8fb0a99212077feaae94ec87261cf873e99d6d6869e0e511df8e574c"} Aug 05 17:12:32.450345 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:32.450302 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-64bcn" event={"ID":"f4596021-3f10-4dcb-812c-5d9cdcfa8373","Type":"ContainerStarted","Data":"60ee3a0c1f42db0ea02b8d43cca0ceac3c15119fd82b01755b87143d9348c831"} Aug 05 17:12:32.451615 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:32.451590 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x92vq" event={"ID":"71a8ffdb-65f6-4e21-9ebf-a37111978c48","Type":"ContainerStarted","Data":"999d9b0064251f1425f764864894c9cf9444144e9701dce6f4e3eeacc8449e6a"} Aug 05 17:12:32.454013 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:32.453990 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" event={"ID":"c85c5ba1-cee1-4308-a12c-8ab17a41b118","Type":"ContainerStarted","Data":"9f6831f29686bd9d90d9dd1a83ae4fddaa9a5bd352d2193acb4348dbe38a46f5"} Aug 05 17:12:32.455240 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:32.455215 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nx4tc" event={"ID":"97da412c-62d1-470d-a056-aeac249c73f7","Type":"ContainerStarted","Data":"893fc44f6b1303d6b300dc58483b58427c9156881f8117671742d1f041a75013"} Aug 05 17:12:32.456840 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:32.456816 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-26f2c" event={"ID":"7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89","Type":"ContainerStarted","Data":"cf3df38980492c0c3d25f9710fb2298c0bb1e14bf5d5537952b5e43a10b3af24"} Aug 05 17:12:32.458131 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:32.458103 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bbhd8" event={"ID":"13196e32-1d2a-474f-9055-6dd74b3d5b86","Type":"ContainerStarted","Data":"99fa1e9258b65ccdad73bee089e449a61d0d4a6dceff899fbcb58da3533d7fc8"} Aug 05 17:12:32.459346 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:32.459313 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hm4pp" event={"ID":"202de948-1d6f-4d03-a580-2e38f89164a1","Type":"ContainerStarted","Data":"6edc9646e383dd8f4c409b31ef65797b1d64212ef866491df2b609da7f92f923"} Aug 05 17:12:32.810110 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:32.810077 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4618f8d9-07bc-4de7-9c7c-b09d7fe9d923-metrics-certs\") pod \"network-metrics-daemon-smhw9\" (UID: \"4618f8d9-07bc-4de7-9c7c-b09d7fe9d923\") " pod="openshift-multus/network-metrics-daemon-smhw9" Aug 05 17:12:32.810300 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:32.810127 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e046e80-1c3a-4186-9ba4-0c393f1a9d0e-original-pull-secret\") pod \"global-pull-secret-syncer-m67dg\" (UID: \"4e046e80-1c3a-4186-9ba4-0c393f1a9d0e\") " pod="kube-system/global-pull-secret-syncer-m67dg" Aug 05 17:12:32.810300 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:32.810287 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:32.810427 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:32.810365 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4618f8d9-07bc-4de7-9c7c-b09d7fe9d923-metrics-certs podName:4618f8d9-07bc-4de7-9c7c-b09d7fe9d923 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:34.810330328 +0000 UTC m=+5.982854232 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4618f8d9-07bc-4de7-9c7c-b09d7fe9d923-metrics-certs") pod "network-metrics-daemon-smhw9" (UID: "4618f8d9-07bc-4de7-9c7c-b09d7fe9d923") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:32.810702 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:32.810287 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:32.810788 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:32.810745 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e046e80-1c3a-4186-9ba4-0c393f1a9d0e-original-pull-secret podName:4e046e80-1c3a-4186-9ba4-0c393f1a9d0e nodeName:}" failed. No retries permitted until 2026-08-05 17:12:34.810727091 +0000 UTC m=+5.983251003 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e046e80-1c3a-4186-9ba4-0c393f1a9d0e-original-pull-secret") pod "global-pull-secret-syncer-m67dg" (UID: "4e046e80-1c3a-4186-9ba4-0c393f1a9d0e") : object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:33.018416 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:33.018144 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78485\" (UniqueName: \"kubernetes.io/projected/8e25eb68-7896-4157-a857-0c72022fc3ff-kube-api-access-78485\") pod \"network-check-target-rw5vc\" (UID: \"8e25eb68-7896-4157-a857-0c72022fc3ff\") " pod="openshift-network-diagnostics/network-check-target-rw5vc" Aug 05 17:12:33.018577 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:33.018566 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 17:12:33.018636 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:33.018590 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 17:12:33.018636 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:33.018603 2562 projected.go:196] Error preparing data for projected volume kube-api-access-78485 for pod openshift-network-diagnostics/network-check-target-rw5vc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:33.018761 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:33.018666 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e25eb68-7896-4157-a857-0c72022fc3ff-kube-api-access-78485 podName:8e25eb68-7896-4157-a857-0c72022fc3ff nodeName:}" failed. No retries permitted until 2026-08-05 17:12:35.018640711 +0000 UTC m=+6.191164606 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-78485" (UniqueName: "kubernetes.io/projected/8e25eb68-7896-4157-a857-0c72022fc3ff-kube-api-access-78485") pod "network-check-target-rw5vc" (UID: "8e25eb68-7896-4157-a857-0c72022fc3ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:33.225482 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:33.225370 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-04 17:07:31 +0000 UTC" deadline="2028-02-26 05:22:06.634655936 +0000 UTC" Aug 05 17:12:33.225482 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:33.225410 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13668h9m33.409250445s" Aug 05 17:12:33.486970 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:33.486884 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-104.ec2.internal" event={"ID":"0acbb7bf884d892b9a77e039f147c1de","Type":"ContainerStarted","Data":"2e8d7cd63a74c799155fad00de8d7fecc89ae65d7ba3849bab10839518b17408"} Aug 05 17:12:34.435956 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:34.435828 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smhw9" Aug 05 17:12:34.436417 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:34.435985 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smhw9" podUID="4618f8d9-07bc-4de7-9c7c-b09d7fe9d923" Aug 05 17:12:34.436417 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:34.436312 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rw5vc" Aug 05 17:12:34.436565 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:34.436421 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rw5vc" podUID="8e25eb68-7896-4157-a857-0c72022fc3ff" Aug 05 17:12:34.436565 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:34.436462 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67dg" Aug 05 17:12:34.436565 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:34.436526 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67dg" podUID="4e046e80-1c3a-4186-9ba4-0c393f1a9d0e" Aug 05 17:12:34.513709 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:34.513670 2562 generic.go:356] "Generic (PLEG): container finished" podID="1796cf7b895d78ea0c300a45d5e0584b" containerID="bb3a7b2ae47c3a9aae9a77fcb2304027458c79eee96fe3454ff741b5ea85a73f" exitCode=0 Aug 05 17:12:34.514689 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:34.514662 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-104.ec2.internal" event={"ID":"1796cf7b895d78ea0c300a45d5e0584b","Type":"ContainerDied","Data":"bb3a7b2ae47c3a9aae9a77fcb2304027458c79eee96fe3454ff741b5ea85a73f"} Aug 05 17:12:34.529785 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:34.528718 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-104.ec2.internal" podStartSLOduration=4.52869552 podStartE2EDuration="4.52869552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:33.500578789 +0000 UTC m=+4.673102701" watchObservedRunningTime="2026-08-05 17:12:34.52869552 +0000 UTC m=+5.701219431" Aug 05 17:12:34.834588 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:34.834502 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4618f8d9-07bc-4de7-9c7c-b09d7fe9d923-metrics-certs\") pod \"network-metrics-daemon-smhw9\" (UID: \"4618f8d9-07bc-4de7-9c7c-b09d7fe9d923\") " pod="openshift-multus/network-metrics-daemon-smhw9" Aug 05 17:12:34.834588 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:34.834563 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e046e80-1c3a-4186-9ba4-0c393f1a9d0e-original-pull-secret\") pod \"global-pull-secret-syncer-m67dg\" (UID: \"4e046e80-1c3a-4186-9ba4-0c393f1a9d0e\") " pod="kube-system/global-pull-secret-syncer-m67dg" Aug 05 17:12:34.834812 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:34.834729 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:34.834812 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:34.834790 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e046e80-1c3a-4186-9ba4-0c393f1a9d0e-original-pull-secret podName:4e046e80-1c3a-4186-9ba4-0c393f1a9d0e nodeName:}" failed. No retries permitted until 2026-08-05 17:12:38.834771538 +0000 UTC m=+10.007295433 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e046e80-1c3a-4186-9ba4-0c393f1a9d0e-original-pull-secret") pod "global-pull-secret-syncer-m67dg" (UID: "4e046e80-1c3a-4186-9ba4-0c393f1a9d0e") : object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:34.835191 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:34.835172 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:34.835284 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:34.835224 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4618f8d9-07bc-4de7-9c7c-b09d7fe9d923-metrics-certs podName:4618f8d9-07bc-4de7-9c7c-b09d7fe9d923 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:38.835208879 +0000 UTC m=+10.007732782 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4618f8d9-07bc-4de7-9c7c-b09d7fe9d923-metrics-certs") pod "network-metrics-daemon-smhw9" (UID: "4618f8d9-07bc-4de7-9c7c-b09d7fe9d923") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:35.036132 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:35.036092 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78485\" (UniqueName: \"kubernetes.io/projected/8e25eb68-7896-4157-a857-0c72022fc3ff-kube-api-access-78485\") pod \"network-check-target-rw5vc\" (UID: \"8e25eb68-7896-4157-a857-0c72022fc3ff\") " pod="openshift-network-diagnostics/network-check-target-rw5vc" Aug 05 17:12:35.036300 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:35.036285 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 17:12:35.036374 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:35.036305 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 17:12:35.036374 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:35.036318 2562 projected.go:196] Error preparing data for projected volume kube-api-access-78485 for pod openshift-network-diagnostics/network-check-target-rw5vc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:35.036488 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:35.036403 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e25eb68-7896-4157-a857-0c72022fc3ff-kube-api-access-78485 podName:8e25eb68-7896-4157-a857-0c72022fc3ff nodeName:}" failed. No retries permitted until 2026-08-05 17:12:39.036383783 +0000 UTC m=+10.208907676 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-78485" (UniqueName: "kubernetes.io/projected/8e25eb68-7896-4157-a857-0c72022fc3ff-kube-api-access-78485") pod "network-check-target-rw5vc" (UID: "8e25eb68-7896-4157-a857-0c72022fc3ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:36.435864 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:36.435396 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rw5vc" Aug 05 17:12:36.435864 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:36.435443 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67dg" Aug 05 17:12:36.435864 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:36.435522 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rw5vc" podUID="8e25eb68-7896-4157-a857-0c72022fc3ff" Aug 05 17:12:36.435864 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:36.435642 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67dg" podUID="4e046e80-1c3a-4186-9ba4-0c393f1a9d0e" Aug 05 17:12:36.435864 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:36.435699 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smhw9" Aug 05 17:12:36.435864 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:36.435799 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smhw9" podUID="4618f8d9-07bc-4de7-9c7c-b09d7fe9d923" Aug 05 17:12:38.435945 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:38.435911 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rw5vc" Aug 05 17:12:38.435945 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:38.435919 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67dg" Aug 05 17:12:38.436447 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:38.435923 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smhw9" Aug 05 17:12:38.436447 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:38.436055 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rw5vc" podUID="8e25eb68-7896-4157-a857-0c72022fc3ff" Aug 05 17:12:38.436447 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:38.436150 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67dg" podUID="4e046e80-1c3a-4186-9ba4-0c393f1a9d0e" Aug 05 17:12:38.436447 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:38.436308 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smhw9" podUID="4618f8d9-07bc-4de7-9c7c-b09d7fe9d923" Aug 05 17:12:38.870669 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:38.870628 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e046e80-1c3a-4186-9ba4-0c393f1a9d0e-original-pull-secret\") pod \"global-pull-secret-syncer-m67dg\" (UID: \"4e046e80-1c3a-4186-9ba4-0c393f1a9d0e\") " pod="kube-system/global-pull-secret-syncer-m67dg" Aug 05 17:12:38.870849 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:38.870740 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4618f8d9-07bc-4de7-9c7c-b09d7fe9d923-metrics-certs\") pod \"network-metrics-daemon-smhw9\" (UID: \"4618f8d9-07bc-4de7-9c7c-b09d7fe9d923\") " pod="openshift-multus/network-metrics-daemon-smhw9" Aug 05 17:12:38.870930 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:38.870862 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:38.870930 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:38.870927 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4618f8d9-07bc-4de7-9c7c-b09d7fe9d923-metrics-certs podName:4618f8d9-07bc-4de7-9c7c-b09d7fe9d923 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:46.870906503 +0000 UTC m=+18.043430395 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4618f8d9-07bc-4de7-9c7c-b09d7fe9d923-metrics-certs") pod "network-metrics-daemon-smhw9" (UID: "4618f8d9-07bc-4de7-9c7c-b09d7fe9d923") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:38.871247 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:38.871155 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:38.871247 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:38.871216 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e046e80-1c3a-4186-9ba4-0c393f1a9d0e-original-pull-secret podName:4e046e80-1c3a-4186-9ba4-0c393f1a9d0e nodeName:}" failed. No retries permitted until 2026-08-05 17:12:46.871200475 +0000 UTC m=+18.043724377 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e046e80-1c3a-4186-9ba4-0c393f1a9d0e-original-pull-secret") pod "global-pull-secret-syncer-m67dg" (UID: "4e046e80-1c3a-4186-9ba4-0c393f1a9d0e") : object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:39.072908 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:39.072864 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78485\" (UniqueName: \"kubernetes.io/projected/8e25eb68-7896-4157-a857-0c72022fc3ff-kube-api-access-78485\") pod \"network-check-target-rw5vc\" (UID: \"8e25eb68-7896-4157-a857-0c72022fc3ff\") " pod="openshift-network-diagnostics/network-check-target-rw5vc" Aug 05 17:12:39.073120 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:39.073021 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 17:12:39.073120 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:39.073048 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 17:12:39.073120 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:39.073062 2562 projected.go:196] Error preparing data for projected volume kube-api-access-78485 for pod openshift-network-diagnostics/network-check-target-rw5vc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:39.073302 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:39.073122 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e25eb68-7896-4157-a857-0c72022fc3ff-kube-api-access-78485 podName:8e25eb68-7896-4157-a857-0c72022fc3ff nodeName:}" failed. No retries permitted until 2026-08-05 17:12:47.073102587 +0000 UTC m=+18.245626480 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-78485" (UniqueName: "kubernetes.io/projected/8e25eb68-7896-4157-a857-0c72022fc3ff-kube-api-access-78485") pod "network-check-target-rw5vc" (UID: "8e25eb68-7896-4157-a857-0c72022fc3ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:40.435694 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:40.435538 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rw5vc" Aug 05 17:12:40.435694 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:40.435557 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smhw9" Aug 05 17:12:40.435694 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:40.435675 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rw5vc" podUID="8e25eb68-7896-4157-a857-0c72022fc3ff" Aug 05 17:12:40.436251 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:40.435724 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67dg" Aug 05 17:12:40.436251 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:40.435829 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smhw9" podUID="4618f8d9-07bc-4de7-9c7c-b09d7fe9d923" Aug 05 17:12:40.436251 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:40.435908 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67dg" podUID="4e046e80-1c3a-4186-9ba4-0c393f1a9d0e" Aug 05 17:12:42.435936 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:42.435899 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smhw9" Aug 05 17:12:42.435936 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:42.435927 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rw5vc" Aug 05 17:12:42.436376 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:42.435902 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67dg" Aug 05 17:12:42.436376 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:42.436028 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smhw9" podUID="4618f8d9-07bc-4de7-9c7c-b09d7fe9d923" Aug 05 17:12:42.436376 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:42.436150 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67dg" podUID="4e046e80-1c3a-4186-9ba4-0c393f1a9d0e" Aug 05 17:12:42.436376 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:42.436215 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rw5vc" podUID="8e25eb68-7896-4157-a857-0c72022fc3ff" Aug 05 17:12:44.435474 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:44.435438 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rw5vc" Aug 05 17:12:44.435955 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:44.435543 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smhw9" Aug 05 17:12:44.435955 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:44.435557 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67dg" Aug 05 17:12:44.435955 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:44.435552 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rw5vc" podUID="8e25eb68-7896-4157-a857-0c72022fc3ff" Aug 05 17:12:44.435955 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:44.435680 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smhw9" podUID="4618f8d9-07bc-4de7-9c7c-b09d7fe9d923" Aug 05 17:12:44.435955 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:44.435769 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67dg" podUID="4e046e80-1c3a-4186-9ba4-0c393f1a9d0e" Aug 05 17:12:46.435934 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:46.435847 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rw5vc" Aug 05 17:12:46.435934 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:46.435879 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smhw9" Aug 05 17:12:46.436514 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:46.435847 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67dg" Aug 05 17:12:46.436514 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:46.435972 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rw5vc" podUID="8e25eb68-7896-4157-a857-0c72022fc3ff" Aug 05 17:12:46.436514 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:46.436062 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67dg" podUID="4e046e80-1c3a-4186-9ba4-0c393f1a9d0e" Aug 05 17:12:46.436514 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:46.436138 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smhw9" podUID="4618f8d9-07bc-4de7-9c7c-b09d7fe9d923" Aug 05 17:12:46.933752 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:46.933661 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4618f8d9-07bc-4de7-9c7c-b09d7fe9d923-metrics-certs\") pod \"network-metrics-daemon-smhw9\" (UID: \"4618f8d9-07bc-4de7-9c7c-b09d7fe9d923\") " pod="openshift-multus/network-metrics-daemon-smhw9" Aug 05 17:12:46.933752 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:46.933716 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e046e80-1c3a-4186-9ba4-0c393f1a9d0e-original-pull-secret\") pod \"global-pull-secret-syncer-m67dg\" (UID: \"4e046e80-1c3a-4186-9ba4-0c393f1a9d0e\") " pod="kube-system/global-pull-secret-syncer-m67dg" Aug 05 17:12:46.933970 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:46.933827 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:46.933970 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:46.933909 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4618f8d9-07bc-4de7-9c7c-b09d7fe9d923-metrics-certs podName:4618f8d9-07bc-4de7-9c7c-b09d7fe9d923 nodeName:}" failed. No retries permitted until 2026-08-05 17:13:02.93388986 +0000 UTC m=+34.106413773 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4618f8d9-07bc-4de7-9c7c-b09d7fe9d923-metrics-certs") pod "network-metrics-daemon-smhw9" (UID: "4618f8d9-07bc-4de7-9c7c-b09d7fe9d923") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:46.933970 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:46.933833 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:46.934100 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:46.933977 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e046e80-1c3a-4186-9ba4-0c393f1a9d0e-original-pull-secret podName:4e046e80-1c3a-4186-9ba4-0c393f1a9d0e nodeName:}" failed. No retries permitted until 2026-08-05 17:13:02.933964991 +0000 UTC m=+34.106488888 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e046e80-1c3a-4186-9ba4-0c393f1a9d0e-original-pull-secret") pod "global-pull-secret-syncer-m67dg" (UID: "4e046e80-1c3a-4186-9ba4-0c393f1a9d0e") : object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:47.134616 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:47.134575 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78485\" (UniqueName: \"kubernetes.io/projected/8e25eb68-7896-4157-a857-0c72022fc3ff-kube-api-access-78485\") pod \"network-check-target-rw5vc\" (UID: \"8e25eb68-7896-4157-a857-0c72022fc3ff\") " pod="openshift-network-diagnostics/network-check-target-rw5vc" Aug 05 17:12:47.134804 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:47.134724 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 17:12:47.134804 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:47.134754 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 17:12:47.134804 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:47.134767 2562 projected.go:196] Error preparing data for projected volume kube-api-access-78485 for pod openshift-network-diagnostics/network-check-target-rw5vc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:47.134936 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:47.134819 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e25eb68-7896-4157-a857-0c72022fc3ff-kube-api-access-78485 podName:8e25eb68-7896-4157-a857-0c72022fc3ff nodeName:}" failed. No retries permitted until 2026-08-05 17:13:03.134804888 +0000 UTC m=+34.307328778 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-78485" (UniqueName: "kubernetes.io/projected/8e25eb68-7896-4157-a857-0c72022fc3ff-kube-api-access-78485") pod "network-check-target-rw5vc" (UID: "8e25eb68-7896-4157-a857-0c72022fc3ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:48.435380 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:48.435330 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67dg" Aug 05 17:12:48.435912 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:48.435329 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rw5vc" Aug 05 17:12:48.435912 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:48.435460 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67dg" podUID="4e046e80-1c3a-4186-9ba4-0c393f1a9d0e" Aug 05 17:12:48.435912 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:48.435468 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smhw9" Aug 05 17:12:48.435912 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:48.435549 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rw5vc" podUID="8e25eb68-7896-4157-a857-0c72022fc3ff" Aug 05 17:12:48.435912 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:48.435630 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smhw9" podUID="4618f8d9-07bc-4de7-9c7c-b09d7fe9d923" Aug 05 17:12:50.435533 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:50.435495 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67dg" Aug 05 17:12:50.436019 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:50.435495 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smhw9" Aug 05 17:12:50.436019 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:50.435633 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67dg" podUID="4e046e80-1c3a-4186-9ba4-0c393f1a9d0e" Aug 05 17:12:50.436019 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:50.435495 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rw5vc" Aug 05 17:12:50.436019 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:50.435678 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smhw9" podUID="4618f8d9-07bc-4de7-9c7c-b09d7fe9d923" Aug 05 17:12:50.436019 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:50.435743 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rw5vc" podUID="8e25eb68-7896-4157-a857-0c72022fc3ff" Aug 05 17:12:51.551312 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:51.550942 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bbhd8" event={"ID":"13196e32-1d2a-474f-9055-6dd74b3d5b86","Type":"ContainerStarted","Data":"f0091d115c5b14779a8094097664fcfd312c2b7a54b948f659d15b95f9290a38"} Aug 05 17:12:51.553680 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:51.553395 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hm4pp" event={"ID":"202de948-1d6f-4d03-a580-2e38f89164a1","Type":"ContainerStarted","Data":"3e51ad8e305b664f9477b1fc67644c8174d97cd6f46f13c82edaf46fd01d284c"} Aug 05 17:12:51.555409 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:51.555378 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qzp8m" event={"ID":"cca3acc3-94b8-4f10-8804-719ac52f1537","Type":"ContainerStarted","Data":"066171e503f90a9e4e9536f8cb75d4498e22876167e55925933a768f7bfa7c15"} Aug 05 17:12:51.557625 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:51.557600 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" event={"ID":"efe99302-9b6f-4f5b-9fd4-9327d511cd6e","Type":"ContainerStarted","Data":"b6ac90e774e0ea311d4e4fb8ec517dcc7307f656b91b1d77cf4e0f1726713c26"} Aug 05 17:12:51.560246 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:51.560223 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-104.ec2.internal" event={"ID":"1796cf7b895d78ea0c300a45d5e0584b","Type":"ContainerStarted","Data":"5e8b0d3b3a87d6b446664cc8ce0b41b01daabb0f6bbbdaa9f3fd648b6280b715"} Aug 05 17:12:51.561957 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:51.561925 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x92vq" event={"ID":"71a8ffdb-65f6-4e21-9ebf-a37111978c48","Type":"ContainerStarted","Data":"c5ea40d2b470d9b8e3c2b3cde0f0c29cc9f84843fd0fc7fdddb22a85d51cee5c"} Aug 05 17:12:51.565236 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:51.565166 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" event={"ID":"c85c5ba1-cee1-4308-a12c-8ab17a41b118","Type":"ContainerStarted","Data":"e555fffa5f93b0625e3f28e53ddd93c95519180bfd05a4979ae9d39a51deb44d"} Aug 05 17:12:51.565348 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:51.565242 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" event={"ID":"c85c5ba1-cee1-4308-a12c-8ab17a41b118","Type":"ContainerStarted","Data":"a8d7739f8bb1b3e04f9e14431ff1fe457340976367917d7eeac2d1c7401afa42"} Aug 05 17:12:51.565348 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:51.565284 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" event={"ID":"c85c5ba1-cee1-4308-a12c-8ab17a41b118","Type":"ContainerStarted","Data":"0c25725905d643d01181a29a5187861c6d04fe16be87433a6ee54f76ad092032"} Aug 05 17:12:51.565348 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:51.565317 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" event={"ID":"c85c5ba1-cee1-4308-a12c-8ab17a41b118","Type":"ContainerStarted","Data":"bd05c18816b17099d1f8036ba0fca728090cab655aeae4abe0a1b70874ad7b28"} Aug 05 17:12:51.565489 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:51.565415 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" event={"ID":"c85c5ba1-cee1-4308-a12c-8ab17a41b118","Type":"ContainerStarted","Data":"77a4b59bf950b15c266a6a494d32ab77f5909a8a0261db441de66124d7b0a6e5"} Aug 05 17:12:51.565489 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:51.565449 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" event={"ID":"c85c5ba1-cee1-4308-a12c-8ab17a41b118","Type":"ContainerStarted","Data":"ebecfb4e497802a6fd01e19de9b1334463f2c986317e7cb1740437a3d4e47d26"} Aug 05 17:12:51.566954 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:51.566930 2562 generic.go:356] "Generic (PLEG): container finished" podID="97da412c-62d1-470d-a056-aeac249c73f7" containerID="7635ccc21027e8c1caeedd1d63f8ecd010388dd86a20dcc1f215631cd081b3c8" exitCode=0 Aug 05 17:12:51.567089 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:51.567001 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nx4tc" event={"ID":"97da412c-62d1-470d-a056-aeac249c73f7","Type":"ContainerDied","Data":"7635ccc21027e8c1caeedd1d63f8ecd010388dd86a20dcc1f215631cd081b3c8"} Aug 05 17:12:51.568590 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:51.567878 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bbhd8" podStartSLOduration=3.43468257 podStartE2EDuration="22.567861951s" totalImagesPullingTime="19.133179381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:12:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:51.567575132 +0000 UTC m=+22.740099036" watchObservedRunningTime="2026-08-05 17:12:51.567861951 +0000 UTC m=+22.740385863" Aug 05 17:12:51.569308 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:51.569285 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-26f2c" event={"ID":"7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89","Type":"ContainerStarted","Data":"03a17a5e11fdb8a9ec5b83c5c9500128337b72e3b3df3915ad3aa51deeb5e2cb"} Aug 05 17:12:51.586371 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:51.586312 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5hfnl" podStartSLOduration=3.432982887 podStartE2EDuration="22.586298714s" totalImagesPullingTime="19.153315827s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:51.586208535 +0000 UTC m=+22.758732443" watchObservedRunningTime="2026-08-05 17:12:51.586298714 +0000 UTC m=+22.758822624" Aug 05 17:12:51.603072 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:51.603026 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hm4pp" podStartSLOduration=3.4633962990000002 podStartE2EDuration="22.603012576s" totalImagesPullingTime="19.139616277s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:51.602311121 +0000 UTC m=+22.774835035" watchObservedRunningTime="2026-08-05 17:12:51.603012576 +0000 UTC m=+22.775536485" Aug 05 17:12:51.624303 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:51.624252 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qzp8m" podStartSLOduration=3.266757125 podStartE2EDuration="22.624237225s" totalImagesPullingTime="19.3574801s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:51.623151083 +0000 UTC m=+22.795674994" watchObservedRunningTime="2026-08-05 17:12:51.624237225 +0000 UTC m=+22.796761141" Aug 05 17:12:51.642524 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:51.642475 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-x92vq" podStartSLOduration=2.534560527 podStartE2EDuration="21.642461566s" totalImagesPullingTime="19.107901039s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:51.64197919 +0000 UTC m=+22.814503103" watchObservedRunningTime="2026-08-05 17:12:51.642461566 +0000 UTC m=+22.814985477" Aug 05 17:12:51.680160 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:51.680119 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-104.ec2.internal" podStartSLOduration=21.680105538 podStartE2EDuration="21.680105538s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:51.679722226 +0000 UTC m=+22.852246138" watchObservedRunningTime="2026-08-05 17:12:51.680105538 +0000 UTC m=+22.852629448" Aug 05 17:12:52.249554 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:52.249525 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Aug 05 17:12:52.433250 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:52.433082 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-05T17:12:52.249543721Z","UUID":"768b2858-5856-457b-bdfb-b3edd7269abe","Handler":null,"Name":"","Endpoint":""} Aug 05 17:12:52.435031 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:52.435003 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rw5vc" Aug 05 17:12:52.435031 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:52.435027 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67dg" Aug 05 17:12:52.435219 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:52.435125 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smhw9" Aug 05 17:12:52.435219 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:52.435149 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67dg" podUID="4e046e80-1c3a-4186-9ba4-0c393f1a9d0e" Aug 05 17:12:52.435322 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:52.435218 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smhw9" podUID="4618f8d9-07bc-4de7-9c7c-b09d7fe9d923" Aug 05 17:12:52.435322 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:52.435282 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rw5vc" podUID="8e25eb68-7896-4157-a857-0c72022fc3ff" Aug 05 17:12:52.435624 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:52.435565 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Aug 05 17:12:52.435624 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:52.435605 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Aug 05 17:12:52.573849 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:52.573810 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-26f2c" event={"ID":"7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89","Type":"ContainerStarted","Data":"8fa8530408f805692c3534846bc6dd21d091740dba5d058b9158c853f54c909f"} Aug 05 17:12:52.575560 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:52.575531 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-64bcn" event={"ID":"f4596021-3f10-4dcb-812c-5d9cdcfa8373","Type":"ContainerStarted","Data":"85a3a642970bb3daa1dbdc65363d0b45ac69a50733385cf5decc16b19238b228"} Aug 05 17:12:52.751841 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:52.751756 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bbhd8" Aug 05 17:12:54.435498 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:54.435462 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rw5vc" Aug 05 17:12:54.435498 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:54.435493 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smhw9" Aug 05 17:12:54.435967 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:54.435493 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67dg" Aug 05 17:12:54.435967 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:54.435585 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rw5vc" podUID="8e25eb68-7896-4157-a857-0c72022fc3ff" Aug 05 17:12:54.435967 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:54.435674 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smhw9" podUID="4618f8d9-07bc-4de7-9c7c-b09d7fe9d923" Aug 05 17:12:54.435967 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:54.435750 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67dg" podUID="4e046e80-1c3a-4186-9ba4-0c393f1a9d0e" Aug 05 17:12:54.582941 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:54.582900 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" event={"ID":"c85c5ba1-cee1-4308-a12c-8ab17a41b118","Type":"ContainerStarted","Data":"a8f91cbe34acadfe5bfe2d288775d9bcd43a4cd41c2ca8c8ef39d1bdef7fb752"} Aug 05 17:12:54.585094 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:54.585070 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-26f2c" event={"ID":"7ed6b52c-ec7c-4322-bd5b-e56dc09c0e89","Type":"ContainerStarted","Data":"41ce730d8813b04d0c6badd60a6df81b043824e83aab0445fc2fb9614b6bbd15"} Aug 05 17:12:54.606352 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:54.606289 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-26f2c" podStartSLOduration=4.120217514 podStartE2EDuration="25.606269632s" totalImagesPullingTime="21.486052118s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:54.606180669 +0000 UTC m=+25.778704579" watchObservedRunningTime="2026-08-05 17:12:54.606269632 +0000 UTC m=+25.778793542" Aug 05 17:12:54.606557 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:54.606535 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-64bcn" podStartSLOduration=10.946316428 podStartE2EDuration="25.606530698s" totalImagesPullingTime="14.66021427s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:52.601728197 +0000 UTC m=+23.774252109" watchObservedRunningTime="2026-08-05 17:12:54.606530698 +0000 UTC m=+25.779054660" Aug 05 17:12:55.141988 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:55.141958 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bbhd8" Aug 05 17:12:55.142595 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:55.142572 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bbhd8" Aug 05 17:12:55.588677 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:55.588419 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bbhd8" Aug 05 17:12:56.435406 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:56.435305 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smhw9" Aug 05 17:12:56.435406 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:56.435370 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67dg" Aug 05 17:12:56.435626 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:56.435315 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rw5vc" Aug 05 17:12:56.435626 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:56.435469 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smhw9" podUID="4618f8d9-07bc-4de7-9c7c-b09d7fe9d923" Aug 05 17:12:56.435626 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:56.435536 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rw5vc" podUID="8e25eb68-7896-4157-a857-0c72022fc3ff" Aug 05 17:12:56.435626 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:56.435576 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67dg" podUID="4e046e80-1c3a-4186-9ba4-0c393f1a9d0e" Aug 05 17:12:56.593141 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:56.593104 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" event={"ID":"c85c5ba1-cee1-4308-a12c-8ab17a41b118","Type":"ContainerStarted","Data":"215454a7b12cae183ee4d090d6ea5706c972b3c6f8f15decebc942a81416e7b2"} Aug 05 17:12:56.594060 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:56.593447 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:56.595030 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:56.595001 2562 generic.go:356] "Generic (PLEG): container finished" podID="97da412c-62d1-470d-a056-aeac249c73f7" containerID="55c399bb9265456cfd70a0014acaf21dedf59be99bbcbf1de3cb8a0ff723a8f5" exitCode=0 Aug 05 17:12:56.595158 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:56.595079 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nx4tc" event={"ID":"97da412c-62d1-470d-a056-aeac249c73f7","Type":"ContainerDied","Data":"55c399bb9265456cfd70a0014acaf21dedf59be99bbcbf1de3cb8a0ff723a8f5"} Aug 05 17:12:56.609091 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:56.609073 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:56.623326 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:56.623281 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" podStartSLOduration=8.455873026999999 podStartE2EDuration="27.623267971s" totalImagesPullingTime="19.167394944s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:56.622698882 +0000 UTC m=+27.795222795" watchObservedRunningTime="2026-08-05 17:12:56.623267971 +0000 UTC m=+27.795791881" Aug 05 17:12:57.598292 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:57.598087 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:57.598747 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:57.598346 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:57.612708 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:57.612684 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:12:58.044708 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:58.044679 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-m67dg"] Aug 05 17:12:58.044840 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:58.044780 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67dg" Aug 05 17:12:58.044893 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:58.044864 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67dg" podUID="4e046e80-1c3a-4186-9ba4-0c393f1a9d0e" Aug 05 17:12:58.045201 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:58.045182 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-smhw9"] Aug 05 17:12:58.045281 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:58.045271 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smhw9" Aug 05 17:12:58.045384 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:58.045369 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smhw9" podUID="4618f8d9-07bc-4de7-9c7c-b09d7fe9d923" Aug 05 17:12:58.047038 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:58.047016 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rw5vc"] Aug 05 17:12:58.047129 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:58.047114 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rw5vc" Aug 05 17:12:58.047220 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:58.047200 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rw5vc" podUID="8e25eb68-7896-4157-a857-0c72022fc3ff" Aug 05 17:12:58.602079 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:58.602043 2562 generic.go:356] "Generic (PLEG): container finished" podID="97da412c-62d1-470d-a056-aeac249c73f7" containerID="e6d414e8a4121b83cd48ed83455ee2d73a38d757607555ea3ce8359c4558d169" exitCode=0 Aug 05 17:12:58.602451 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:58.602103 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nx4tc" event={"ID":"97da412c-62d1-470d-a056-aeac249c73f7","Type":"ContainerDied","Data":"e6d414e8a4121b83cd48ed83455ee2d73a38d757607555ea3ce8359c4558d169"} Aug 05 17:12:59.436510 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:59.436485 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67dg" Aug 05 17:12:59.436662 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:59.436565 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67dg" podUID="4e046e80-1c3a-4186-9ba4-0c393f1a9d0e" Aug 05 17:12:59.436710 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:59.436657 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smhw9" Aug 05 17:12:59.436784 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:59.436764 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smhw9" podUID="4618f8d9-07bc-4de7-9c7c-b09d7fe9d923" Aug 05 17:12:59.436829 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:59.436796 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rw5vc" Aug 05 17:12:59.436859 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:12:59.436850 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rw5vc" podUID="8e25eb68-7896-4157-a857-0c72022fc3ff" Aug 05 17:12:59.606941 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:59.606624 2562 generic.go:356] "Generic (PLEG): container finished" podID="97da412c-62d1-470d-a056-aeac249c73f7" containerID="7a91159c113e5b049302c7a97168cb5a3d25d66348fee3ac6114cb84794feb1e" exitCode=0 Aug 05 17:12:59.607307 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:12:59.606702 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nx4tc" event={"ID":"97da412c-62d1-470d-a056-aeac249c73f7","Type":"ContainerDied","Data":"7a91159c113e5b049302c7a97168cb5a3d25d66348fee3ac6114cb84794feb1e"} Aug 05 17:13:01.438589 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:01.438562 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67dg" Aug 05 17:13:01.439211 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:01.438682 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smhw9" Aug 05 17:13:01.439211 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:13:01.438695 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67dg" podUID="4e046e80-1c3a-4186-9ba4-0c393f1a9d0e" Aug 05 17:13:01.439211 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:13:01.438780 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smhw9" podUID="4618f8d9-07bc-4de7-9c7c-b09d7fe9d923" Aug 05 17:13:01.439211 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:01.438823 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rw5vc" Aug 05 17:13:01.439211 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:13:01.438875 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rw5vc" podUID="8e25eb68-7896-4157-a857-0c72022fc3ff" Aug 05 17:13:02.960460 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:02.960419 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4618f8d9-07bc-4de7-9c7c-b09d7fe9d923-metrics-certs\") pod \"network-metrics-daemon-smhw9\" (UID: \"4618f8d9-07bc-4de7-9c7c-b09d7fe9d923\") " pod="openshift-multus/network-metrics-daemon-smhw9" Aug 05 17:13:02.960460 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:02.960465 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e046e80-1c3a-4186-9ba4-0c393f1a9d0e-original-pull-secret\") pod \"global-pull-secret-syncer-m67dg\" (UID: \"4e046e80-1c3a-4186-9ba4-0c393f1a9d0e\") " pod="kube-system/global-pull-secret-syncer-m67dg" Aug 05 17:13:02.960952 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:13:02.960570 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 17:13:02.960952 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:13:02.960574 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:13:02.960952 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:13:02.960636 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e046e80-1c3a-4186-9ba4-0c393f1a9d0e-original-pull-secret podName:4e046e80-1c3a-4186-9ba4-0c393f1a9d0e nodeName:}" failed. No retries permitted until 2026-08-05 17:13:34.960618086 +0000 UTC m=+66.133141977 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e046e80-1c3a-4186-9ba4-0c393f1a9d0e-original-pull-secret") pod "global-pull-secret-syncer-m67dg" (UID: "4e046e80-1c3a-4186-9ba4-0c393f1a9d0e") : object "kube-system"/"original-pull-secret" not registered Aug 05 17:13:02.960952 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:13:02.960650 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4618f8d9-07bc-4de7-9c7c-b09d7fe9d923-metrics-certs podName:4618f8d9-07bc-4de7-9c7c-b09d7fe9d923 nodeName:}" failed. No retries permitted until 2026-08-05 17:13:34.960643787 +0000 UTC m=+66.133167680 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4618f8d9-07bc-4de7-9c7c-b09d7fe9d923-metrics-certs") pod "network-metrics-daemon-smhw9" (UID: "4618f8d9-07bc-4de7-9c7c-b09d7fe9d923") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:13:03.162493 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:03.162457 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78485\" (UniqueName: \"kubernetes.io/projected/8e25eb68-7896-4157-a857-0c72022fc3ff-kube-api-access-78485\") pod \"network-check-target-rw5vc\" (UID: \"8e25eb68-7896-4157-a857-0c72022fc3ff\") " pod="openshift-network-diagnostics/network-check-target-rw5vc" Aug 05 17:13:03.162766 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:13:03.162740 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 17:13:03.162880 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:13:03.162772 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 17:13:03.162880 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:13:03.162787 2562 projected.go:196] Error preparing data for projected volume kube-api-access-78485 for pod openshift-network-diagnostics/network-check-target-rw5vc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:13:03.162880 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:13:03.162856 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e25eb68-7896-4157-a857-0c72022fc3ff-kube-api-access-78485 podName:8e25eb68-7896-4157-a857-0c72022fc3ff nodeName:}" failed. No retries permitted until 2026-08-05 17:13:35.162839362 +0000 UTC m=+66.335363253 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-78485" (UniqueName: "kubernetes.io/projected/8e25eb68-7896-4157-a857-0c72022fc3ff-kube-api-access-78485") pod "network-check-target-rw5vc" (UID: "8e25eb68-7896-4157-a857-0c72022fc3ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:13:03.439625 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:03.439594 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rw5vc" Aug 05 17:13:03.439879 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:03.439716 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smhw9" Aug 05 17:13:03.439879 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:13:03.439727 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rw5vc" podUID="8e25eb68-7896-4157-a857-0c72022fc3ff" Aug 05 17:13:03.439879 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:03.439734 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67dg" Aug 05 17:13:03.439879 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:13:03.439840 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smhw9" podUID="4618f8d9-07bc-4de7-9c7c-b09d7fe9d923" Aug 05 17:13:03.440106 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:13:03.439903 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67dg" podUID="4e046e80-1c3a-4186-9ba4-0c393f1a9d0e" Aug 05 17:13:03.626570 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:03.626496 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-104.ec2.internal" event="NodeReady" Aug 05 17:13:03.626824 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:03.626652 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Aug 05 17:13:03.680960 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:03.680929 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xwr4m"] Aug 05 17:13:03.716713 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:03.716687 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-87z42"] Aug 05 17:13:03.716854 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:03.716806 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xwr4m" Aug 05 17:13:03.722069 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:03.722044 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Aug 05 17:13:03.722069 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:03.722062 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Aug 05 17:13:03.722244 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:03.722133 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Aug 05 17:13:03.722352 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:03.722316 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7qph7\"" Aug 05 17:13:03.738069 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:03.738048 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xwr4m"] Aug 05 17:13:03.738182 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:03.738085 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-87z42"] Aug 05 17:13:03.738182 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:03.738156 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-87z42" Aug 05 17:13:03.741063 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:03.741044 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Aug 05 17:13:03.741063 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:03.741058 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Aug 05 17:13:03.741236 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:03.741129 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jxp5d\"" Aug 05 17:13:03.767383 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:03.767354 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7eb0a9c9-9673-426a-9db6-52bd7454b2e3-metrics-tls\") pod \"dns-default-87z42\" (UID: \"7eb0a9c9-9673-426a-9db6-52bd7454b2e3\") " pod="openshift-dns/dns-default-87z42" Aug 05 17:13:03.767519 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:03.767404 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkkgg\" (UniqueName: \"kubernetes.io/projected/7eb0a9c9-9673-426a-9db6-52bd7454b2e3-kube-api-access-lkkgg\") pod \"dns-default-87z42\" (UID: \"7eb0a9c9-9673-426a-9db6-52bd7454b2e3\") " pod="openshift-dns/dns-default-87z42" Aug 05 17:13:03.767519 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:03.767424 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7eb0a9c9-9673-426a-9db6-52bd7454b2e3-config-volume\") pod \"dns-default-87z42\" (UID: \"7eb0a9c9-9673-426a-9db6-52bd7454b2e3\") " pod="openshift-dns/dns-default-87z42" Aug 05 17:13:03.767519 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:03.767457 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7eb0a9c9-9673-426a-9db6-52bd7454b2e3-tmp-dir\") pod \"dns-default-87z42\" (UID: \"7eb0a9c9-9673-426a-9db6-52bd7454b2e3\") " pod="openshift-dns/dns-default-87z42" Aug 05 17:13:03.767519 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:03.767475 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf525\" (UniqueName: \"kubernetes.io/projected/95b2fee7-9604-40e1-8a29-f86363c5991e-kube-api-access-bf525\") pod \"ingress-canary-xwr4m\" (UID: \"95b2fee7-9604-40e1-8a29-f86363c5991e\") " pod="openshift-ingress-canary/ingress-canary-xwr4m" Aug 05 17:13:03.767519 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:03.767493 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95b2fee7-9604-40e1-8a29-f86363c5991e-cert\") pod \"ingress-canary-xwr4m\" (UID: \"95b2fee7-9604-40e1-8a29-f86363c5991e\") " pod="openshift-ingress-canary/ingress-canary-xwr4m" Aug 05 17:13:03.868020 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:03.867989 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7eb0a9c9-9673-426a-9db6-52bd7454b2e3-metrics-tls\") pod \"dns-default-87z42\" (UID: \"7eb0a9c9-9673-426a-9db6-52bd7454b2e3\") " pod="openshift-dns/dns-default-87z42" Aug 05 17:13:03.868170 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:03.868041 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkkgg\" (UniqueName: \"kubernetes.io/projected/7eb0a9c9-9673-426a-9db6-52bd7454b2e3-kube-api-access-lkkgg\") pod \"dns-default-87z42\" (UID: \"7eb0a9c9-9673-426a-9db6-52bd7454b2e3\") " pod="openshift-dns/dns-default-87z42" Aug 05 17:13:03.868170 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:03.868060 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7eb0a9c9-9673-426a-9db6-52bd7454b2e3-config-volume\") pod \"dns-default-87z42\" (UID: \"7eb0a9c9-9673-426a-9db6-52bd7454b2e3\") " pod="openshift-dns/dns-default-87z42" Aug 05 17:13:03.868170 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:03.868096 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7eb0a9c9-9673-426a-9db6-52bd7454b2e3-tmp-dir\") pod \"dns-default-87z42\" (UID: \"7eb0a9c9-9673-426a-9db6-52bd7454b2e3\") " pod="openshift-dns/dns-default-87z42" Aug 05 17:13:03.868170 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:03.868116 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf525\" (UniqueName: \"kubernetes.io/projected/95b2fee7-9604-40e1-8a29-f86363c5991e-kube-api-access-bf525\") pod \"ingress-canary-xwr4m\" (UID: \"95b2fee7-9604-40e1-8a29-f86363c5991e\") " pod="openshift-ingress-canary/ingress-canary-xwr4m" Aug 05 17:13:03.868170 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:03.868133 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95b2fee7-9604-40e1-8a29-f86363c5991e-cert\") pod \"ingress-canary-xwr4m\" (UID: \"95b2fee7-9604-40e1-8a29-f86363c5991e\") " pod="openshift-ingress-canary/ingress-canary-xwr4m" Aug 05 17:13:03.868170 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:13:03.868149 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 17:13:03.868488 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:13:03.868220 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7eb0a9c9-9673-426a-9db6-52bd7454b2e3-metrics-tls podName:7eb0a9c9-9673-426a-9db6-52bd7454b2e3 nodeName:}" failed. No retries permitted until 2026-08-05 17:13:04.368199275 +0000 UTC m=+35.540723167 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7eb0a9c9-9673-426a-9db6-52bd7454b2e3-metrics-tls") pod "dns-default-87z42" (UID: "7eb0a9c9-9673-426a-9db6-52bd7454b2e3") : secret "dns-default-metrics-tls" not found Aug 05 17:13:03.868555 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:03.868537 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7eb0a9c9-9673-426a-9db6-52bd7454b2e3-tmp-dir\") pod \"dns-default-87z42\" (UID: \"7eb0a9c9-9673-426a-9db6-52bd7454b2e3\") " pod="openshift-dns/dns-default-87z42" Aug 05 17:13:03.868864 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:03.868836 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7eb0a9c9-9673-426a-9db6-52bd7454b2e3-config-volume\") pod \"dns-default-87z42\" (UID: \"7eb0a9c9-9673-426a-9db6-52bd7454b2e3\") " pod="openshift-dns/dns-default-87z42" Aug 05 17:13:03.872422 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:03.872404 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95b2fee7-9604-40e1-8a29-f86363c5991e-cert\") pod \"ingress-canary-xwr4m\" (UID: \"95b2fee7-9604-40e1-8a29-f86363c5991e\") " pod="openshift-ingress-canary/ingress-canary-xwr4m" Aug 05 17:13:03.878313 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:03.878251 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkkgg\" (UniqueName: \"kubernetes.io/projected/7eb0a9c9-9673-426a-9db6-52bd7454b2e3-kube-api-access-lkkgg\") pod \"dns-default-87z42\" (UID: \"7eb0a9c9-9673-426a-9db6-52bd7454b2e3\") " pod="openshift-dns/dns-default-87z42" Aug 05 17:13:03.878635 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:03.878615 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf525\" (UniqueName: \"kubernetes.io/projected/95b2fee7-9604-40e1-8a29-f86363c5991e-kube-api-access-bf525\") pod \"ingress-canary-xwr4m\" (UID: \"95b2fee7-9604-40e1-8a29-f86363c5991e\") " pod="openshift-ingress-canary/ingress-canary-xwr4m" Aug 05 17:13:04.025445 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:04.025411 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xwr4m" Aug 05 17:13:04.331454 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:04.331256 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xwr4m"] Aug 05 17:13:04.334155 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:13:04.334128 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95b2fee7_9604_40e1_8a29_f86363c5991e.slice/crio-59f0ade18d27c6db28ea9b9bd4554261b1fe7a408a66d068f2c7e4f6e42345a3 WatchSource:0}: Error finding container 59f0ade18d27c6db28ea9b9bd4554261b1fe7a408a66d068f2c7e4f6e42345a3: Status 404 returned error can't find the container with id 59f0ade18d27c6db28ea9b9bd4554261b1fe7a408a66d068f2c7e4f6e42345a3 Aug 05 17:13:04.371494 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:04.371456 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7eb0a9c9-9673-426a-9db6-52bd7454b2e3-metrics-tls\") pod \"dns-default-87z42\" (UID: \"7eb0a9c9-9673-426a-9db6-52bd7454b2e3\") " pod="openshift-dns/dns-default-87z42" Aug 05 17:13:04.371649 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:13:04.371589 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 17:13:04.371649 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:13:04.371644 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7eb0a9c9-9673-426a-9db6-52bd7454b2e3-metrics-tls podName:7eb0a9c9-9673-426a-9db6-52bd7454b2e3 nodeName:}" failed. No retries permitted until 2026-08-05 17:13:05.37162943 +0000 UTC m=+36.544153319 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7eb0a9c9-9673-426a-9db6-52bd7454b2e3-metrics-tls") pod "dns-default-87z42" (UID: "7eb0a9c9-9673-426a-9db6-52bd7454b2e3") : secret "dns-default-metrics-tls" not found Aug 05 17:13:04.618786 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:04.618750 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xwr4m" event={"ID":"95b2fee7-9604-40e1-8a29-f86363c5991e","Type":"ContainerStarted","Data":"59f0ade18d27c6db28ea9b9bd4554261b1fe7a408a66d068f2c7e4f6e42345a3"} Aug 05 17:13:04.621251 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:04.621227 2562 generic.go:356] "Generic (PLEG): container finished" podID="97da412c-62d1-470d-a056-aeac249c73f7" containerID="e49e85b15abce14ca29d01746a54d4dbbc00cd39977e2bd7bc619dcf4a82febc" exitCode=0 Aug 05 17:13:04.621388 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:04.621277 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nx4tc" event={"ID":"97da412c-62d1-470d-a056-aeac249c73f7","Type":"ContainerDied","Data":"e49e85b15abce14ca29d01746a54d4dbbc00cd39977e2bd7bc619dcf4a82febc"} Aug 05 17:13:05.378833 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:05.378798 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7eb0a9c9-9673-426a-9db6-52bd7454b2e3-metrics-tls\") pod \"dns-default-87z42\" (UID: \"7eb0a9c9-9673-426a-9db6-52bd7454b2e3\") " pod="openshift-dns/dns-default-87z42" Aug 05 17:13:05.379250 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:13:05.378953 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 17:13:05.379250 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:13:05.379018 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7eb0a9c9-9673-426a-9db6-52bd7454b2e3-metrics-tls podName:7eb0a9c9-9673-426a-9db6-52bd7454b2e3 nodeName:}" failed. No retries permitted until 2026-08-05 17:13:07.379000269 +0000 UTC m=+38.551524158 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7eb0a9c9-9673-426a-9db6-52bd7454b2e3-metrics-tls") pod "dns-default-87z42" (UID: "7eb0a9c9-9673-426a-9db6-52bd7454b2e3") : secret "dns-default-metrics-tls" not found Aug 05 17:13:05.438881 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:05.438851 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rw5vc" Aug 05 17:13:05.438881 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:05.438892 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smhw9" Aug 05 17:13:05.439105 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:05.438891 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67dg" Aug 05 17:13:05.443481 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:05.443423 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Aug 05 17:13:05.443481 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:05.443423 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Aug 05 17:13:05.443647 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:05.443425 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g8bnx\"" Aug 05 17:13:05.443647 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:05.443563 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z9xpb\"" Aug 05 17:13:05.443887 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:05.443743 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Aug 05 17:13:05.443887 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:05.443813 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Aug 05 17:13:05.626971 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:05.626930 2562 generic.go:356] "Generic (PLEG): container finished" podID="97da412c-62d1-470d-a056-aeac249c73f7" containerID="23353e9f35467b9166ca55c2b39cca52fa27c13a1ff0ebd1da80c0d17d4cda9f" exitCode=0 Aug 05 17:13:05.627132 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:05.626978 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nx4tc" event={"ID":"97da412c-62d1-470d-a056-aeac249c73f7","Type":"ContainerDied","Data":"23353e9f35467b9166ca55c2b39cca52fa27c13a1ff0ebd1da80c0d17d4cda9f"} Aug 05 17:13:06.632670 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:06.632425 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nx4tc" event={"ID":"97da412c-62d1-470d-a056-aeac249c73f7","Type":"ContainerStarted","Data":"3492248f37828f0f4c3f01321125e4cbb809ab81c94425261146dbeb24e9cffd"} Aug 05 17:13:06.663285 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:06.663232 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nx4tc" podStartSLOduration=7.565823174 podStartE2EDuration="37.663216532s" totalImagesPullingTime="30.097393358s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:29 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:13:06.661614954 +0000 UTC m=+37.834138864" watchObservedRunningTime="2026-08-05 17:13:06.663216532 +0000 UTC m=+37.835740423" Aug 05 17:13:07.395632 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:07.395584 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7eb0a9c9-9673-426a-9db6-52bd7454b2e3-metrics-tls\") pod \"dns-default-87z42\" (UID: \"7eb0a9c9-9673-426a-9db6-52bd7454b2e3\") " pod="openshift-dns/dns-default-87z42" Aug 05 17:13:07.395831 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:13:07.395719 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 17:13:07.395831 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:13:07.395790 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7eb0a9c9-9673-426a-9db6-52bd7454b2e3-metrics-tls podName:7eb0a9c9-9673-426a-9db6-52bd7454b2e3 nodeName:}" failed. No retries permitted until 2026-08-05 17:13:11.395771288 +0000 UTC m=+42.568295192 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7eb0a9c9-9673-426a-9db6-52bd7454b2e3-metrics-tls") pod "dns-default-87z42" (UID: "7eb0a9c9-9673-426a-9db6-52bd7454b2e3") : secret "dns-default-metrics-tls" not found Aug 05 17:13:07.636079 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:07.636043 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xwr4m" event={"ID":"95b2fee7-9604-40e1-8a29-f86363c5991e","Type":"ContainerStarted","Data":"a212c5b8a36a9ae663a7cba8a78cc4e021202e8ec0ec3b32612700a29a0be63f"} Aug 05 17:13:07.655735 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:07.655653 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xwr4m" podStartSLOduration=2.247725689 podStartE2EDuration="4.655640032s" totalImagesPullingTime="2.407914343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:13:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:13:07.654948644 +0000 UTC m=+38.827472551" watchObservedRunningTime="2026-08-05 17:13:07.655640032 +0000 UTC m=+38.828163943" Aug 05 17:13:11.423048 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:11.423008 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7eb0a9c9-9673-426a-9db6-52bd7454b2e3-metrics-tls\") pod \"dns-default-87z42\" (UID: \"7eb0a9c9-9673-426a-9db6-52bd7454b2e3\") " pod="openshift-dns/dns-default-87z42" Aug 05 17:13:11.423453 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:13:11.423157 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 17:13:11.423453 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:13:11.423226 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7eb0a9c9-9673-426a-9db6-52bd7454b2e3-metrics-tls podName:7eb0a9c9-9673-426a-9db6-52bd7454b2e3 nodeName:}" failed. No retries permitted until 2026-08-05 17:13:19.423210948 +0000 UTC m=+50.595734842 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7eb0a9c9-9673-426a-9db6-52bd7454b2e3-metrics-tls") pod "dns-default-87z42" (UID: "7eb0a9c9-9673-426a-9db6-52bd7454b2e3") : secret "dns-default-metrics-tls" not found Aug 05 17:13:19.477930 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:19.477897 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7eb0a9c9-9673-426a-9db6-52bd7454b2e3-metrics-tls\") pod \"dns-default-87z42\" (UID: \"7eb0a9c9-9673-426a-9db6-52bd7454b2e3\") " pod="openshift-dns/dns-default-87z42" Aug 05 17:13:19.478315 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:13:19.478040 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 17:13:19.478315 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:13:19.478097 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7eb0a9c9-9673-426a-9db6-52bd7454b2e3-metrics-tls podName:7eb0a9c9-9673-426a-9db6-52bd7454b2e3 nodeName:}" failed. No retries permitted until 2026-08-05 17:13:35.478083545 +0000 UTC m=+66.650607434 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7eb0a9c9-9673-426a-9db6-52bd7454b2e3-metrics-tls") pod "dns-default-87z42" (UID: "7eb0a9c9-9673-426a-9db6-52bd7454b2e3") : secret "dns-default-metrics-tls" not found Aug 05 17:13:29.617415 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:29.617384 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lxfxq" Aug 05 17:13:34.986040 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:34.985990 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4618f8d9-07bc-4de7-9c7c-b09d7fe9d923-metrics-certs\") pod \"network-metrics-daemon-smhw9\" (UID: \"4618f8d9-07bc-4de7-9c7c-b09d7fe9d923\") " pod="openshift-multus/network-metrics-daemon-smhw9" Aug 05 17:13:34.986499 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:34.986049 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e046e80-1c3a-4186-9ba4-0c393f1a9d0e-original-pull-secret\") pod \"global-pull-secret-syncer-m67dg\" (UID: \"4e046e80-1c3a-4186-9ba4-0c393f1a9d0e\") " pod="kube-system/global-pull-secret-syncer-m67dg" Aug 05 17:13:34.989104 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:34.989077 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Aug 05 17:13:34.989191 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:34.989173 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Aug 05 17:13:34.996465 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:13:34.996439 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Aug 05 17:13:34.996569 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:13:34.996508 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4618f8d9-07bc-4de7-9c7c-b09d7fe9d923-metrics-certs podName:4618f8d9-07bc-4de7-9c7c-b09d7fe9d923 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:38.996487567 +0000 UTC m=+130.169011456 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4618f8d9-07bc-4de7-9c7c-b09d7fe9d923-metrics-certs") pod "network-metrics-daemon-smhw9" (UID: "4618f8d9-07bc-4de7-9c7c-b09d7fe9d923") : secret "metrics-daemon-secret" not found Aug 05 17:13:35.000246 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.000215 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e046e80-1c3a-4186-9ba4-0c393f1a9d0e-original-pull-secret\") pod \"global-pull-secret-syncer-m67dg\" (UID: \"4e046e80-1c3a-4186-9ba4-0c393f1a9d0e\") " pod="kube-system/global-pull-secret-syncer-m67dg" Aug 05 17:13:35.158146 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.158104 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67dg" Aug 05 17:13:35.187768 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.187728 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78485\" (UniqueName: \"kubernetes.io/projected/8e25eb68-7896-4157-a857-0c72022fc3ff-kube-api-access-78485\") pod \"network-check-target-rw5vc\" (UID: \"8e25eb68-7896-4157-a857-0c72022fc3ff\") " pod="openshift-network-diagnostics/network-check-target-rw5vc" Aug 05 17:13:35.190966 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.190946 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Aug 05 17:13:35.201432 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.201406 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Aug 05 17:13:35.211441 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.211415 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78485\" (UniqueName: \"kubernetes.io/projected/8e25eb68-7896-4157-a857-0c72022fc3ff-kube-api-access-78485\") pod \"network-check-target-rw5vc\" (UID: \"8e25eb68-7896-4157-a857-0c72022fc3ff\") " pod="openshift-network-diagnostics/network-check-target-rw5vc" Aug 05 17:13:35.289317 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.289283 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb85f687b-2znwf"] Aug 05 17:13:35.310968 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.310940 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb85f687b-2znwf" Aug 05 17:13:35.316139 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.316095 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb85f687b-2znwf"] Aug 05 17:13:35.316725 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.316700 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Aug 05 17:13:35.316846 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.316773 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cc4d8977-69nkw"] Aug 05 17:13:35.317642 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.317616 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Aug 05 17:13:35.318566 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.318265 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Aug 05 17:13:35.318566 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.318323 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Aug 05 17:13:35.318566 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.318456 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-nw5xd\"" Aug 05 17:13:35.335053 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.335019 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cc4d8977-69nkw" Aug 05 17:13:35.336718 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.336576 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-m67dg"] Aug 05 17:13:35.337319 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.337255 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cc4d8977-69nkw"] Aug 05 17:13:35.339142 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:13:35.339120 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e046e80_1c3a_4186_9ba4_0c393f1a9d0e.slice/crio-81d79526fdd34887ee74c2c132fddee6e5cc1439664a82cf9a568da1d2dacbe1 WatchSource:0}: Error finding container 81d79526fdd34887ee74c2c132fddee6e5cc1439664a82cf9a568da1d2dacbe1: Status 404 returned error can't find the container with id 81d79526fdd34887ee74c2c132fddee6e5cc1439664a82cf9a568da1d2dacbe1 Aug 05 17:13:35.339577 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.339460 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Aug 05 17:13:35.389128 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.389092 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64ws7\" (UniqueName: \"kubernetes.io/projected/67d3788a-d9c8-43d9-a4ce-831c48ffb355-kube-api-access-64ws7\") pod \"managed-serviceaccount-addon-agent-7cb85f687b-2znwf\" (UID: \"67d3788a-d9c8-43d9-a4ce-831c48ffb355\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb85f687b-2znwf" Aug 05 17:13:35.389320 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.389136 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b322ef71-bfa7-4e76-a826-b3b6421c3ce0-klusterlet-config\") pod \"klusterlet-addon-workmgr-77cc4d8977-69nkw\" (UID: \"b322ef71-bfa7-4e76-a826-b3b6421c3ce0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cc4d8977-69nkw" Aug 05 17:13:35.389320 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.389158 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj6ks\" (UniqueName: \"kubernetes.io/projected/b322ef71-bfa7-4e76-a826-b3b6421c3ce0-kube-api-access-jj6ks\") pod \"klusterlet-addon-workmgr-77cc4d8977-69nkw\" (UID: \"b322ef71-bfa7-4e76-a826-b3b6421c3ce0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cc4d8977-69nkw" Aug 05 17:13:35.389320 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.389219 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/67d3788a-d9c8-43d9-a4ce-831c48ffb355-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7cb85f687b-2znwf\" (UID: \"67d3788a-d9c8-43d9-a4ce-831c48ffb355\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb85f687b-2znwf" Aug 05 17:13:35.389320 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.389255 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b322ef71-bfa7-4e76-a826-b3b6421c3ce0-tmp\") pod \"klusterlet-addon-workmgr-77cc4d8977-69nkw\" (UID: \"b322ef71-bfa7-4e76-a826-b3b6421c3ce0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cc4d8977-69nkw" Aug 05 17:13:35.453948 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.453915 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g8bnx\"" Aug 05 17:13:35.461517 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.461491 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rw5vc" Aug 05 17:13:35.489943 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.489852 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/67d3788a-d9c8-43d9-a4ce-831c48ffb355-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7cb85f687b-2znwf\" (UID: \"67d3788a-d9c8-43d9-a4ce-831c48ffb355\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb85f687b-2znwf" Aug 05 17:13:35.489943 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.489895 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7eb0a9c9-9673-426a-9db6-52bd7454b2e3-metrics-tls\") pod \"dns-default-87z42\" (UID: \"7eb0a9c9-9673-426a-9db6-52bd7454b2e3\") " pod="openshift-dns/dns-default-87z42" Aug 05 17:13:35.489943 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.489914 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b322ef71-bfa7-4e76-a826-b3b6421c3ce0-tmp\") pod \"klusterlet-addon-workmgr-77cc4d8977-69nkw\" (UID: \"b322ef71-bfa7-4e76-a826-b3b6421c3ce0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cc4d8977-69nkw" Aug 05 17:13:35.490201 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.489962 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64ws7\" (UniqueName: \"kubernetes.io/projected/67d3788a-d9c8-43d9-a4ce-831c48ffb355-kube-api-access-64ws7\") pod \"managed-serviceaccount-addon-agent-7cb85f687b-2znwf\" (UID: \"67d3788a-d9c8-43d9-a4ce-831c48ffb355\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb85f687b-2znwf" Aug 05 17:13:35.490201 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.489979 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b322ef71-bfa7-4e76-a826-b3b6421c3ce0-klusterlet-config\") pod \"klusterlet-addon-workmgr-77cc4d8977-69nkw\" (UID: \"b322ef71-bfa7-4e76-a826-b3b6421c3ce0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cc4d8977-69nkw" Aug 05 17:13:35.490201 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.489996 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj6ks\" (UniqueName: \"kubernetes.io/projected/b322ef71-bfa7-4e76-a826-b3b6421c3ce0-kube-api-access-jj6ks\") pod \"klusterlet-addon-workmgr-77cc4d8977-69nkw\" (UID: \"b322ef71-bfa7-4e76-a826-b3b6421c3ce0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cc4d8977-69nkw" Aug 05 17:13:35.490201 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:13:35.490053 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 17:13:35.490201 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:13:35.490160 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7eb0a9c9-9673-426a-9db6-52bd7454b2e3-metrics-tls podName:7eb0a9c9-9673-426a-9db6-52bd7454b2e3 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:07.490137933 +0000 UTC m=+98.662661822 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7eb0a9c9-9673-426a-9db6-52bd7454b2e3-metrics-tls") pod "dns-default-87z42" (UID: "7eb0a9c9-9673-426a-9db6-52bd7454b2e3") : secret "dns-default-metrics-tls" not found Aug 05 17:13:35.490518 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.490487 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b322ef71-bfa7-4e76-a826-b3b6421c3ce0-tmp\") pod \"klusterlet-addon-workmgr-77cc4d8977-69nkw\" (UID: \"b322ef71-bfa7-4e76-a826-b3b6421c3ce0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cc4d8977-69nkw" Aug 05 17:13:35.492409 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.492383 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/67d3788a-d9c8-43d9-a4ce-831c48ffb355-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7cb85f687b-2znwf\" (UID: \"67d3788a-d9c8-43d9-a4ce-831c48ffb355\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb85f687b-2znwf" Aug 05 17:13:35.492655 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.492630 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b322ef71-bfa7-4e76-a826-b3b6421c3ce0-klusterlet-config\") pod \"klusterlet-addon-workmgr-77cc4d8977-69nkw\" (UID: \"b322ef71-bfa7-4e76-a826-b3b6421c3ce0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cc4d8977-69nkw" Aug 05 17:13:35.500052 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.500023 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj6ks\" (UniqueName: \"kubernetes.io/projected/b322ef71-bfa7-4e76-a826-b3b6421c3ce0-kube-api-access-jj6ks\") pod \"klusterlet-addon-workmgr-77cc4d8977-69nkw\" (UID: \"b322ef71-bfa7-4e76-a826-b3b6421c3ce0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cc4d8977-69nkw" Aug 05 17:13:35.501521 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.501491 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64ws7\" (UniqueName: \"kubernetes.io/projected/67d3788a-d9c8-43d9-a4ce-831c48ffb355-kube-api-access-64ws7\") pod \"managed-serviceaccount-addon-agent-7cb85f687b-2znwf\" (UID: \"67d3788a-d9c8-43d9-a4ce-831c48ffb355\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb85f687b-2znwf" Aug 05 17:13:35.589273 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.589238 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rw5vc"] Aug 05 17:13:35.592672 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:13:35.592648 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e25eb68_7896_4157_a857_0c72022fc3ff.slice/crio-0bc1f0889a916d1c14d4591398a7bfbb8d09e454fdb602e83eac10aea04dbbee WatchSource:0}: Error finding container 0bc1f0889a916d1c14d4591398a7bfbb8d09e454fdb602e83eac10aea04dbbee: Status 404 returned error can't find the container with id 0bc1f0889a916d1c14d4591398a7bfbb8d09e454fdb602e83eac10aea04dbbee Aug 05 17:13:35.632876 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.632835 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb85f687b-2znwf" Aug 05 17:13:35.655165 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.655138 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cc4d8977-69nkw" Aug 05 17:13:35.704907 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.704868 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rw5vc" event={"ID":"8e25eb68-7896-4157-a857-0c72022fc3ff","Type":"ContainerStarted","Data":"0bc1f0889a916d1c14d4591398a7bfbb8d09e454fdb602e83eac10aea04dbbee"} Aug 05 17:13:35.706722 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.706664 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-m67dg" event={"ID":"4e046e80-1c3a-4186-9ba4-0c393f1a9d0e","Type":"ContainerStarted","Data":"81d79526fdd34887ee74c2c132fddee6e5cc1439664a82cf9a568da1d2dacbe1"} Aug 05 17:13:35.783872 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.783824 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb85f687b-2znwf"] Aug 05 17:13:35.788623 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:13:35.788589 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod67d3788a_d9c8_43d9_a4ce_831c48ffb355.slice/crio-aae8e4b21e1bcac91be83d35e0921bd4d57310782c498389abb81df16d4bdfb8 WatchSource:0}: Error finding container aae8e4b21e1bcac91be83d35e0921bd4d57310782c498389abb81df16d4bdfb8: Status 404 returned error can't find the container with id aae8e4b21e1bcac91be83d35e0921bd4d57310782c498389abb81df16d4bdfb8 Aug 05 17:13:35.811965 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:35.811933 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cc4d8977-69nkw"] Aug 05 17:13:35.815570 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:13:35.815536 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb322ef71_bfa7_4e76_a826_b3b6421c3ce0.slice/crio-a129616fde0eb59552743fa45e86d728e1dca8af6856b044fb4e5a4d2139f355 WatchSource:0}: Error finding container a129616fde0eb59552743fa45e86d728e1dca8af6856b044fb4e5a4d2139f355: Status 404 returned error can't find the container with id a129616fde0eb59552743fa45e86d728e1dca8af6856b044fb4e5a4d2139f355 Aug 05 17:13:36.711813 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:36.711740 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb85f687b-2znwf" event={"ID":"67d3788a-d9c8-43d9-a4ce-831c48ffb355","Type":"ContainerStarted","Data":"aae8e4b21e1bcac91be83d35e0921bd4d57310782c498389abb81df16d4bdfb8"} Aug 05 17:13:36.713808 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:36.713716 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cc4d8977-69nkw" event={"ID":"b322ef71-bfa7-4e76-a826-b3b6421c3ce0","Type":"ContainerStarted","Data":"a129616fde0eb59552743fa45e86d728e1dca8af6856b044fb4e5a4d2139f355"} Aug 05 17:13:42.736105 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:42.735865 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb85f687b-2znwf" event={"ID":"67d3788a-d9c8-43d9-a4ce-831c48ffb355","Type":"ContainerStarted","Data":"846e692408f36eadcd93be956fab052a5c2b9d3f2737602e345e580df14f8466"} Aug 05 17:13:42.759051 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:42.758989 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb85f687b-2znwf" podStartSLOduration=0.908892722 podStartE2EDuration="7.758970458s" totalImagesPullingTime="6.850077736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:13:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:13:42.758401459 +0000 UTC m=+73.930925371" watchObservedRunningTime="2026-08-05 17:13:42.758970458 +0000 UTC m=+73.931494370" Aug 05 17:13:43.739683 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:43.739647 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rw5vc" event={"ID":"8e25eb68-7896-4157-a857-0c72022fc3ff","Type":"ContainerStarted","Data":"0aa35ca52aa684e0a9700be11dc0403b44cf2ae8a5fbbfa0c968693da0ae6c33"} Aug 05 17:13:43.740129 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:43.739777 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rw5vc" Aug 05 17:13:43.741264 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:43.741238 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-m67dg" event={"ID":"4e046e80-1c3a-4186-9ba4-0c393f1a9d0e","Type":"ContainerStarted","Data":"be110bea0d571b38192bafe26f9b5f4a6ad35344953dc7c1138dd99956f75906"} Aug 05 17:13:43.742572 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:43.742551 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cc4d8977-69nkw" event={"ID":"b322ef71-bfa7-4e76-a826-b3b6421c3ce0","Type":"ContainerStarted","Data":"7a65c617d0b82963ca774361f7587821d795a62b2911ab42abe01a273cdc2b4b"} Aug 05 17:13:43.759702 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:43.759649 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rw5vc" podStartSLOduration=67.705273792 podStartE2EDuration="1m14.759629424s" totalImagesPullingTime="7.054355632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:12:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:13:43.758380185 +0000 UTC m=+74.930904092" watchObservedRunningTime="2026-08-05 17:13:43.759629424 +0000 UTC m=+74.932153334" Aug 05 17:13:43.776189 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:43.776135 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-m67dg" podStartSLOduration=67.469607856 podStartE2EDuration="1m14.776114754s" totalImagesPullingTime="7.306506898s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:13:43.775437825 +0000 UTC m=+74.947961737" watchObservedRunningTime="2026-08-05 17:13:43.776114754 +0000 UTC m=+74.948638716" Aug 05 17:13:43.793196 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:43.793140 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cc4d8977-69nkw" podStartSLOduration=1.949933293 podStartE2EDuration="8.79312576s" totalImagesPullingTime="6.843192467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:13:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:13:43.792862007 +0000 UTC m=+74.965385919" watchObservedRunningTime="2026-08-05 17:13:43.79312576 +0000 UTC m=+74.965649675" Aug 05 17:13:44.745641 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:44.745600 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cc4d8977-69nkw" Aug 05 17:13:44.747404 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:13:44.747381 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cc4d8977-69nkw" Aug 05 17:14:07.524945 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:07.524806 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7eb0a9c9-9673-426a-9db6-52bd7454b2e3-metrics-tls\") pod \"dns-default-87z42\" (UID: \"7eb0a9c9-9673-426a-9db6-52bd7454b2e3\") " pod="openshift-dns/dns-default-87z42" Aug 05 17:14:07.524945 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:14:07.524929 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 17:14:07.525413 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:14:07.524992 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7eb0a9c9-9673-426a-9db6-52bd7454b2e3-metrics-tls podName:7eb0a9c9-9673-426a-9db6-52bd7454b2e3 nodeName:}" failed. No retries permitted until 2026-08-05 17:15:11.524977959 +0000 UTC m=+162.697501848 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7eb0a9c9-9673-426a-9db6-52bd7454b2e3-metrics-tls") pod "dns-default-87z42" (UID: "7eb0a9c9-9673-426a-9db6-52bd7454b2e3") : secret "dns-default-metrics-tls" not found Aug 05 17:14:14.747486 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:14.747453 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rw5vc" Aug 05 17:14:39.046564 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:39.046522 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4618f8d9-07bc-4de7-9c7c-b09d7fe9d923-metrics-certs\") pod \"network-metrics-daemon-smhw9\" (UID: \"4618f8d9-07bc-4de7-9c7c-b09d7fe9d923\") " pod="openshift-multus/network-metrics-daemon-smhw9" Aug 05 17:14:39.047052 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:14:39.046659 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Aug 05 17:14:39.047052 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:14:39.046728 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4618f8d9-07bc-4de7-9c7c-b09d7fe9d923-metrics-certs podName:4618f8d9-07bc-4de7-9c7c-b09d7fe9d923 nodeName:}" failed. No retries permitted until 2026-08-05 17:16:41.046710476 +0000 UTC m=+252.219234366 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4618f8d9-07bc-4de7-9c7c-b09d7fe9d923-metrics-certs") pod "network-metrics-daemon-smhw9" (UID: "4618f8d9-07bc-4de7-9c7c-b09d7fe9d923") : secret "metrics-daemon-secret" not found Aug 05 17:14:42.826831 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:42.826797 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-tdhz6"] Aug 05 17:14:42.828713 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:42.828698 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-xbr7x"] Aug 05 17:14:42.828841 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:42.828823 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-tdhz6" Aug 05 17:14:42.831961 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:42.831934 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Aug 05 17:14:42.832930 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:42.832043 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-5wzn5\"" Aug 05 17:14:42.833037 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:42.832181 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Aug 05 17:14:42.833528 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:42.833510 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-xbr7x" Aug 05 17:14:42.836480 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:42.836462 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Aug 05 17:14:42.839938 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:42.839906 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Aug 05 17:14:42.840035 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:42.839943 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Aug 05 17:14:42.840035 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:42.839993 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Aug 05 17:14:42.840035 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:42.839997 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4hzs7\"" Aug 05 17:14:42.846970 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:42.846950 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-tdhz6"] Aug 05 17:14:42.849781 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:42.849761 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-xbr7x"] Aug 05 17:14:42.975474 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:42.975434 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/12e59498-428e-4bec-9fd3-6e8ba11384f4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-xbr7x\" (UID: \"12e59498-428e-4bec-9fd3-6e8ba11384f4\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-xbr7x" Aug 05 17:14:42.975474 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:42.975473 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfnzd\" (UniqueName: \"kubernetes.io/projected/1d3ccb1f-4b5b-47da-a4e4-d60ac0a8b2f4-kube-api-access-gfnzd\") pod \"volume-data-source-validator-5b8776669-tdhz6\" (UID: \"1d3ccb1f-4b5b-47da-a4e4-d60ac0a8b2f4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-tdhz6" Aug 05 17:14:42.975703 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:42.975506 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/12e59498-428e-4bec-9fd3-6e8ba11384f4-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-xbr7x\" (UID: \"12e59498-428e-4bec-9fd3-6e8ba11384f4\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-xbr7x" Aug 05 17:14:42.975703 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:42.975559 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx65m\" (UniqueName: \"kubernetes.io/projected/12e59498-428e-4bec-9fd3-6e8ba11384f4-kube-api-access-qx65m\") pod \"cluster-monitoring-operator-6f55c4f58d-xbr7x\" (UID: \"12e59498-428e-4bec-9fd3-6e8ba11384f4\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-xbr7x" Aug 05 17:14:43.076411 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:43.076374 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/12e59498-428e-4bec-9fd3-6e8ba11384f4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-xbr7x\" (UID: \"12e59498-428e-4bec-9fd3-6e8ba11384f4\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-xbr7x" Aug 05 17:14:43.076411 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:43.076412 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfnzd\" (UniqueName: \"kubernetes.io/projected/1d3ccb1f-4b5b-47da-a4e4-d60ac0a8b2f4-kube-api-access-gfnzd\") pod \"volume-data-source-validator-5b8776669-tdhz6\" (UID: \"1d3ccb1f-4b5b-47da-a4e4-d60ac0a8b2f4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-tdhz6" Aug 05 17:14:43.076658 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:43.076436 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/12e59498-428e-4bec-9fd3-6e8ba11384f4-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-xbr7x\" (UID: \"12e59498-428e-4bec-9fd3-6e8ba11384f4\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-xbr7x" Aug 05 17:14:43.076658 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:43.076460 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx65m\" (UniqueName: \"kubernetes.io/projected/12e59498-428e-4bec-9fd3-6e8ba11384f4-kube-api-access-qx65m\") pod \"cluster-monitoring-operator-6f55c4f58d-xbr7x\" (UID: \"12e59498-428e-4bec-9fd3-6e8ba11384f4\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-xbr7x" Aug 05 17:14:43.076658 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:14:43.076525 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 05 17:14:43.076658 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:14:43.076598 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e59498-428e-4bec-9fd3-6e8ba11384f4-cluster-monitoring-operator-tls podName:12e59498-428e-4bec-9fd3-6e8ba11384f4 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:43.576582414 +0000 UTC m=+134.749106306 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/12e59498-428e-4bec-9fd3-6e8ba11384f4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-xbr7x" (UID: "12e59498-428e-4bec-9fd3-6e8ba11384f4") : secret "cluster-monitoring-operator-tls" not found Aug 05 17:14:43.077227 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:43.077178 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/12e59498-428e-4bec-9fd3-6e8ba11384f4-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-xbr7x\" (UID: \"12e59498-428e-4bec-9fd3-6e8ba11384f4\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-xbr7x" Aug 05 17:14:43.086833 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:43.086807 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx65m\" (UniqueName: \"kubernetes.io/projected/12e59498-428e-4bec-9fd3-6e8ba11384f4-kube-api-access-qx65m\") pod \"cluster-monitoring-operator-6f55c4f58d-xbr7x\" (UID: \"12e59498-428e-4bec-9fd3-6e8ba11384f4\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-xbr7x" Aug 05 17:14:43.088620 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:43.088596 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfnzd\" (UniqueName: \"kubernetes.io/projected/1d3ccb1f-4b5b-47da-a4e4-d60ac0a8b2f4-kube-api-access-gfnzd\") pod \"volume-data-source-validator-5b8776669-tdhz6\" (UID: \"1d3ccb1f-4b5b-47da-a4e4-d60ac0a8b2f4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-tdhz6" Aug 05 17:14:43.140637 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:43.140586 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-tdhz6" Aug 05 17:14:43.266463 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:43.266438 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-tdhz6"] Aug 05 17:14:43.266778 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:14:43.266759 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d3ccb1f_4b5b_47da_a4e4_d60ac0a8b2f4.slice/crio-ac7c0cd10ab8524e615adbe60bc001aa3befa68dd428c09648b54600437828b3 WatchSource:0}: Error finding container ac7c0cd10ab8524e615adbe60bc001aa3befa68dd428c09648b54600437828b3: Status 404 returned error can't find the container with id ac7c0cd10ab8524e615adbe60bc001aa3befa68dd428c09648b54600437828b3 Aug 05 17:14:43.581459 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:43.581422 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/12e59498-428e-4bec-9fd3-6e8ba11384f4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-xbr7x\" (UID: \"12e59498-428e-4bec-9fd3-6e8ba11384f4\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-xbr7x" Aug 05 17:14:43.581649 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:14:43.581553 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 05 17:14:43.581649 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:14:43.581623 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e59498-428e-4bec-9fd3-6e8ba11384f4-cluster-monitoring-operator-tls podName:12e59498-428e-4bec-9fd3-6e8ba11384f4 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:44.58160563 +0000 UTC m=+135.754129537 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/12e59498-428e-4bec-9fd3-6e8ba11384f4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-xbr7x" (UID: "12e59498-428e-4bec-9fd3-6e8ba11384f4") : secret "cluster-monitoring-operator-tls" not found Aug 05 17:14:43.895892 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:43.895806 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-tdhz6" event={"ID":"1d3ccb1f-4b5b-47da-a4e4-d60ac0a8b2f4","Type":"ContainerStarted","Data":"ac7c0cd10ab8524e615adbe60bc001aa3befa68dd428c09648b54600437828b3"} Aug 05 17:14:44.590705 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:44.590614 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/12e59498-428e-4bec-9fd3-6e8ba11384f4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-xbr7x\" (UID: \"12e59498-428e-4bec-9fd3-6e8ba11384f4\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-xbr7x" Aug 05 17:14:44.590892 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:14:44.590759 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 05 17:14:44.590892 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:14:44.590834 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e59498-428e-4bec-9fd3-6e8ba11384f4-cluster-monitoring-operator-tls podName:12e59498-428e-4bec-9fd3-6e8ba11384f4 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:46.590816937 +0000 UTC m=+137.763340826 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/12e59498-428e-4bec-9fd3-6e8ba11384f4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-xbr7x" (UID: "12e59498-428e-4bec-9fd3-6e8ba11384f4") : secret "cluster-monitoring-operator-tls" not found Aug 05 17:14:44.901267 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:44.901177 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-tdhz6" event={"ID":"1d3ccb1f-4b5b-47da-a4e4-d60ac0a8b2f4","Type":"ContainerStarted","Data":"4e15af27ee957c8bc36fba617acd64999dd8c36055fb1bdf3a9858bd0832af02"} Aug 05 17:14:44.918582 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:44.918540 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-tdhz6" podStartSLOduration=1.911306174 podStartE2EDuration="2.918526883s" totalImagesPullingTime="1.007220709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:14:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:14:44.918404618 +0000 UTC m=+136.090928529" watchObservedRunningTime="2026-08-05 17:14:44.918526883 +0000 UTC m=+136.091050794" Aug 05 17:14:46.603146 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:46.603106 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/12e59498-428e-4bec-9fd3-6e8ba11384f4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-xbr7x\" (UID: \"12e59498-428e-4bec-9fd3-6e8ba11384f4\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-xbr7x" Aug 05 17:14:46.603549 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:14:46.603271 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 05 17:14:46.603549 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:14:46.603367 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e59498-428e-4bec-9fd3-6e8ba11384f4-cluster-monitoring-operator-tls podName:12e59498-428e-4bec-9fd3-6e8ba11384f4 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:50.603330153 +0000 UTC m=+141.775854043 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/12e59498-428e-4bec-9fd3-6e8ba11384f4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-xbr7x" (UID: "12e59498-428e-4bec-9fd3-6e8ba11384f4") : secret "cluster-monitoring-operator-tls" not found Aug 05 17:14:46.996293 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:46.996261 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-sj8rd"] Aug 05 17:14:46.998118 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:46.998102 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-sj8rd" Aug 05 17:14:47.004474 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:47.004448 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lbpz\" (UniqueName: \"kubernetes.io/projected/ab585e0e-4903-475a-9e16-5cec636ebe3b-kube-api-access-2lbpz\") pod \"network-check-source-65bdbbff45-sj8rd\" (UID: \"ab585e0e-4903-475a-9e16-5cec636ebe3b\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-sj8rd" Aug 05 17:14:47.004581 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:47.004476 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-9pd59\"" Aug 05 17:14:47.014439 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:47.014417 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-sj8rd"] Aug 05 17:14:47.105533 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:47.105495 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lbpz\" (UniqueName: \"kubernetes.io/projected/ab585e0e-4903-475a-9e16-5cec636ebe3b-kube-api-access-2lbpz\") pod \"network-check-source-65bdbbff45-sj8rd\" (UID: \"ab585e0e-4903-475a-9e16-5cec636ebe3b\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-sj8rd" Aug 05 17:14:47.116449 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:47.116419 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lbpz\" (UniqueName: \"kubernetes.io/projected/ab585e0e-4903-475a-9e16-5cec636ebe3b-kube-api-access-2lbpz\") pod \"network-check-source-65bdbbff45-sj8rd\" (UID: \"ab585e0e-4903-475a-9e16-5cec636ebe3b\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-sj8rd" Aug 05 17:14:47.307019 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:47.306919 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-sj8rd" Aug 05 17:14:47.432907 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:47.432813 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-sj8rd"] Aug 05 17:14:47.435238 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:14:47.435202 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab585e0e_4903_475a_9e16_5cec636ebe3b.slice/crio-3733ae09cb8b090b09b9dc1b37d26dc1adb48dd085e02c437f2f5a095bfe97d4 WatchSource:0}: Error finding container 3733ae09cb8b090b09b9dc1b37d26dc1adb48dd085e02c437f2f5a095bfe97d4: Status 404 returned error can't find the container with id 3733ae09cb8b090b09b9dc1b37d26dc1adb48dd085e02c437f2f5a095bfe97d4 Aug 05 17:14:47.913533 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:47.913494 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-sj8rd" event={"ID":"ab585e0e-4903-475a-9e16-5cec636ebe3b","Type":"ContainerStarted","Data":"a1050a3eb4aa1b435f4ca6f66b6ad7e8f3f86559357c626f31abf5acf78f885f"} Aug 05 17:14:47.913902 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:47.913554 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-sj8rd" event={"ID":"ab585e0e-4903-475a-9e16-5cec636ebe3b","Type":"ContainerStarted","Data":"3733ae09cb8b090b09b9dc1b37d26dc1adb48dd085e02c437f2f5a095bfe97d4"} Aug 05 17:14:47.947199 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:47.947145 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-sj8rd" podStartSLOduration=1.947124557 podStartE2EDuration="1.947124557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:14:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:14:47.946502022 +0000 UTC m=+139.119025944" watchObservedRunningTime="2026-08-05 17:14:47.947124557 +0000 UTC m=+139.119648469" Aug 05 17:14:47.981628 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:47.981593 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-98cmk"] Aug 05 17:14:47.984084 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:47.984065 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-98cmk" Aug 05 17:14:47.987118 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:47.987095 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-xch8h\"" Aug 05 17:14:47.987415 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:47.987395 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Aug 05 17:14:47.987518 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:47.987395 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Aug 05 17:14:47.995079 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:47.995056 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-98cmk"] Aug 05 17:14:48.011218 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:48.011182 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj7vh\" (UniqueName: \"kubernetes.io/projected/c022ed4e-1cbe-4053-aad8-56fd09fe9376-kube-api-access-wj7vh\") pod \"migrator-68bc745d87-98cmk\" (UID: \"c022ed4e-1cbe-4053-aad8-56fd09fe9376\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-98cmk" Aug 05 17:14:48.112540 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:48.112495 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj7vh\" (UniqueName: \"kubernetes.io/projected/c022ed4e-1cbe-4053-aad8-56fd09fe9376-kube-api-access-wj7vh\") pod \"migrator-68bc745d87-98cmk\" (UID: \"c022ed4e-1cbe-4053-aad8-56fd09fe9376\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-98cmk" Aug 05 17:14:48.129395 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:48.129362 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj7vh\" (UniqueName: \"kubernetes.io/projected/c022ed4e-1cbe-4053-aad8-56fd09fe9376-kube-api-access-wj7vh\") pod \"migrator-68bc745d87-98cmk\" (UID: \"c022ed4e-1cbe-4053-aad8-56fd09fe9376\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-98cmk" Aug 05 17:14:48.163730 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:48.163476 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-r2dtl"] Aug 05 17:14:48.169926 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:48.169902 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r2dtl" Aug 05 17:14:48.174713 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:48.174688 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7l8s7\"" Aug 05 17:14:48.174713 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:48.174712 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Aug 05 17:14:48.174909 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:48.174759 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Aug 05 17:14:48.175544 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:48.175514 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Aug 05 17:14:48.175544 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:48.175531 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Aug 05 17:14:48.188009 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:48.187981 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r2dtl"] Aug 05 17:14:48.213708 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:48.213677 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-crio-socket\") pod \"insights-runtime-extractor-r2dtl\" (UID: \"96ad42ff-12a1-45b4-9481-2e6daa28ff2d\") " pod="openshift-insights/insights-runtime-extractor-r2dtl" Aug 05 17:14:48.213830 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:48.213722 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r2dtl\" (UID: \"96ad42ff-12a1-45b4-9481-2e6daa28ff2d\") " pod="openshift-insights/insights-runtime-extractor-r2dtl" Aug 05 17:14:48.213830 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:48.213753 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r2dtl\" (UID: \"96ad42ff-12a1-45b4-9481-2e6daa28ff2d\") " pod="openshift-insights/insights-runtime-extractor-r2dtl" Aug 05 17:14:48.213830 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:48.213795 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-data-volume\") pod \"insights-runtime-extractor-r2dtl\" (UID: \"96ad42ff-12a1-45b4-9481-2e6daa28ff2d\") " pod="openshift-insights/insights-runtime-extractor-r2dtl" Aug 05 17:14:48.213927 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:48.213841 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xdbl\" (UniqueName: \"kubernetes.io/projected/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-kube-api-access-2xdbl\") pod \"insights-runtime-extractor-r2dtl\" (UID: \"96ad42ff-12a1-45b4-9481-2e6daa28ff2d\") " pod="openshift-insights/insights-runtime-extractor-r2dtl" Aug 05 17:14:48.292676 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:48.292642 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-98cmk" Aug 05 17:14:48.314141 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:48.314110 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-crio-socket\") pod \"insights-runtime-extractor-r2dtl\" (UID: \"96ad42ff-12a1-45b4-9481-2e6daa28ff2d\") " pod="openshift-insights/insights-runtime-extractor-r2dtl" Aug 05 17:14:48.314278 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:48.314148 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r2dtl\" (UID: \"96ad42ff-12a1-45b4-9481-2e6daa28ff2d\") " pod="openshift-insights/insights-runtime-extractor-r2dtl" Aug 05 17:14:48.314278 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:48.314168 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r2dtl\" (UID: \"96ad42ff-12a1-45b4-9481-2e6daa28ff2d\") " pod="openshift-insights/insights-runtime-extractor-r2dtl" Aug 05 17:14:48.314278 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:48.314215 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-data-volume\") pod \"insights-runtime-extractor-r2dtl\" (UID: \"96ad42ff-12a1-45b4-9481-2e6daa28ff2d\") " pod="openshift-insights/insights-runtime-extractor-r2dtl" Aug 05 17:14:48.314278 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:48.314238 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xdbl\" (UniqueName: \"kubernetes.io/projected/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-kube-api-access-2xdbl\") pod \"insights-runtime-extractor-r2dtl\" (UID: \"96ad42ff-12a1-45b4-9481-2e6daa28ff2d\") " pod="openshift-insights/insights-runtime-extractor-r2dtl" Aug 05 17:14:48.314278 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:48.314239 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-crio-socket\") pod \"insights-runtime-extractor-r2dtl\" (UID: \"96ad42ff-12a1-45b4-9481-2e6daa28ff2d\") " pod="openshift-insights/insights-runtime-extractor-r2dtl" Aug 05 17:14:48.314278 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:14:48.314275 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 17:14:48.314614 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:14:48.314285 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 05 17:14:48.314614 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:14:48.314366 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-insights-runtime-extractor-tls podName:96ad42ff-12a1-45b4-9481-2e6daa28ff2d nodeName:}" failed. No retries permitted until 2026-08-05 17:14:48.814330917 +0000 UTC m=+139.986854813 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r2dtl" (UID: "96ad42ff-12a1-45b4-9481-2e6daa28ff2d") : secret "insights-runtime-extractor-tls" not found Aug 05 17:14:48.314614 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:14:48.314416 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-kube-rbac-proxy-cm podName:96ad42ff-12a1-45b4-9481-2e6daa28ff2d nodeName:}" failed. No retries permitted until 2026-08-05 17:14:48.81439724 +0000 UTC m=+139.986921129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r2dtl" (UID: "96ad42ff-12a1-45b4-9481-2e6daa28ff2d") : configmap "kube-rbac-proxy" not found Aug 05 17:14:48.314756 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:48.314631 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-data-volume\") pod \"insights-runtime-extractor-r2dtl\" (UID: \"96ad42ff-12a1-45b4-9481-2e6daa28ff2d\") " pod="openshift-insights/insights-runtime-extractor-r2dtl" Aug 05 17:14:48.326060 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:48.326030 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xdbl\" (UniqueName: \"kubernetes.io/projected/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-kube-api-access-2xdbl\") pod \"insights-runtime-extractor-r2dtl\" (UID: \"96ad42ff-12a1-45b4-9481-2e6daa28ff2d\") " pod="openshift-insights/insights-runtime-extractor-r2dtl" Aug 05 17:14:48.419911 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:48.419843 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-98cmk"] Aug 05 17:14:48.423078 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:14:48.423051 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc022ed4e_1cbe_4053_aad8_56fd09fe9376.slice/crio-e13733a28850f6ec40c5a1bb029c4afd584455db21d55b4af46fa1984c3af594 WatchSource:0}: Error finding container e13733a28850f6ec40c5a1bb029c4afd584455db21d55b4af46fa1984c3af594: Status 404 returned error can't find the container with id e13733a28850f6ec40c5a1bb029c4afd584455db21d55b4af46fa1984c3af594 Aug 05 17:14:48.816549 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:48.816510 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r2dtl\" (UID: \"96ad42ff-12a1-45b4-9481-2e6daa28ff2d\") " pod="openshift-insights/insights-runtime-extractor-r2dtl" Aug 05 17:14:48.816549 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:48.816554 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r2dtl\" (UID: \"96ad42ff-12a1-45b4-9481-2e6daa28ff2d\") " pod="openshift-insights/insights-runtime-extractor-r2dtl" Aug 05 17:14:48.816756 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:14:48.816626 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 05 17:14:48.816756 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:14:48.816666 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 17:14:48.816756 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:14:48.816684 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-kube-rbac-proxy-cm podName:96ad42ff-12a1-45b4-9481-2e6daa28ff2d nodeName:}" failed. No retries permitted until 2026-08-05 17:14:49.816666761 +0000 UTC m=+140.989190650 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r2dtl" (UID: "96ad42ff-12a1-45b4-9481-2e6daa28ff2d") : configmap "kube-rbac-proxy" not found Aug 05 17:14:48.816756 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:14:48.816726 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-insights-runtime-extractor-tls podName:96ad42ff-12a1-45b4-9481-2e6daa28ff2d nodeName:}" failed. No retries permitted until 2026-08-05 17:14:49.816708942 +0000 UTC m=+140.989232848 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r2dtl" (UID: "96ad42ff-12a1-45b4-9481-2e6daa28ff2d") : secret "insights-runtime-extractor-tls" not found Aug 05 17:14:48.919111 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:48.919070 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-98cmk" event={"ID":"c022ed4e-1cbe-4053-aad8-56fd09fe9376","Type":"ContainerStarted","Data":"e13733a28850f6ec40c5a1bb029c4afd584455db21d55b4af46fa1984c3af594"} Aug 05 17:14:49.823537 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:49.823446 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r2dtl\" (UID: \"96ad42ff-12a1-45b4-9481-2e6daa28ff2d\") " pod="openshift-insights/insights-runtime-extractor-r2dtl" Aug 05 17:14:49.823537 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:49.823484 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r2dtl\" (UID: \"96ad42ff-12a1-45b4-9481-2e6daa28ff2d\") " pod="openshift-insights/insights-runtime-extractor-r2dtl" Aug 05 17:14:49.823734 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:14:49.823593 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 17:14:49.823734 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:14:49.823617 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 05 17:14:49.823734 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:14:49.823660 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-insights-runtime-extractor-tls podName:96ad42ff-12a1-45b4-9481-2e6daa28ff2d nodeName:}" failed. No retries permitted until 2026-08-05 17:14:51.823644787 +0000 UTC m=+142.996168676 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r2dtl" (UID: "96ad42ff-12a1-45b4-9481-2e6daa28ff2d") : secret "insights-runtime-extractor-tls" not found Aug 05 17:14:49.823734 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:14:49.823674 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-kube-rbac-proxy-cm podName:96ad42ff-12a1-45b4-9481-2e6daa28ff2d nodeName:}" failed. No retries permitted until 2026-08-05 17:14:51.823667811 +0000 UTC m=+142.996191700 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r2dtl" (UID: "96ad42ff-12a1-45b4-9481-2e6daa28ff2d") : configmap "kube-rbac-proxy" not found Aug 05 17:14:49.923457 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:49.923418 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-98cmk" event={"ID":"c022ed4e-1cbe-4053-aad8-56fd09fe9376","Type":"ContainerStarted","Data":"5793a2b730164ca901b2603f91c500c78bb80ee0b028b3f9d67fa75e45b5749e"} Aug 05 17:14:49.923818 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:49.923480 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-98cmk" event={"ID":"c022ed4e-1cbe-4053-aad8-56fd09fe9376","Type":"ContainerStarted","Data":"08910fb215b97411ebe196971ef62780c918440a0a86b247b9dd2d266c64c313"} Aug 05 17:14:50.629273 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:50.629214 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/12e59498-428e-4bec-9fd3-6e8ba11384f4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-xbr7x\" (UID: \"12e59498-428e-4bec-9fd3-6e8ba11384f4\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-xbr7x" Aug 05 17:14:50.629477 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:14:50.629396 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 05 17:14:50.629519 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:14:50.629489 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e59498-428e-4bec-9fd3-6e8ba11384f4-cluster-monitoring-operator-tls podName:12e59498-428e-4bec-9fd3-6e8ba11384f4 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:58.629472398 +0000 UTC m=+149.801996287 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/12e59498-428e-4bec-9fd3-6e8ba11384f4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-xbr7x" (UID: "12e59498-428e-4bec-9fd3-6e8ba11384f4") : secret "cluster-monitoring-operator-tls" not found Aug 05 17:14:51.075791 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:51.075760 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x92vq_71a8ffdb-65f6-4e21-9ebf-a37111978c48/dns-node-resolver/0.log" Aug 05 17:14:51.674828 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:51.674797 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hm4pp_202de948-1d6f-4d03-a580-2e38f89164a1/node-ca/0.log" Aug 05 17:14:51.838889 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:51.838846 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r2dtl\" (UID: \"96ad42ff-12a1-45b4-9481-2e6daa28ff2d\") " pod="openshift-insights/insights-runtime-extractor-r2dtl" Aug 05 17:14:51.838889 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:51.838895 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r2dtl\" (UID: \"96ad42ff-12a1-45b4-9481-2e6daa28ff2d\") " pod="openshift-insights/insights-runtime-extractor-r2dtl" Aug 05 17:14:51.839141 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:14:51.838996 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 05 17:14:51.839141 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:14:51.839015 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 17:14:51.839141 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:14:51.839073 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-kube-rbac-proxy-cm podName:96ad42ff-12a1-45b4-9481-2e6daa28ff2d nodeName:}" failed. No retries permitted until 2026-08-05 17:14:55.839054674 +0000 UTC m=+147.011578577 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r2dtl" (UID: "96ad42ff-12a1-45b4-9481-2e6daa28ff2d") : configmap "kube-rbac-proxy" not found Aug 05 17:14:51.839141 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:14:51.839091 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-insights-runtime-extractor-tls podName:96ad42ff-12a1-45b4-9481-2e6daa28ff2d nodeName:}" failed. No retries permitted until 2026-08-05 17:14:55.839083326 +0000 UTC m=+147.011607215 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r2dtl" (UID: "96ad42ff-12a1-45b4-9481-2e6daa28ff2d") : secret "insights-runtime-extractor-tls" not found Aug 05 17:14:52.895092 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:52.895068 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xwr4m_95b2fee7-9604-40e1-8a29-f86363c5991e/serve-healthcheck-canary/0.log" Aug 05 17:14:53.083230 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:53.083203 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-98cmk_c022ed4e-1cbe-4053-aad8-56fd09fe9376/migrator/0.log" Aug 05 17:14:53.275448 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:53.275424 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-98cmk_c022ed4e-1cbe-4053-aad8-56fd09fe9376/graceful-termination/0.log" Aug 05 17:14:55.868201 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:55.868164 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r2dtl\" (UID: \"96ad42ff-12a1-45b4-9481-2e6daa28ff2d\") " pod="openshift-insights/insights-runtime-extractor-r2dtl" Aug 05 17:14:55.868201 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:55.868201 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r2dtl\" (UID: \"96ad42ff-12a1-45b4-9481-2e6daa28ff2d\") " pod="openshift-insights/insights-runtime-extractor-r2dtl" Aug 05 17:14:55.868704 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:14:55.868281 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 05 17:14:55.868704 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:14:55.868326 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 17:14:55.868704 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:14:55.868359 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-kube-rbac-proxy-cm podName:96ad42ff-12a1-45b4-9481-2e6daa28ff2d nodeName:}" failed. No retries permitted until 2026-08-05 17:15:03.868328985 +0000 UTC m=+155.040852875 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r2dtl" (UID: "96ad42ff-12a1-45b4-9481-2e6daa28ff2d") : configmap "kube-rbac-proxy" not found Aug 05 17:14:55.868704 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:14:55.868429 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-insights-runtime-extractor-tls podName:96ad42ff-12a1-45b4-9481-2e6daa28ff2d nodeName:}" failed. No retries permitted until 2026-08-05 17:15:03.868411054 +0000 UTC m=+155.040934946 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r2dtl" (UID: "96ad42ff-12a1-45b4-9481-2e6daa28ff2d") : secret "insights-runtime-extractor-tls" not found Aug 05 17:14:58.689358 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:14:58.689297 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/12e59498-428e-4bec-9fd3-6e8ba11384f4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-xbr7x\" (UID: \"12e59498-428e-4bec-9fd3-6e8ba11384f4\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-xbr7x" Aug 05 17:14:58.689843 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:14:58.689477 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 05 17:14:58.689843 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:14:58.689567 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e59498-428e-4bec-9fd3-6e8ba11384f4-cluster-monitoring-operator-tls podName:12e59498-428e-4bec-9fd3-6e8ba11384f4 nodeName:}" failed. No retries permitted until 2026-08-05 17:15:14.68954531 +0000 UTC m=+165.862069199 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/12e59498-428e-4bec-9fd3-6e8ba11384f4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-xbr7x" (UID: "12e59498-428e-4bec-9fd3-6e8ba11384f4") : secret "cluster-monitoring-operator-tls" not found Aug 05 17:15:03.930047 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:03.930011 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r2dtl\" (UID: \"96ad42ff-12a1-45b4-9481-2e6daa28ff2d\") " pod="openshift-insights/insights-runtime-extractor-r2dtl" Aug 05 17:15:03.930047 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:03.930049 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r2dtl\" (UID: \"96ad42ff-12a1-45b4-9481-2e6daa28ff2d\") " pod="openshift-insights/insights-runtime-extractor-r2dtl" Aug 05 17:15:03.930642 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:03.930564 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r2dtl\" (UID: \"96ad42ff-12a1-45b4-9481-2e6daa28ff2d\") " pod="openshift-insights/insights-runtime-extractor-r2dtl" Aug 05 17:15:03.932490 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:03.932463 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/96ad42ff-12a1-45b4-9481-2e6daa28ff2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r2dtl\" (UID: \"96ad42ff-12a1-45b4-9481-2e6daa28ff2d\") " pod="openshift-insights/insights-runtime-extractor-r2dtl" Aug 05 17:15:04.079768 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:04.079727 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r2dtl" Aug 05 17:15:04.213867 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:04.213770 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-98cmk" podStartSLOduration=16.075257276 podStartE2EDuration="17.213752069s" totalImagesPullingTime="1.138494793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:14:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:14:49.946194324 +0000 UTC m=+141.118718236" watchObservedRunningTime="2026-08-05 17:15:04.213752069 +0000 UTC m=+155.386275980" Aug 05 17:15:04.214613 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:04.214422 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r2dtl"] Aug 05 17:15:04.219448 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:15:04.219401 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96ad42ff_12a1_45b4_9481_2e6daa28ff2d.slice/crio-67677e72497416c477ab8569f818d4ba0a2fa47b65d591827613749ba405f40b WatchSource:0}: Error finding container 67677e72497416c477ab8569f818d4ba0a2fa47b65d591827613749ba405f40b: Status 404 returned error can't find the container with id 67677e72497416c477ab8569f818d4ba0a2fa47b65d591827613749ba405f40b Aug 05 17:15:04.968725 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:04.968681 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r2dtl" event={"ID":"96ad42ff-12a1-45b4-9481-2e6daa28ff2d","Type":"ContainerStarted","Data":"c77d5f03e9bcc1be91396db0e24e54823392c00a34c0eb205aff183f0e513a2d"} Aug 05 17:15:04.969086 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:04.968756 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r2dtl" event={"ID":"96ad42ff-12a1-45b4-9481-2e6daa28ff2d","Type":"ContainerStarted","Data":"67677e72497416c477ab8569f818d4ba0a2fa47b65d591827613749ba405f40b"} Aug 05 17:15:05.973774 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:05.973725 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r2dtl" event={"ID":"96ad42ff-12a1-45b4-9481-2e6daa28ff2d","Type":"ContainerStarted","Data":"7fece569e1eaf19b68e17163553b3f8c217167e93a2623261138354a282147da"} Aug 05 17:15:06.746436 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:15:06.746404 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-87z42" podUID="7eb0a9c9-9673-426a-9db6-52bd7454b2e3" Aug 05 17:15:06.978503 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:06.978469 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-87z42" Aug 05 17:15:06.978928 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:06.978507 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r2dtl" event={"ID":"96ad42ff-12a1-45b4-9481-2e6daa28ff2d","Type":"ContainerStarted","Data":"620f889fcbe10ed4358c319b63515e3259042a74e44626d116bea9d172f391c2"} Aug 05 17:15:07.007070 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:07.006977 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-r2dtl" podStartSLOduration=16.942595344 podStartE2EDuration="19.006961769s" totalImagesPullingTime="2.064366425s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:14:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:07.006580015 +0000 UTC m=+158.179103929" watchObservedRunningTime="2026-08-05 17:15:07.006961769 +0000 UTC m=+158.179485680" Aug 05 17:15:08.464873 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:15:08.464832 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-smhw9" podUID="4618f8d9-07bc-4de7-9c7c-b09d7fe9d923" Aug 05 17:15:09.508927 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:09.508871 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5b6564796c-6l4mt"] Aug 05 17:15:09.511028 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:09.511011 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b6564796c-6l4mt" Aug 05 17:15:09.513706 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:09.513686 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Aug 05 17:15:09.514116 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:09.514102 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-g4tv2\"" Aug 05 17:15:09.515489 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:09.515472 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Aug 05 17:15:09.515589 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:09.515563 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Aug 05 17:15:09.519530 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:09.519505 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Aug 05 17:15:09.539627 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:09.539599 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b6564796c-6l4mt"] Aug 05 17:15:09.569931 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:09.569900 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg6k8\" (UniqueName: \"kubernetes.io/projected/7a2ac39e-2891-48a5-8141-69278698a16a-kube-api-access-zg6k8\") pod \"image-registry-5b6564796c-6l4mt\" (UID: \"7a2ac39e-2891-48a5-8141-69278698a16a\") " pod="openshift-image-registry/image-registry-5b6564796c-6l4mt" Aug 05 17:15:09.570081 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:09.569948 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7a2ac39e-2891-48a5-8141-69278698a16a-image-registry-private-configuration\") pod \"image-registry-5b6564796c-6l4mt\" (UID: \"7a2ac39e-2891-48a5-8141-69278698a16a\") " pod="openshift-image-registry/image-registry-5b6564796c-6l4mt" Aug 05 17:15:09.570081 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:09.569971 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7a2ac39e-2891-48a5-8141-69278698a16a-bound-sa-token\") pod \"image-registry-5b6564796c-6l4mt\" (UID: \"7a2ac39e-2891-48a5-8141-69278698a16a\") " pod="openshift-image-registry/image-registry-5b6564796c-6l4mt" Aug 05 17:15:09.570081 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:09.570060 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7a2ac39e-2891-48a5-8141-69278698a16a-installation-pull-secrets\") pod \"image-registry-5b6564796c-6l4mt\" (UID: \"7a2ac39e-2891-48a5-8141-69278698a16a\") " pod="openshift-image-registry/image-registry-5b6564796c-6l4mt" Aug 05 17:15:09.570195 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:09.570087 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7a2ac39e-2891-48a5-8141-69278698a16a-registry-tls\") pod \"image-registry-5b6564796c-6l4mt\" (UID: \"7a2ac39e-2891-48a5-8141-69278698a16a\") " pod="openshift-image-registry/image-registry-5b6564796c-6l4mt" Aug 05 17:15:09.570195 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:09.570105 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7a2ac39e-2891-48a5-8141-69278698a16a-ca-trust-extracted\") pod \"image-registry-5b6564796c-6l4mt\" (UID: \"7a2ac39e-2891-48a5-8141-69278698a16a\") " pod="openshift-image-registry/image-registry-5b6564796c-6l4mt" Aug 05 17:15:09.570195 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:09.570119 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a2ac39e-2891-48a5-8141-69278698a16a-trusted-ca\") pod \"image-registry-5b6564796c-6l4mt\" (UID: \"7a2ac39e-2891-48a5-8141-69278698a16a\") " pod="openshift-image-registry/image-registry-5b6564796c-6l4mt" Aug 05 17:15:09.570195 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:09.570186 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7a2ac39e-2891-48a5-8141-69278698a16a-registry-certificates\") pod \"image-registry-5b6564796c-6l4mt\" (UID: \"7a2ac39e-2891-48a5-8141-69278698a16a\") " pod="openshift-image-registry/image-registry-5b6564796c-6l4mt" Aug 05 17:15:09.670932 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:09.670902 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7a2ac39e-2891-48a5-8141-69278698a16a-installation-pull-secrets\") pod \"image-registry-5b6564796c-6l4mt\" (UID: \"7a2ac39e-2891-48a5-8141-69278698a16a\") " pod="openshift-image-registry/image-registry-5b6564796c-6l4mt" Aug 05 17:15:09.671040 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:09.670940 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7a2ac39e-2891-48a5-8141-69278698a16a-registry-tls\") pod \"image-registry-5b6564796c-6l4mt\" (UID: \"7a2ac39e-2891-48a5-8141-69278698a16a\") " pod="openshift-image-registry/image-registry-5b6564796c-6l4mt" Aug 05 17:15:09.671040 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:09.670957 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7a2ac39e-2891-48a5-8141-69278698a16a-ca-trust-extracted\") pod \"image-registry-5b6564796c-6l4mt\" (UID: \"7a2ac39e-2891-48a5-8141-69278698a16a\") " pod="openshift-image-registry/image-registry-5b6564796c-6l4mt" Aug 05 17:15:09.671040 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:09.670975 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a2ac39e-2891-48a5-8141-69278698a16a-trusted-ca\") pod \"image-registry-5b6564796c-6l4mt\" (UID: \"7a2ac39e-2891-48a5-8141-69278698a16a\") " pod="openshift-image-registry/image-registry-5b6564796c-6l4mt" Aug 05 17:15:09.671040 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:09.671029 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7a2ac39e-2891-48a5-8141-69278698a16a-registry-certificates\") pod \"image-registry-5b6564796c-6l4mt\" (UID: \"7a2ac39e-2891-48a5-8141-69278698a16a\") " pod="openshift-image-registry/image-registry-5b6564796c-6l4mt" Aug 05 17:15:09.671230 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:09.671067 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg6k8\" (UniqueName: \"kubernetes.io/projected/7a2ac39e-2891-48a5-8141-69278698a16a-kube-api-access-zg6k8\") pod \"image-registry-5b6564796c-6l4mt\" (UID: \"7a2ac39e-2891-48a5-8141-69278698a16a\") " pod="openshift-image-registry/image-registry-5b6564796c-6l4mt" Aug 05 17:15:09.671230 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:09.671124 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7a2ac39e-2891-48a5-8141-69278698a16a-image-registry-private-configuration\") pod \"image-registry-5b6564796c-6l4mt\" (UID: \"7a2ac39e-2891-48a5-8141-69278698a16a\") " pod="openshift-image-registry/image-registry-5b6564796c-6l4mt" Aug 05 17:15:09.671230 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:09.671153 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7a2ac39e-2891-48a5-8141-69278698a16a-bound-sa-token\") pod \"image-registry-5b6564796c-6l4mt\" (UID: \"7a2ac39e-2891-48a5-8141-69278698a16a\") " pod="openshift-image-registry/image-registry-5b6564796c-6l4mt" Aug 05 17:15:09.671487 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:09.671463 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7a2ac39e-2891-48a5-8141-69278698a16a-ca-trust-extracted\") pod \"image-registry-5b6564796c-6l4mt\" (UID: \"7a2ac39e-2891-48a5-8141-69278698a16a\") " pod="openshift-image-registry/image-registry-5b6564796c-6l4mt" Aug 05 17:15:09.671969 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:09.671942 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7a2ac39e-2891-48a5-8141-69278698a16a-registry-certificates\") pod \"image-registry-5b6564796c-6l4mt\" (UID: \"7a2ac39e-2891-48a5-8141-69278698a16a\") " pod="openshift-image-registry/image-registry-5b6564796c-6l4mt" Aug 05 17:15:09.672133 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:09.672109 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a2ac39e-2891-48a5-8141-69278698a16a-trusted-ca\") pod \"image-registry-5b6564796c-6l4mt\" (UID: \"7a2ac39e-2891-48a5-8141-69278698a16a\") " pod="openshift-image-registry/image-registry-5b6564796c-6l4mt" Aug 05 17:15:09.673397 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:09.673377 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7a2ac39e-2891-48a5-8141-69278698a16a-installation-pull-secrets\") pod \"image-registry-5b6564796c-6l4mt\" (UID: \"7a2ac39e-2891-48a5-8141-69278698a16a\") " pod="openshift-image-registry/image-registry-5b6564796c-6l4mt" Aug 05 17:15:09.673533 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:09.673512 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7a2ac39e-2891-48a5-8141-69278698a16a-image-registry-private-configuration\") pod \"image-registry-5b6564796c-6l4mt\" (UID: \"7a2ac39e-2891-48a5-8141-69278698a16a\") " pod="openshift-image-registry/image-registry-5b6564796c-6l4mt" Aug 05 17:15:09.673684 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:09.673669 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7a2ac39e-2891-48a5-8141-69278698a16a-registry-tls\") pod \"image-registry-5b6564796c-6l4mt\" (UID: \"7a2ac39e-2891-48a5-8141-69278698a16a\") " pod="openshift-image-registry/image-registry-5b6564796c-6l4mt" Aug 05 17:15:09.682780 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:09.682756 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7a2ac39e-2891-48a5-8141-69278698a16a-bound-sa-token\") pod \"image-registry-5b6564796c-6l4mt\" (UID: \"7a2ac39e-2891-48a5-8141-69278698a16a\") " pod="openshift-image-registry/image-registry-5b6564796c-6l4mt" Aug 05 17:15:09.685205 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:09.685177 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg6k8\" (UniqueName: \"kubernetes.io/projected/7a2ac39e-2891-48a5-8141-69278698a16a-kube-api-access-zg6k8\") pod \"image-registry-5b6564796c-6l4mt\" (UID: \"7a2ac39e-2891-48a5-8141-69278698a16a\") " pod="openshift-image-registry/image-registry-5b6564796c-6l4mt" Aug 05 17:15:09.821463 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:09.821375 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b6564796c-6l4mt" Aug 05 17:15:09.971556 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:09.971521 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b6564796c-6l4mt"] Aug 05 17:15:09.975166 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:15:09.975136 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a2ac39e_2891_48a5_8141_69278698a16a.slice/crio-5fe61828519010fb7012641a03775e39be4646461e9a4de14a1effb665de678c WatchSource:0}: Error finding container 5fe61828519010fb7012641a03775e39be4646461e9a4de14a1effb665de678c: Status 404 returned error can't find the container with id 5fe61828519010fb7012641a03775e39be4646461e9a4de14a1effb665de678c Aug 05 17:15:09.988650 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:09.988623 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b6564796c-6l4mt" event={"ID":"7a2ac39e-2891-48a5-8141-69278698a16a","Type":"ContainerStarted","Data":"5fe61828519010fb7012641a03775e39be4646461e9a4de14a1effb665de678c"} Aug 05 17:15:10.993377 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:10.993331 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b6564796c-6l4mt" event={"ID":"7a2ac39e-2891-48a5-8141-69278698a16a","Type":"ContainerStarted","Data":"bf119cb32a292f354cb9b323af466b4511f30fad3a061cf419d7e9d1d71b9dec"} Aug 05 17:15:10.993757 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:10.993442 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5b6564796c-6l4mt" Aug 05 17:15:11.588501 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:11.588465 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7eb0a9c9-9673-426a-9db6-52bd7454b2e3-metrics-tls\") pod \"dns-default-87z42\" (UID: \"7eb0a9c9-9673-426a-9db6-52bd7454b2e3\") " pod="openshift-dns/dns-default-87z42" Aug 05 17:15:11.590779 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:11.590759 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7eb0a9c9-9673-426a-9db6-52bd7454b2e3-metrics-tls\") pod \"dns-default-87z42\" (UID: \"7eb0a9c9-9673-426a-9db6-52bd7454b2e3\") " pod="openshift-dns/dns-default-87z42" Aug 05 17:15:11.783643 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:11.783613 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jxp5d\"" Aug 05 17:15:11.789850 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:11.789823 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-87z42" Aug 05 17:15:11.924912 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:11.924858 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5b6564796c-6l4mt" podStartSLOduration=2.924838502 podStartE2EDuration="2.924838502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:15:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:11.022640399 +0000 UTC m=+162.195164316" watchObservedRunningTime="2026-08-05 17:15:11.924838502 +0000 UTC m=+163.097362413" Aug 05 17:15:11.925258 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:11.925245 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-87z42"] Aug 05 17:15:11.928456 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:15:11.928427 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eb0a9c9_9673_426a_9db6_52bd7454b2e3.slice/crio-6d6113d6b3d48835546dd16173a9d95ca02d2e42ff188987cf740489e37319e0 WatchSource:0}: Error finding container 6d6113d6b3d48835546dd16173a9d95ca02d2e42ff188987cf740489e37319e0: Status 404 returned error can't find the container with id 6d6113d6b3d48835546dd16173a9d95ca02d2e42ff188987cf740489e37319e0 Aug 05 17:15:11.997431 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:11.997395 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-87z42" event={"ID":"7eb0a9c9-9673-426a-9db6-52bd7454b2e3","Type":"ContainerStarted","Data":"6d6113d6b3d48835546dd16173a9d95ca02d2e42ff188987cf740489e37319e0"} Aug 05 17:15:14.005895 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:14.005864 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-87z42" event={"ID":"7eb0a9c9-9673-426a-9db6-52bd7454b2e3","Type":"ContainerStarted","Data":"4e1bd3317e1454aa7bae10fc68d1f490fa4cb9603c9cd72325d512fc42c4b875"} Aug 05 17:15:14.006257 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:14.005915 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-87z42" event={"ID":"7eb0a9c9-9673-426a-9db6-52bd7454b2e3","Type":"ContainerStarted","Data":"e815020c530cc36a250408de783abf963991b0ac8b33b3cbea137bff39a969b8"} Aug 05 17:15:14.006257 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:14.005972 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-87z42" Aug 05 17:15:14.027587 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:14.027542 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-87z42" podStartSLOduration=129.408126571 podStartE2EDuration="2m11.027527237s" totalImagesPullingTime="1.619400666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:13:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:14.026788387 +0000 UTC m=+165.199312299" watchObservedRunningTime="2026-08-05 17:15:14.027527237 +0000 UTC m=+165.200051149" Aug 05 17:15:14.713313 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:14.713276 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/12e59498-428e-4bec-9fd3-6e8ba11384f4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-xbr7x\" (UID: \"12e59498-428e-4bec-9fd3-6e8ba11384f4\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-xbr7x" Aug 05 17:15:14.715805 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:14.715772 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/12e59498-428e-4bec-9fd3-6e8ba11384f4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-xbr7x\" (UID: \"12e59498-428e-4bec-9fd3-6e8ba11384f4\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-xbr7x" Aug 05 17:15:14.945732 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:14.945681 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-xbr7x" Aug 05 17:15:15.076101 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:15.076071 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-xbr7x"] Aug 05 17:15:15.078969 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:15:15.078941 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12e59498_428e_4bec_9fd3_6e8ba11384f4.slice/crio-f7c8eb66a27d886dd0c8be333f8b0141e79ad1a8d94db1babae6895ced9108f4 WatchSource:0}: Error finding container f7c8eb66a27d886dd0c8be333f8b0141e79ad1a8d94db1babae6895ced9108f4: Status 404 returned error can't find the container with id f7c8eb66a27d886dd0c8be333f8b0141e79ad1a8d94db1babae6895ced9108f4 Aug 05 17:15:16.017088 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:16.017050 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-xbr7x" event={"ID":"12e59498-428e-4bec-9fd3-6e8ba11384f4","Type":"ContainerStarted","Data":"f7c8eb66a27d886dd0c8be333f8b0141e79ad1a8d94db1babae6895ced9108f4"} Aug 05 17:15:17.021934 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:17.021897 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-xbr7x" event={"ID":"12e59498-428e-4bec-9fd3-6e8ba11384f4","Type":"ContainerStarted","Data":"e7b3ddd01dc7ed3474cfe8fba2b3656a0dfffd7bd2c45b7ddd9fe1258281908b"} Aug 05 17:15:17.050326 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:17.050263 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-xbr7x" podStartSLOduration=33.304988861 podStartE2EDuration="35.050238825s" totalImagesPullingTime="1.745249964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:14:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:17.045566086 +0000 UTC m=+168.218089997" watchObservedRunningTime="2026-08-05 17:15:17.050238825 +0000 UTC m=+168.222762737" Aug 05 17:15:23.435361 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:23.435267 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smhw9" Aug 05 17:15:24.015458 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:24.015423 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-87z42" Aug 05 17:15:26.880730 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:26.880701 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-w5256"] Aug 05 17:15:26.882912 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:26.882892 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-42kbn"] Aug 05 17:15:26.883026 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:26.883007 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-w5256" Aug 05 17:15:26.885105 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:26.885083 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-42kbn" Aug 05 17:15:26.885567 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:26.885549 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Aug 05 17:15:26.885873 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:26.885855 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Aug 05 17:15:26.886094 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:26.886066 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-b8xwm\"" Aug 05 17:15:26.887061 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:26.887040 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Aug 05 17:15:26.887171 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:26.887087 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Aug 05 17:15:26.887493 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:26.887474 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Aug 05 17:15:26.887626 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:26.887480 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-m5z48\"" Aug 05 17:15:26.887626 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:26.887606 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Aug 05 17:15:26.887904 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:26.887889 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Aug 05 17:15:26.901043 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:26.901007 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-w5256"] Aug 05 17:15:27.013536 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.013496 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc2350ad-789a-4dab-8eef-7bc83a9936bf-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-w5256\" (UID: \"dc2350ad-789a-4dab-8eef-7bc83a9936bf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-w5256" Aug 05 17:15:27.013536 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.013538 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc2350ad-789a-4dab-8eef-7bc83a9936bf-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-w5256\" (UID: \"dc2350ad-789a-4dab-8eef-7bc83a9936bf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-w5256" Aug 05 17:15:27.013803 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.013563 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477-sys\") pod \"node-exporter-42kbn\" (UID: \"f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477\") " pod="openshift-monitoring/node-exporter-42kbn" Aug 05 17:15:27.013803 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.013629 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-42kbn\" (UID: \"f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477\") " pod="openshift-monitoring/node-exporter-42kbn" Aug 05 17:15:27.013803 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.013695 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc2350ad-789a-4dab-8eef-7bc83a9936bf-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-w5256\" (UID: \"dc2350ad-789a-4dab-8eef-7bc83a9936bf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-w5256" Aug 05 17:15:27.013803 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.013716 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477-node-exporter-tls\") pod \"node-exporter-42kbn\" (UID: \"f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477\") " pod="openshift-monitoring/node-exporter-42kbn" Aug 05 17:15:27.013803 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.013741 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znv4k\" (UniqueName: \"kubernetes.io/projected/f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477-kube-api-access-znv4k\") pod \"node-exporter-42kbn\" (UID: \"f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477\") " pod="openshift-monitoring/node-exporter-42kbn" Aug 05 17:15:27.014058 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.013825 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dc2350ad-789a-4dab-8eef-7bc83a9936bf-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-w5256\" (UID: \"dc2350ad-789a-4dab-8eef-7bc83a9936bf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-w5256" Aug 05 17:15:27.014058 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.013874 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dc2350ad-789a-4dab-8eef-7bc83a9936bf-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-w5256\" (UID: \"dc2350ad-789a-4dab-8eef-7bc83a9936bf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-w5256" Aug 05 17:15:27.014058 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.013920 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477-node-exporter-wtmp\") pod \"node-exporter-42kbn\" (UID: \"f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477\") " pod="openshift-monitoring/node-exporter-42kbn" Aug 05 17:15:27.014058 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.013952 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477-node-exporter-textfile\") pod \"node-exporter-42kbn\" (UID: \"f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477\") " pod="openshift-monitoring/node-exporter-42kbn" Aug 05 17:15:27.014058 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.014000 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477-node-exporter-accelerators-collector-config\") pod \"node-exporter-42kbn\" (UID: \"f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477\") " pod="openshift-monitoring/node-exporter-42kbn" Aug 05 17:15:27.014058 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.014036 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477-root\") pod \"node-exporter-42kbn\" (UID: \"f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477\") " pod="openshift-monitoring/node-exporter-42kbn" Aug 05 17:15:27.014263 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.014088 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfxnt\" (UniqueName: \"kubernetes.io/projected/dc2350ad-789a-4dab-8eef-7bc83a9936bf-kube-api-access-jfxnt\") pod \"kube-state-metrics-6bd9664c4-w5256\" (UID: \"dc2350ad-789a-4dab-8eef-7bc83a9936bf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-w5256" Aug 05 17:15:27.014263 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.014108 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477-metrics-client-ca\") pod \"node-exporter-42kbn\" (UID: \"f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477\") " pod="openshift-monitoring/node-exporter-42kbn" Aug 05 17:15:27.114844 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.114801 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477-node-exporter-accelerators-collector-config\") pod \"node-exporter-42kbn\" (UID: \"f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477\") " pod="openshift-monitoring/node-exporter-42kbn" Aug 05 17:15:27.114844 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.114843 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477-root\") pod \"node-exporter-42kbn\" (UID: \"f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477\") " pod="openshift-monitoring/node-exporter-42kbn" Aug 05 17:15:27.115117 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.114865 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfxnt\" (UniqueName: \"kubernetes.io/projected/dc2350ad-789a-4dab-8eef-7bc83a9936bf-kube-api-access-jfxnt\") pod \"kube-state-metrics-6bd9664c4-w5256\" (UID: \"dc2350ad-789a-4dab-8eef-7bc83a9936bf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-w5256" Aug 05 17:15:27.115117 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.114883 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477-metrics-client-ca\") pod \"node-exporter-42kbn\" (UID: \"f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477\") " pod="openshift-monitoring/node-exporter-42kbn" Aug 05 17:15:27.115117 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.114918 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc2350ad-789a-4dab-8eef-7bc83a9936bf-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-w5256\" (UID: \"dc2350ad-789a-4dab-8eef-7bc83a9936bf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-w5256" Aug 05 17:15:27.115117 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.114938 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc2350ad-789a-4dab-8eef-7bc83a9936bf-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-w5256\" (UID: \"dc2350ad-789a-4dab-8eef-7bc83a9936bf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-w5256" Aug 05 17:15:27.115117 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.114945 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477-root\") pod \"node-exporter-42kbn\" (UID: \"f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477\") " pod="openshift-monitoring/node-exporter-42kbn" Aug 05 17:15:27.115117 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.114953 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477-sys\") pod \"node-exporter-42kbn\" (UID: \"f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477\") " pod="openshift-monitoring/node-exporter-42kbn" Aug 05 17:15:27.115117 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.114986 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477-sys\") pod \"node-exporter-42kbn\" (UID: \"f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477\") " pod="openshift-monitoring/node-exporter-42kbn" Aug 05 17:15:27.115117 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.115019 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-42kbn\" (UID: \"f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477\") " pod="openshift-monitoring/node-exporter-42kbn" Aug 05 17:15:27.115117 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.115056 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc2350ad-789a-4dab-8eef-7bc83a9936bf-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-w5256\" (UID: \"dc2350ad-789a-4dab-8eef-7bc83a9936bf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-w5256" Aug 05 17:15:27.115117 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:15:27.115073 2562 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Aug 05 17:15:27.115117 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.115080 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477-node-exporter-tls\") pod \"node-exporter-42kbn\" (UID: \"f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477\") " pod="openshift-monitoring/node-exporter-42kbn" Aug 05 17:15:27.115678 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:15:27.115152 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc2350ad-789a-4dab-8eef-7bc83a9936bf-kube-state-metrics-tls podName:dc2350ad-789a-4dab-8eef-7bc83a9936bf nodeName:}" failed. No retries permitted until 2026-08-05 17:15:27.615131306 +0000 UTC m=+178.787655202 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/dc2350ad-789a-4dab-8eef-7bc83a9936bf-kube-state-metrics-tls") pod "kube-state-metrics-6bd9664c4-w5256" (UID: "dc2350ad-789a-4dab-8eef-7bc83a9936bf") : secret "kube-state-metrics-tls" not found Aug 05 17:15:27.115678 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.115279 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znv4k\" (UniqueName: \"kubernetes.io/projected/f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477-kube-api-access-znv4k\") pod \"node-exporter-42kbn\" (UID: \"f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477\") " pod="openshift-monitoring/node-exporter-42kbn" Aug 05 17:15:27.115678 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.115322 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dc2350ad-789a-4dab-8eef-7bc83a9936bf-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-w5256\" (UID: \"dc2350ad-789a-4dab-8eef-7bc83a9936bf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-w5256" Aug 05 17:15:27.115678 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.115387 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dc2350ad-789a-4dab-8eef-7bc83a9936bf-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-w5256\" (UID: \"dc2350ad-789a-4dab-8eef-7bc83a9936bf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-w5256" Aug 05 17:15:27.115678 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.115434 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477-node-exporter-wtmp\") pod \"node-exporter-42kbn\" (UID: \"f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477\") " pod="openshift-monitoring/node-exporter-42kbn" Aug 05 17:15:27.115678 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.115466 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477-node-exporter-textfile\") pod \"node-exporter-42kbn\" (UID: \"f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477\") " pod="openshift-monitoring/node-exporter-42kbn" Aug 05 17:15:27.115678 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.115599 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477-node-exporter-accelerators-collector-config\") pod \"node-exporter-42kbn\" (UID: \"f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477\") " pod="openshift-monitoring/node-exporter-42kbn" Aug 05 17:15:27.116027 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.115820 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477-node-exporter-wtmp\") pod \"node-exporter-42kbn\" (UID: \"f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477\") " pod="openshift-monitoring/node-exporter-42kbn" Aug 05 17:15:27.116027 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.115946 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc2350ad-789a-4dab-8eef-7bc83a9936bf-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-w5256\" (UID: \"dc2350ad-789a-4dab-8eef-7bc83a9936bf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-w5256" Aug 05 17:15:27.116027 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.115952 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477-node-exporter-textfile\") pod \"node-exporter-42kbn\" (UID: \"f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477\") " pod="openshift-monitoring/node-exporter-42kbn" Aug 05 17:15:27.116171 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.116106 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477-metrics-client-ca\") pod \"node-exporter-42kbn\" (UID: \"f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477\") " pod="openshift-monitoring/node-exporter-42kbn" Aug 05 17:15:27.116227 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.116183 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dc2350ad-789a-4dab-8eef-7bc83a9936bf-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-w5256\" (UID: \"dc2350ad-789a-4dab-8eef-7bc83a9936bf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-w5256" Aug 05 17:15:27.116285 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.116256 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dc2350ad-789a-4dab-8eef-7bc83a9936bf-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-w5256\" (UID: \"dc2350ad-789a-4dab-8eef-7bc83a9936bf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-w5256" Aug 05 17:15:27.117712 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.117693 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477-node-exporter-tls\") pod \"node-exporter-42kbn\" (UID: \"f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477\") " pod="openshift-monitoring/node-exporter-42kbn" Aug 05 17:15:27.117990 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.117969 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-42kbn\" (UID: \"f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477\") " pod="openshift-monitoring/node-exporter-42kbn" Aug 05 17:15:27.118169 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.118146 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc2350ad-789a-4dab-8eef-7bc83a9936bf-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-w5256\" (UID: \"dc2350ad-789a-4dab-8eef-7bc83a9936bf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-w5256" Aug 05 17:15:27.123935 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.123904 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfxnt\" (UniqueName: \"kubernetes.io/projected/dc2350ad-789a-4dab-8eef-7bc83a9936bf-kube-api-access-jfxnt\") pod \"kube-state-metrics-6bd9664c4-w5256\" (UID: \"dc2350ad-789a-4dab-8eef-7bc83a9936bf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-w5256" Aug 05 17:15:27.124599 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.124578 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znv4k\" (UniqueName: \"kubernetes.io/projected/f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477-kube-api-access-znv4k\") pod \"node-exporter-42kbn\" (UID: \"f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477\") " pod="openshift-monitoring/node-exporter-42kbn" Aug 05 17:15:27.199436 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.199325 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-42kbn" Aug 05 17:15:27.211908 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:15:27.211876 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9b2fc0c_d2d7_48c3_92fb_64c4d4e29477.slice/crio-9bb5ae3009c50ac7c168a83c3288f22c5c58684b2aef13a488605dcd10eb95ba WatchSource:0}: Error finding container 9bb5ae3009c50ac7c168a83c3288f22c5c58684b2aef13a488605dcd10eb95ba: Status 404 returned error can't find the container with id 9bb5ae3009c50ac7c168a83c3288f22c5c58684b2aef13a488605dcd10eb95ba Aug 05 17:15:27.623685 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.623629 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc2350ad-789a-4dab-8eef-7bc83a9936bf-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-w5256\" (UID: \"dc2350ad-789a-4dab-8eef-7bc83a9936bf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-w5256" Aug 05 17:15:27.625999 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.625968 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc2350ad-789a-4dab-8eef-7bc83a9936bf-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-w5256\" (UID: \"dc2350ad-789a-4dab-8eef-7bc83a9936bf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-w5256" Aug 05 17:15:27.794447 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.794408 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-w5256" Aug 05 17:15:27.988312 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:27.988270 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-w5256"] Aug 05 17:15:27.992966 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:15:27.992924 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc2350ad_789a_4dab_8eef_7bc83a9936bf.slice/crio-64a6c600ad8a9ebc177f89a7041f9359cb4ef991a44d9bac2bf24054f422d684 WatchSource:0}: Error finding container 64a6c600ad8a9ebc177f89a7041f9359cb4ef991a44d9bac2bf24054f422d684: Status 404 returned error can't find the container with id 64a6c600ad8a9ebc177f89a7041f9359cb4ef991a44d9bac2bf24054f422d684 Aug 05 17:15:28.059139 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:28.059091 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-w5256" event={"ID":"dc2350ad-789a-4dab-8eef-7bc83a9936bf","Type":"ContainerStarted","Data":"64a6c600ad8a9ebc177f89a7041f9359cb4ef991a44d9bac2bf24054f422d684"} Aug 05 17:15:28.060672 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:28.060638 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-42kbn" event={"ID":"f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477","Type":"ContainerStarted","Data":"9bb5ae3009c50ac7c168a83c3288f22c5c58684b2aef13a488605dcd10eb95ba"} Aug 05 17:15:29.066775 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:29.066737 2562 generic.go:356] "Generic (PLEG): container finished" podID="f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477" containerID="6ffe23ef6e71868531086912a380b186913c5ecd5fd78ac6bf19e2e3d2175f03" exitCode=0 Aug 05 17:15:29.067176 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:29.066835 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-42kbn" event={"ID":"f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477","Type":"ContainerDied","Data":"6ffe23ef6e71868531086912a380b186913c5ecd5fd78ac6bf19e2e3d2175f03"} Aug 05 17:15:30.072357 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:30.072306 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-42kbn" event={"ID":"f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477","Type":"ContainerStarted","Data":"841997011ae9779f154d4f71c800f74d9d9104fada141dcf0dd2cfce2e44cf67"} Aug 05 17:15:30.072853 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:30.072431 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-42kbn" event={"ID":"f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477","Type":"ContainerStarted","Data":"ac67e4012dbb7599f0a7fec7ba53b68df25315af4b9f1ca6f7a5d780becb8b88"} Aug 05 17:15:30.074356 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:30.074316 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-w5256" event={"ID":"dc2350ad-789a-4dab-8eef-7bc83a9936bf","Type":"ContainerStarted","Data":"f71449a0189bb2586b24ccdcfaeefa94f5a1a576ba518a158df4f1064dd9fb22"} Aug 05 17:15:30.074458 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:30.074377 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-w5256" event={"ID":"dc2350ad-789a-4dab-8eef-7bc83a9936bf","Type":"ContainerStarted","Data":"501862aa4b97ec32107e9b9adb7d79c84951afe33a620e136a0a8bb54c4672de"} Aug 05 17:15:30.074458 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:30.074396 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-w5256" event={"ID":"dc2350ad-789a-4dab-8eef-7bc83a9936bf","Type":"ContainerStarted","Data":"dc621e2d326df716669c71e07d57eb3cc070061d2908d4dda95837fc1530a64a"} Aug 05 17:15:30.109989 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:30.109892 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-42kbn" podStartSLOduration=2.988215591 podStartE2EDuration="4.109868422s" totalImagesPullingTime="1.054326108s" totalInitContainerRuntime="67.326723ms" isStatefulPod=true podCreationTimestamp="2026-08-05 17:15:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:30.106687085 +0000 UTC m=+181.279210995" watchObservedRunningTime="2026-08-05 17:15:30.109868422 +0000 UTC m=+181.282392334" Aug 05 17:15:30.141618 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:30.141562 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-w5256" podStartSLOduration=2.8917863390000003 podStartE2EDuration="4.14154194s" totalImagesPullingTime="1.249755601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:15:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:30.140453179 +0000 UTC m=+181.312977092" watchObservedRunningTime="2026-08-05 17:15:30.14154194 +0000 UTC m=+181.314065851" Aug 05 17:15:31.351012 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:31.350970 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-78c8b7bd89-qbrsl"] Aug 05 17:15:31.354330 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:31.354307 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-78c8b7bd89-qbrsl" Aug 05 17:15:31.358639 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:31.358609 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Aug 05 17:15:31.358812 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:31.358790 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Aug 05 17:15:31.358873 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:31.358830 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-94xt2\"" Aug 05 17:15:31.359915 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:31.359895 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Aug 05 17:15:31.360036 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:31.359920 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Aug 05 17:15:31.360036 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:31.359924 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-7a6hi9v9shvq6\"" Aug 05 17:15:31.375704 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:31.375670 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-78c8b7bd89-qbrsl"] Aug 05 17:15:31.456785 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:31.456743 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/494ce1fd-e0dc-4439-bca3-8009374c9b2b-metrics-server-audit-profiles\") pod \"metrics-server-78c8b7bd89-qbrsl\" (UID: \"494ce1fd-e0dc-4439-bca3-8009374c9b2b\") " pod="openshift-monitoring/metrics-server-78c8b7bd89-qbrsl" Aug 05 17:15:31.456983 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:31.456796 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/494ce1fd-e0dc-4439-bca3-8009374c9b2b-client-ca-bundle\") pod \"metrics-server-78c8b7bd89-qbrsl\" (UID: \"494ce1fd-e0dc-4439-bca3-8009374c9b2b\") " pod="openshift-monitoring/metrics-server-78c8b7bd89-qbrsl" Aug 05 17:15:31.456983 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:31.456857 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/494ce1fd-e0dc-4439-bca3-8009374c9b2b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78c8b7bd89-qbrsl\" (UID: \"494ce1fd-e0dc-4439-bca3-8009374c9b2b\") " pod="openshift-monitoring/metrics-server-78c8b7bd89-qbrsl" Aug 05 17:15:31.456983 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:31.456909 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgxdc\" (UniqueName: \"kubernetes.io/projected/494ce1fd-e0dc-4439-bca3-8009374c9b2b-kube-api-access-kgxdc\") pod \"metrics-server-78c8b7bd89-qbrsl\" (UID: \"494ce1fd-e0dc-4439-bca3-8009374c9b2b\") " pod="openshift-monitoring/metrics-server-78c8b7bd89-qbrsl" Aug 05 17:15:31.456983 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:31.456944 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/494ce1fd-e0dc-4439-bca3-8009374c9b2b-audit-log\") pod \"metrics-server-78c8b7bd89-qbrsl\" (UID: \"494ce1fd-e0dc-4439-bca3-8009374c9b2b\") " pod="openshift-monitoring/metrics-server-78c8b7bd89-qbrsl" Aug 05 17:15:31.457148 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:31.456993 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/494ce1fd-e0dc-4439-bca3-8009374c9b2b-secret-metrics-server-client-certs\") pod \"metrics-server-78c8b7bd89-qbrsl\" (UID: \"494ce1fd-e0dc-4439-bca3-8009374c9b2b\") " pod="openshift-monitoring/metrics-server-78c8b7bd89-qbrsl" Aug 05 17:15:31.457148 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:31.457018 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/494ce1fd-e0dc-4439-bca3-8009374c9b2b-secret-metrics-server-tls\") pod \"metrics-server-78c8b7bd89-qbrsl\" (UID: \"494ce1fd-e0dc-4439-bca3-8009374c9b2b\") " pod="openshift-monitoring/metrics-server-78c8b7bd89-qbrsl" Aug 05 17:15:31.557637 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:31.557598 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/494ce1fd-e0dc-4439-bca3-8009374c9b2b-secret-metrics-server-client-certs\") pod \"metrics-server-78c8b7bd89-qbrsl\" (UID: \"494ce1fd-e0dc-4439-bca3-8009374c9b2b\") " pod="openshift-monitoring/metrics-server-78c8b7bd89-qbrsl" Aug 05 17:15:31.557637 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:31.557633 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/494ce1fd-e0dc-4439-bca3-8009374c9b2b-secret-metrics-server-tls\") pod \"metrics-server-78c8b7bd89-qbrsl\" (UID: \"494ce1fd-e0dc-4439-bca3-8009374c9b2b\") " pod="openshift-monitoring/metrics-server-78c8b7bd89-qbrsl" Aug 05 17:15:31.557863 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:31.557655 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/494ce1fd-e0dc-4439-bca3-8009374c9b2b-metrics-server-audit-profiles\") pod \"metrics-server-78c8b7bd89-qbrsl\" (UID: \"494ce1fd-e0dc-4439-bca3-8009374c9b2b\") " pod="openshift-monitoring/metrics-server-78c8b7bd89-qbrsl" Aug 05 17:15:31.557863 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:31.557685 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/494ce1fd-e0dc-4439-bca3-8009374c9b2b-client-ca-bundle\") pod \"metrics-server-78c8b7bd89-qbrsl\" (UID: \"494ce1fd-e0dc-4439-bca3-8009374c9b2b\") " pod="openshift-monitoring/metrics-server-78c8b7bd89-qbrsl" Aug 05 17:15:31.557863 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:31.557708 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/494ce1fd-e0dc-4439-bca3-8009374c9b2b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78c8b7bd89-qbrsl\" (UID: \"494ce1fd-e0dc-4439-bca3-8009374c9b2b\") " pod="openshift-monitoring/metrics-server-78c8b7bd89-qbrsl" Aug 05 17:15:31.557863 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:31.557736 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgxdc\" (UniqueName: \"kubernetes.io/projected/494ce1fd-e0dc-4439-bca3-8009374c9b2b-kube-api-access-kgxdc\") pod \"metrics-server-78c8b7bd89-qbrsl\" (UID: \"494ce1fd-e0dc-4439-bca3-8009374c9b2b\") " pod="openshift-monitoring/metrics-server-78c8b7bd89-qbrsl" Aug 05 17:15:31.557863 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:31.557787 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/494ce1fd-e0dc-4439-bca3-8009374c9b2b-audit-log\") pod \"metrics-server-78c8b7bd89-qbrsl\" (UID: \"494ce1fd-e0dc-4439-bca3-8009374c9b2b\") " pod="openshift-monitoring/metrics-server-78c8b7bd89-qbrsl" Aug 05 17:15:31.558364 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:31.558298 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/494ce1fd-e0dc-4439-bca3-8009374c9b2b-audit-log\") pod \"metrics-server-78c8b7bd89-qbrsl\" (UID: \"494ce1fd-e0dc-4439-bca3-8009374c9b2b\") " pod="openshift-monitoring/metrics-server-78c8b7bd89-qbrsl" Aug 05 17:15:31.558560 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:31.558524 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/494ce1fd-e0dc-4439-bca3-8009374c9b2b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78c8b7bd89-qbrsl\" (UID: \"494ce1fd-e0dc-4439-bca3-8009374c9b2b\") " pod="openshift-monitoring/metrics-server-78c8b7bd89-qbrsl" Aug 05 17:15:31.558780 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:31.558760 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/494ce1fd-e0dc-4439-bca3-8009374c9b2b-metrics-server-audit-profiles\") pod \"metrics-server-78c8b7bd89-qbrsl\" (UID: \"494ce1fd-e0dc-4439-bca3-8009374c9b2b\") " pod="openshift-monitoring/metrics-server-78c8b7bd89-qbrsl" Aug 05 17:15:31.560407 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:31.560387 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/494ce1fd-e0dc-4439-bca3-8009374c9b2b-secret-metrics-server-client-certs\") pod \"metrics-server-78c8b7bd89-qbrsl\" (UID: \"494ce1fd-e0dc-4439-bca3-8009374c9b2b\") " pod="openshift-monitoring/metrics-server-78c8b7bd89-qbrsl" Aug 05 17:15:31.560496 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:31.560404 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/494ce1fd-e0dc-4439-bca3-8009374c9b2b-client-ca-bundle\") pod \"metrics-server-78c8b7bd89-qbrsl\" (UID: \"494ce1fd-e0dc-4439-bca3-8009374c9b2b\") " pod="openshift-monitoring/metrics-server-78c8b7bd89-qbrsl" Aug 05 17:15:31.560496 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:31.560451 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/494ce1fd-e0dc-4439-bca3-8009374c9b2b-secret-metrics-server-tls\") pod \"metrics-server-78c8b7bd89-qbrsl\" (UID: \"494ce1fd-e0dc-4439-bca3-8009374c9b2b\") " pod="openshift-monitoring/metrics-server-78c8b7bd89-qbrsl" Aug 05 17:15:31.573117 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:31.573086 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgxdc\" (UniqueName: \"kubernetes.io/projected/494ce1fd-e0dc-4439-bca3-8009374c9b2b-kube-api-access-kgxdc\") pod \"metrics-server-78c8b7bd89-qbrsl\" (UID: \"494ce1fd-e0dc-4439-bca3-8009374c9b2b\") " pod="openshift-monitoring/metrics-server-78c8b7bd89-qbrsl" Aug 05 17:15:31.663922 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:31.663833 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-78c8b7bd89-qbrsl" Aug 05 17:15:31.803792 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:31.803766 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-78c8b7bd89-qbrsl"] Aug 05 17:15:31.805600 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:15:31.805575 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod494ce1fd_e0dc_4439_bca3_8009374c9b2b.slice/crio-54e1d6847dc78b29bf6fb5b0f45929b40def85b41ad9b2063dee79bfe378b9b7 WatchSource:0}: Error finding container 54e1d6847dc78b29bf6fb5b0f45929b40def85b41ad9b2063dee79bfe378b9b7: Status 404 returned error can't find the container with id 54e1d6847dc78b29bf6fb5b0f45929b40def85b41ad9b2063dee79bfe378b9b7 Aug 05 17:15:32.002373 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:32.002326 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5b6564796c-6l4mt" Aug 05 17:15:32.084806 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:32.084769 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-78c8b7bd89-qbrsl" event={"ID":"494ce1fd-e0dc-4439-bca3-8009374c9b2b","Type":"ContainerStarted","Data":"54e1d6847dc78b29bf6fb5b0f45929b40def85b41ad9b2063dee79bfe378b9b7"} Aug 05 17:15:34.095005 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:34.094962 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-78c8b7bd89-qbrsl" event={"ID":"494ce1fd-e0dc-4439-bca3-8009374c9b2b","Type":"ContainerStarted","Data":"c6f734c657ac5cf676b0276cf49c03983251a672b13803f5d977a9c51bcc3342"} Aug 05 17:15:34.122910 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:34.122849 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-78c8b7bd89-qbrsl" podStartSLOduration=1.227920313 podStartE2EDuration="3.122830522s" totalImagesPullingTime="1.894910209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:15:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:34.122547493 +0000 UTC m=+185.295071406" watchObservedRunningTime="2026-08-05 17:15:34.122830522 +0000 UTC m=+185.295354434" Aug 05 17:15:51.664637 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:51.664601 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-78c8b7bd89-qbrsl" Aug 05 17:15:51.665121 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:15:51.664670 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-78c8b7bd89-qbrsl" Aug 05 17:16:11.669442 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:16:11.669413 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-78c8b7bd89-qbrsl" Aug 05 17:16:11.673415 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:16:11.673392 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-78c8b7bd89-qbrsl" Aug 05 17:16:41.140510 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:16:41.140471 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4618f8d9-07bc-4de7-9c7c-b09d7fe9d923-metrics-certs\") pod \"network-metrics-daemon-smhw9\" (UID: \"4618f8d9-07bc-4de7-9c7c-b09d7fe9d923\") " pod="openshift-multus/network-metrics-daemon-smhw9" Aug 05 17:16:41.142771 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:16:41.142745 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4618f8d9-07bc-4de7-9c7c-b09d7fe9d923-metrics-certs\") pod \"network-metrics-daemon-smhw9\" (UID: \"4618f8d9-07bc-4de7-9c7c-b09d7fe9d923\") " pod="openshift-multus/network-metrics-daemon-smhw9" Aug 05 17:16:41.438810 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:16:41.438719 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z9xpb\"" Aug 05 17:16:41.446453 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:16:41.446428 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smhw9" Aug 05 17:16:41.593021 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:16:41.592989 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-smhw9"] Aug 05 17:16:41.596278 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:16:41.596251 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4618f8d9_07bc_4de7_9c7c_b09d7fe9d923.slice/crio-442622cdd8498534fcd4956f410125aa228ae81655eca62b663c95a5c3982297 WatchSource:0}: Error finding container 442622cdd8498534fcd4956f410125aa228ae81655eca62b663c95a5c3982297: Status 404 returned error can't find the container with id 442622cdd8498534fcd4956f410125aa228ae81655eca62b663c95a5c3982297 Aug 05 17:16:42.333872 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:16:42.333838 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-smhw9" event={"ID":"4618f8d9-07bc-4de7-9c7c-b09d7fe9d923","Type":"ContainerStarted","Data":"442622cdd8498534fcd4956f410125aa228ae81655eca62b663c95a5c3982297"} Aug 05 17:16:43.342973 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:16:43.342937 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-smhw9" event={"ID":"4618f8d9-07bc-4de7-9c7c-b09d7fe9d923","Type":"ContainerStarted","Data":"35cdcbaf8b41bbe61c283603e41c3b5ab96e5e061f724872120a297949a54ecc"} Aug 05 17:16:43.343431 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:16:43.343025 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-smhw9" event={"ID":"4618f8d9-07bc-4de7-9c7c-b09d7fe9d923","Type":"ContainerStarted","Data":"a3e3b22b5a6ad578cc60996e3e34b76b654345153651e7d582a6df3c47e2f83b"} Aug 05 17:16:43.365917 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:16:43.365870 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-smhw9" podStartSLOduration=253.380228071 podStartE2EDuration="4m14.365855299s" totalImagesPullingTime="985.627228ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:12:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:16:43.363934368 +0000 UTC m=+254.536458280" watchObservedRunningTime="2026-08-05 17:16:43.365855299 +0000 UTC m=+254.538379207" Aug 05 17:17:29.196221 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:17:29.196192 2562 kubelet.go:1648] "Image garbage collection succeeded" Aug 05 17:19:43.299134 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:19:43.299098 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54nnlr"] Aug 05 17:19:43.301763 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:19:43.301746 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54nnlr" Aug 05 17:19:43.304518 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:19:43.304484 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Aug 05 17:19:43.305492 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:19:43.305472 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Aug 05 17:19:43.305610 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:19:43.305494 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pscwn\"" Aug 05 17:19:43.312158 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:19:43.312135 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54nnlr"] Aug 05 17:19:43.408891 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:19:43.408859 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2318998b-a53c-4d2a-a2e6-f6a205b52756-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54nnlr\" (UID: \"2318998b-a53c-4d2a-a2e6-f6a205b52756\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54nnlr" Aug 05 17:19:43.409057 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:19:43.408904 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mpmp\" (UniqueName: \"kubernetes.io/projected/2318998b-a53c-4d2a-a2e6-f6a205b52756-kube-api-access-7mpmp\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54nnlr\" (UID: \"2318998b-a53c-4d2a-a2e6-f6a205b52756\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54nnlr" Aug 05 17:19:43.409057 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:19:43.408945 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2318998b-a53c-4d2a-a2e6-f6a205b52756-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54nnlr\" (UID: \"2318998b-a53c-4d2a-a2e6-f6a205b52756\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54nnlr" Aug 05 17:19:43.510116 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:19:43.510079 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2318998b-a53c-4d2a-a2e6-f6a205b52756-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54nnlr\" (UID: \"2318998b-a53c-4d2a-a2e6-f6a205b52756\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54nnlr" Aug 05 17:19:43.510289 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:19:43.510131 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2318998b-a53c-4d2a-a2e6-f6a205b52756-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54nnlr\" (UID: \"2318998b-a53c-4d2a-a2e6-f6a205b52756\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54nnlr" Aug 05 17:19:43.510289 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:19:43.510173 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mpmp\" (UniqueName: \"kubernetes.io/projected/2318998b-a53c-4d2a-a2e6-f6a205b52756-kube-api-access-7mpmp\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54nnlr\" (UID: \"2318998b-a53c-4d2a-a2e6-f6a205b52756\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54nnlr" Aug 05 17:19:43.510504 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:19:43.510484 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2318998b-a53c-4d2a-a2e6-f6a205b52756-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54nnlr\" (UID: \"2318998b-a53c-4d2a-a2e6-f6a205b52756\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54nnlr" Aug 05 17:19:43.510569 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:19:43.510549 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2318998b-a53c-4d2a-a2e6-f6a205b52756-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54nnlr\" (UID: \"2318998b-a53c-4d2a-a2e6-f6a205b52756\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54nnlr" Aug 05 17:19:43.519773 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:19:43.519748 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mpmp\" (UniqueName: \"kubernetes.io/projected/2318998b-a53c-4d2a-a2e6-f6a205b52756-kube-api-access-7mpmp\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54nnlr\" (UID: \"2318998b-a53c-4d2a-a2e6-f6a205b52756\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54nnlr" Aug 05 17:19:43.610699 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:19:43.610617 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54nnlr" Aug 05 17:19:43.745735 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:19:43.745696 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54nnlr"] Aug 05 17:19:43.748480 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:19:43.748452 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2318998b_a53c_4d2a_a2e6_f6a205b52756.slice/crio-846fa715262e16c8c61e68285059f1e7f86f3ff649306f6024373201bfe9b8a4 WatchSource:0}: Error finding container 846fa715262e16c8c61e68285059f1e7f86f3ff649306f6024373201bfe9b8a4: Status 404 returned error can't find the container with id 846fa715262e16c8c61e68285059f1e7f86f3ff649306f6024373201bfe9b8a4 Aug 05 17:19:43.752077 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:19:43.752057 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 05 17:19:43.959723 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:19:43.959633 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54nnlr" event={"ID":"2318998b-a53c-4d2a-a2e6-f6a205b52756","Type":"ContainerStarted","Data":"846fa715262e16c8c61e68285059f1e7f86f3ff649306f6024373201bfe9b8a4"} Aug 05 17:19:49.983723 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:19:49.983690 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54nnlr" event={"ID":"2318998b-a53c-4d2a-a2e6-f6a205b52756","Type":"ContainerStarted","Data":"c6bcc744b994de1e6cc6f58b544f593bf7be87d635af023a0c444f562cf2d392"} Aug 05 17:19:50.988605 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:19:50.988567 2562 generic.go:356] "Generic (PLEG): container finished" podID="2318998b-a53c-4d2a-a2e6-f6a205b52756" containerID="c6bcc744b994de1e6cc6f58b544f593bf7be87d635af023a0c444f562cf2d392" exitCode=0 Aug 05 17:19:50.988994 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:19:50.988653 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54nnlr" event={"ID":"2318998b-a53c-4d2a-a2e6-f6a205b52756","Type":"ContainerDied","Data":"c6bcc744b994de1e6cc6f58b544f593bf7be87d635af023a0c444f562cf2d392"} Aug 05 17:19:54.002194 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:19:54.002155 2562 generic.go:356] "Generic (PLEG): container finished" podID="2318998b-a53c-4d2a-a2e6-f6a205b52756" containerID="e49a2647f5139d50e651554187ddea70395eb9d3553ee03f4f1f528be65faa26" exitCode=0 Aug 05 17:19:54.002608 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:19:54.002203 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54nnlr" event={"ID":"2318998b-a53c-4d2a-a2e6-f6a205b52756","Type":"ContainerDied","Data":"e49a2647f5139d50e651554187ddea70395eb9d3553ee03f4f1f528be65faa26"} Aug 05 17:20:01.031216 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:01.031182 2562 generic.go:356] "Generic (PLEG): container finished" podID="2318998b-a53c-4d2a-a2e6-f6a205b52756" containerID="b9aade8266dc72e4c44224a038c42c875b9569fde360106181de37f82bf022bf" exitCode=0 Aug 05 17:20:01.031629 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:01.031280 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54nnlr" event={"ID":"2318998b-a53c-4d2a-a2e6-f6a205b52756","Type":"ContainerDied","Data":"b9aade8266dc72e4c44224a038c42c875b9569fde360106181de37f82bf022bf"} Aug 05 17:20:02.158991 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:02.158966 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54nnlr" Aug 05 17:20:02.273398 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:02.273358 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2318998b-a53c-4d2a-a2e6-f6a205b52756-bundle\") pod \"2318998b-a53c-4d2a-a2e6-f6a205b52756\" (UID: \"2318998b-a53c-4d2a-a2e6-f6a205b52756\") " Aug 05 17:20:02.273570 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:02.273433 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mpmp\" (UniqueName: \"kubernetes.io/projected/2318998b-a53c-4d2a-a2e6-f6a205b52756-kube-api-access-7mpmp\") pod \"2318998b-a53c-4d2a-a2e6-f6a205b52756\" (UID: \"2318998b-a53c-4d2a-a2e6-f6a205b52756\") " Aug 05 17:20:02.273570 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:02.273512 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2318998b-a53c-4d2a-a2e6-f6a205b52756-util\") pod \"2318998b-a53c-4d2a-a2e6-f6a205b52756\" (UID: \"2318998b-a53c-4d2a-a2e6-f6a205b52756\") " Aug 05 17:20:02.274010 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:02.273987 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2318998b-a53c-4d2a-a2e6-f6a205b52756-bundle" (OuterVolumeSpecName: "bundle") pod "2318998b-a53c-4d2a-a2e6-f6a205b52756" (UID: "2318998b-a53c-4d2a-a2e6-f6a205b52756"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:20:02.275657 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:02.275636 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2318998b-a53c-4d2a-a2e6-f6a205b52756-kube-api-access-7mpmp" (OuterVolumeSpecName: "kube-api-access-7mpmp") pod "2318998b-a53c-4d2a-a2e6-f6a205b52756" (UID: "2318998b-a53c-4d2a-a2e6-f6a205b52756"). InnerVolumeSpecName "kube-api-access-7mpmp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:20:02.277559 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:02.277533 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2318998b-a53c-4d2a-a2e6-f6a205b52756-util" (OuterVolumeSpecName: "util") pod "2318998b-a53c-4d2a-a2e6-f6a205b52756" (UID: "2318998b-a53c-4d2a-a2e6-f6a205b52756"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:20:02.374229 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:02.374141 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2318998b-a53c-4d2a-a2e6-f6a205b52756-util\") on node \"ip-10-0-137-104.ec2.internal\" DevicePath \"\"" Aug 05 17:20:02.374229 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:02.374171 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2318998b-a53c-4d2a-a2e6-f6a205b52756-bundle\") on node \"ip-10-0-137-104.ec2.internal\" DevicePath \"\"" Aug 05 17:20:02.374229 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:02.374180 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mpmp\" (UniqueName: \"kubernetes.io/projected/2318998b-a53c-4d2a-a2e6-f6a205b52756-kube-api-access-7mpmp\") on node \"ip-10-0-137-104.ec2.internal\" DevicePath \"\"" Aug 05 17:20:03.041001 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:03.040966 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54nnlr" Aug 05 17:20:03.041161 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:03.040962 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b54nnlr" event={"ID":"2318998b-a53c-4d2a-a2e6-f6a205b52756","Type":"ContainerDied","Data":"846fa715262e16c8c61e68285059f1e7f86f3ff649306f6024373201bfe9b8a4"} Aug 05 17:20:03.041161 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:03.041103 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="846fa715262e16c8c61e68285059f1e7f86f3ff649306f6024373201bfe9b8a4" Aug 05 17:20:06.254644 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:06.254608 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-4zpt2"] Aug 05 17:20:06.255030 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:06.254916 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2318998b-a53c-4d2a-a2e6-f6a205b52756" containerName="pull" Aug 05 17:20:06.255030 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:06.254929 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2318998b-a53c-4d2a-a2e6-f6a205b52756" containerName="pull" Aug 05 17:20:06.255030 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:06.254936 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2318998b-a53c-4d2a-a2e6-f6a205b52756" containerName="util" Aug 05 17:20:06.255030 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:06.254942 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2318998b-a53c-4d2a-a2e6-f6a205b52756" containerName="util" Aug 05 17:20:06.255030 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:06.254952 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2318998b-a53c-4d2a-a2e6-f6a205b52756" containerName="extract" Aug 05 17:20:06.255030 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:06.254960 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2318998b-a53c-4d2a-a2e6-f6a205b52756" containerName="extract" Aug 05 17:20:06.255030 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:06.255019 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2318998b-a53c-4d2a-a2e6-f6a205b52756" containerName="extract" Aug 05 17:20:06.280907 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:06.280868 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-4zpt2" Aug 05 17:20:06.281117 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:06.281095 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-4zpt2"] Aug 05 17:20:06.286994 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:06.286962 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Aug 05 17:20:06.287476 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:06.287315 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Aug 05 17:20:06.287476 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:06.287414 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Aug 05 17:20:06.287700 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:06.287687 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-f7c77\"" Aug 05 17:20:06.406844 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:06.406807 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbmtk\" (UniqueName: \"kubernetes.io/projected/afb7d73f-b9e5-48b2-b827-7197a5ce2fab-kube-api-access-mbmtk\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-4zpt2\" (UID: \"afb7d73f-b9e5-48b2-b827-7197a5ce2fab\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-4zpt2" Aug 05 17:20:06.407023 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:06.406863 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/afb7d73f-b9e5-48b2-b827-7197a5ce2fab-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-4zpt2\" (UID: \"afb7d73f-b9e5-48b2-b827-7197a5ce2fab\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-4zpt2" Aug 05 17:20:06.507596 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:06.507512 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/afb7d73f-b9e5-48b2-b827-7197a5ce2fab-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-4zpt2\" (UID: \"afb7d73f-b9e5-48b2-b827-7197a5ce2fab\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-4zpt2" Aug 05 17:20:06.507596 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:06.507575 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbmtk\" (UniqueName: \"kubernetes.io/projected/afb7d73f-b9e5-48b2-b827-7197a5ce2fab-kube-api-access-mbmtk\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-4zpt2\" (UID: \"afb7d73f-b9e5-48b2-b827-7197a5ce2fab\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-4zpt2" Aug 05 17:20:06.509857 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:06.509834 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/afb7d73f-b9e5-48b2-b827-7197a5ce2fab-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-4zpt2\" (UID: \"afb7d73f-b9e5-48b2-b827-7197a5ce2fab\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-4zpt2" Aug 05 17:20:06.522945 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:06.522913 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbmtk\" (UniqueName: \"kubernetes.io/projected/afb7d73f-b9e5-48b2-b827-7197a5ce2fab-kube-api-access-mbmtk\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-4zpt2\" (UID: \"afb7d73f-b9e5-48b2-b827-7197a5ce2fab\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-4zpt2" Aug 05 17:20:06.590790 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:06.590752 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-4zpt2" Aug 05 17:20:06.756833 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:20:06.756791 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafb7d73f_b9e5_48b2_b827_7197a5ce2fab.slice/crio-8d306372d75cce22991e6933314e16a38d585c4e4bf41ff5f915710609a5604b WatchSource:0}: Error finding container 8d306372d75cce22991e6933314e16a38d585c4e4bf41ff5f915710609a5604b: Status 404 returned error can't find the container with id 8d306372d75cce22991e6933314e16a38d585c4e4bf41ff5f915710609a5604b Aug 05 17:20:06.758800 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:06.758773 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-4zpt2"] Aug 05 17:20:07.061042 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:07.060956 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-4zpt2" event={"ID":"afb7d73f-b9e5-48b2-b827-7197a5ce2fab","Type":"ContainerStarted","Data":"8d306372d75cce22991e6933314e16a38d585c4e4bf41ff5f915710609a5604b"} Aug 05 17:20:10.075502 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:10.075465 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-4zpt2" event={"ID":"afb7d73f-b9e5-48b2-b827-7197a5ce2fab","Type":"ContainerStarted","Data":"aa753d5fabc48b72638f00a588632972d5aaf814bcb7ada4fd7503fa9eb359d0"} Aug 05 17:20:10.075875 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:10.075531 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-4zpt2" Aug 05 17:20:10.102873 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:10.102809 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-4zpt2" podStartSLOduration=0.988317115 podStartE2EDuration="4.102787269s" totalImagesPullingTime="3.114470154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:20:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:20:10.100133462 +0000 UTC m=+461.272657374" watchObservedRunningTime="2026-08-05 17:20:10.102787269 +0000 UTC m=+461.275311180" Aug 05 17:20:31.081311 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:20:31.081269 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-4zpt2" Aug 05 17:21:34.606869 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:21:34.606789 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-6f49dcd9ff-8hd2f"] Aug 05 17:21:34.614010 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:21:34.613985 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-qx854"] Aug 05 17:21:34.614144 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:21:34.614102 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6f49dcd9ff-8hd2f" Aug 05 17:21:34.617112 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:21:34.617091 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-qx854" Aug 05 17:21:34.617866 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:21:34.617841 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Aug 05 17:21:34.617866 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:21:34.617857 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-78mbn\"" Aug 05 17:21:34.618027 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:21:34.617877 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Aug 05 17:21:34.618027 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:21:34.617950 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Aug 05 17:21:34.619502 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:21:34.619479 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Aug 05 17:21:34.619502 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:21:34.619494 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-6vjm9\"" Aug 05 17:21:34.620664 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:21:34.620549 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-6f49dcd9ff-8hd2f"] Aug 05 17:21:34.625471 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:21:34.625453 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-qx854"] Aug 05 17:21:34.775319 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:21:34.775284 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20e5fdeb-abe3-4435-bbd3-33271ba125b2-cert\") pod \"kserve-controller-manager-6f49dcd9ff-8hd2f\" (UID: \"20e5fdeb-abe3-4435-bbd3-33271ba125b2\") " pod="kserve/kserve-controller-manager-6f49dcd9ff-8hd2f" Aug 05 17:21:34.775537 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:21:34.775363 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/154005b8-b3c4-425e-88b0-d79aea504d6b-cert\") pod \"llmisvc-controller-manager-654c557856-qx854\" (UID: \"154005b8-b3c4-425e-88b0-d79aea504d6b\") " pod="kserve/llmisvc-controller-manager-654c557856-qx854" Aug 05 17:21:34.775537 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:21:34.775435 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqn2g\" (UniqueName: \"kubernetes.io/projected/20e5fdeb-abe3-4435-bbd3-33271ba125b2-kube-api-access-sqn2g\") pod \"kserve-controller-manager-6f49dcd9ff-8hd2f\" (UID: \"20e5fdeb-abe3-4435-bbd3-33271ba125b2\") " pod="kserve/kserve-controller-manager-6f49dcd9ff-8hd2f" Aug 05 17:21:34.775537 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:21:34.775482 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9t95\" (UniqueName: \"kubernetes.io/projected/154005b8-b3c4-425e-88b0-d79aea504d6b-kube-api-access-j9t95\") pod \"llmisvc-controller-manager-654c557856-qx854\" (UID: \"154005b8-b3c4-425e-88b0-d79aea504d6b\") " pod="kserve/llmisvc-controller-manager-654c557856-qx854" Aug 05 17:21:34.876189 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:21:34.876094 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9t95\" (UniqueName: \"kubernetes.io/projected/154005b8-b3c4-425e-88b0-d79aea504d6b-kube-api-access-j9t95\") pod \"llmisvc-controller-manager-654c557856-qx854\" (UID: \"154005b8-b3c4-425e-88b0-d79aea504d6b\") " pod="kserve/llmisvc-controller-manager-654c557856-qx854" Aug 05 17:21:34.876189 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:21:34.876137 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20e5fdeb-abe3-4435-bbd3-33271ba125b2-cert\") pod \"kserve-controller-manager-6f49dcd9ff-8hd2f\" (UID: \"20e5fdeb-abe3-4435-bbd3-33271ba125b2\") " pod="kserve/kserve-controller-manager-6f49dcd9ff-8hd2f" Aug 05 17:21:34.876189 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:21:34.876176 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/154005b8-b3c4-425e-88b0-d79aea504d6b-cert\") pod \"llmisvc-controller-manager-654c557856-qx854\" (UID: \"154005b8-b3c4-425e-88b0-d79aea504d6b\") " pod="kserve/llmisvc-controller-manager-654c557856-qx854" Aug 05 17:21:34.876498 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:21:34.876206 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqn2g\" (UniqueName: \"kubernetes.io/projected/20e5fdeb-abe3-4435-bbd3-33271ba125b2-kube-api-access-sqn2g\") pod \"kserve-controller-manager-6f49dcd9ff-8hd2f\" (UID: \"20e5fdeb-abe3-4435-bbd3-33271ba125b2\") " pod="kserve/kserve-controller-manager-6f49dcd9ff-8hd2f" Aug 05 17:21:34.878666 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:21:34.878643 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/154005b8-b3c4-425e-88b0-d79aea504d6b-cert\") pod \"llmisvc-controller-manager-654c557856-qx854\" (UID: \"154005b8-b3c4-425e-88b0-d79aea504d6b\") " pod="kserve/llmisvc-controller-manager-654c557856-qx854" Aug 05 17:21:34.878792 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:21:34.878729 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20e5fdeb-abe3-4435-bbd3-33271ba125b2-cert\") pod \"kserve-controller-manager-6f49dcd9ff-8hd2f\" (UID: \"20e5fdeb-abe3-4435-bbd3-33271ba125b2\") " pod="kserve/kserve-controller-manager-6f49dcd9ff-8hd2f" Aug 05 17:21:34.901381 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:21:34.901328 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqn2g\" (UniqueName: \"kubernetes.io/projected/20e5fdeb-abe3-4435-bbd3-33271ba125b2-kube-api-access-sqn2g\") pod \"kserve-controller-manager-6f49dcd9ff-8hd2f\" (UID: \"20e5fdeb-abe3-4435-bbd3-33271ba125b2\") " pod="kserve/kserve-controller-manager-6f49dcd9ff-8hd2f" Aug 05 17:21:34.901381 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:21:34.901379 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9t95\" (UniqueName: \"kubernetes.io/projected/154005b8-b3c4-425e-88b0-d79aea504d6b-kube-api-access-j9t95\") pod \"llmisvc-controller-manager-654c557856-qx854\" (UID: \"154005b8-b3c4-425e-88b0-d79aea504d6b\") " pod="kserve/llmisvc-controller-manager-654c557856-qx854" Aug 05 17:21:34.927927 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:21:34.927897 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6f49dcd9ff-8hd2f" Aug 05 17:21:34.934091 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:21:34.934069 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-qx854" Aug 05 17:21:35.091001 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:21:35.090968 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20e5fdeb_abe3_4435_bbd3_33271ba125b2.slice/crio-63fa76aa4ad9c2a4e4a9ab5c25250e2190459b9c247f43565e4dedf7404a7e6d WatchSource:0}: Error finding container 63fa76aa4ad9c2a4e4a9ab5c25250e2190459b9c247f43565e4dedf7404a7e6d: Status 404 returned error can't find the container with id 63fa76aa4ad9c2a4e4a9ab5c25250e2190459b9c247f43565e4dedf7404a7e6d Aug 05 17:21:35.092589 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:21:35.092566 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-6f49dcd9ff-8hd2f"] Aug 05 17:21:35.120095 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:21:35.119922 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-qx854"] Aug 05 17:21:35.122491 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:21:35.122465 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod154005b8_b3c4_425e_88b0_d79aea504d6b.slice/crio-5c2f909d8c8d2acf76d61dbb34f168d75b024952193b1ed6df9a8984c99331a3 WatchSource:0}: Error finding container 5c2f909d8c8d2acf76d61dbb34f168d75b024952193b1ed6df9a8984c99331a3: Status 404 returned error can't find the container with id 5c2f909d8c8d2acf76d61dbb34f168d75b024952193b1ed6df9a8984c99331a3 Aug 05 17:21:35.382402 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:21:35.382365 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6f49dcd9ff-8hd2f" event={"ID":"20e5fdeb-abe3-4435-bbd3-33271ba125b2","Type":"ContainerStarted","Data":"63fa76aa4ad9c2a4e4a9ab5c25250e2190459b9c247f43565e4dedf7404a7e6d"} Aug 05 17:21:35.383317 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:21:35.383293 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-qx854" event={"ID":"154005b8-b3c4-425e-88b0-d79aea504d6b","Type":"ContainerStarted","Data":"5c2f909d8c8d2acf76d61dbb34f168d75b024952193b1ed6df9a8984c99331a3"} Aug 05 17:21:39.404591 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:21:39.404552 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6f49dcd9ff-8hd2f" event={"ID":"20e5fdeb-abe3-4435-bbd3-33271ba125b2","Type":"ContainerStarted","Data":"5d766d69f4d30a8a2950cbdebe323aafa350d953ab4c0463ec66766a8362013b"} Aug 05 17:21:39.405085 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:21:39.404656 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-6f49dcd9ff-8hd2f" Aug 05 17:21:39.406131 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:21:39.406110 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-qx854" event={"ID":"154005b8-b3c4-425e-88b0-d79aea504d6b","Type":"ContainerStarted","Data":"a164130fef5e46d61bfc147e789970bff3c6960c3fda1f8307a449e96a2e47dc"} Aug 05 17:21:39.406230 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:21:39.406221 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-654c557856-qx854" Aug 05 17:21:39.424820 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:21:39.424767 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-6f49dcd9ff-8hd2f" podStartSLOduration=1.9576228900000001 podStartE2EDuration="5.424751112s" totalImagesPullingTime="3.467128222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:21:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:21:39.423497146 +0000 UTC m=+550.596021070" watchObservedRunningTime="2026-08-05 17:21:39.424751112 +0000 UTC m=+550.597275024" Aug 05 17:21:39.443674 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:21:39.443627 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-654c557856-qx854" podStartSLOduration=2.008853916 podStartE2EDuration="5.443610581s" totalImagesPullingTime="3.434756665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:21:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:21:39.44261456 +0000 UTC m=+550.615138472" watchObservedRunningTime="2026-08-05 17:21:39.443610581 +0000 UTC m=+550.616134494" Aug 05 17:22:10.412597 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:10.412560 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-654c557856-qx854" Aug 05 17:22:10.415575 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:10.415554 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-6f49dcd9ff-8hd2f" Aug 05 17:22:19.581170 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:19.581137 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-6f49dcd9ff-8hd2f"] Aug 05 17:22:19.581596 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:19.581366 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/kserve-controller-manager-6f49dcd9ff-8hd2f" podUID="20e5fdeb-abe3-4435-bbd3-33271ba125b2" containerName="manager" containerID="cri-o://5d766d69f4d30a8a2950cbdebe323aafa350d953ab4c0463ec66766a8362013b" gracePeriod=10 Aug 05 17:22:19.605411 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:19.605385 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-6f49dcd9ff-cm7s8"] Aug 05 17:22:19.607571 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:19.607555 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6f49dcd9ff-cm7s8" Aug 05 17:22:19.620238 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:19.620213 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-6f49dcd9ff-cm7s8"] Aug 05 17:22:19.689726 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:19.689696 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjxcq\" (UniqueName: \"kubernetes.io/projected/7d534ddb-a76f-4f32-b520-7371e8f49765-kube-api-access-hjxcq\") pod \"kserve-controller-manager-6f49dcd9ff-cm7s8\" (UID: \"7d534ddb-a76f-4f32-b520-7371e8f49765\") " pod="kserve/kserve-controller-manager-6f49dcd9ff-cm7s8" Aug 05 17:22:19.689861 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:19.689763 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d534ddb-a76f-4f32-b520-7371e8f49765-cert\") pod \"kserve-controller-manager-6f49dcd9ff-cm7s8\" (UID: \"7d534ddb-a76f-4f32-b520-7371e8f49765\") " pod="kserve/kserve-controller-manager-6f49dcd9ff-cm7s8" Aug 05 17:22:19.790453 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:19.790422 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjxcq\" (UniqueName: \"kubernetes.io/projected/7d534ddb-a76f-4f32-b520-7371e8f49765-kube-api-access-hjxcq\") pod \"kserve-controller-manager-6f49dcd9ff-cm7s8\" (UID: \"7d534ddb-a76f-4f32-b520-7371e8f49765\") " pod="kserve/kserve-controller-manager-6f49dcd9ff-cm7s8" Aug 05 17:22:19.790599 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:19.790473 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d534ddb-a76f-4f32-b520-7371e8f49765-cert\") pod \"kserve-controller-manager-6f49dcd9ff-cm7s8\" (UID: \"7d534ddb-a76f-4f32-b520-7371e8f49765\") " pod="kserve/kserve-controller-manager-6f49dcd9ff-cm7s8" Aug 05 17:22:19.792774 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:19.792743 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d534ddb-a76f-4f32-b520-7371e8f49765-cert\") pod \"kserve-controller-manager-6f49dcd9ff-cm7s8\" (UID: \"7d534ddb-a76f-4f32-b520-7371e8f49765\") " pod="kserve/kserve-controller-manager-6f49dcd9ff-cm7s8" Aug 05 17:22:19.801131 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:19.801106 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjxcq\" (UniqueName: \"kubernetes.io/projected/7d534ddb-a76f-4f32-b520-7371e8f49765-kube-api-access-hjxcq\") pod \"kserve-controller-manager-6f49dcd9ff-cm7s8\" (UID: \"7d534ddb-a76f-4f32-b520-7371e8f49765\") " pod="kserve/kserve-controller-manager-6f49dcd9ff-cm7s8" Aug 05 17:22:19.818299 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:19.818278 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6f49dcd9ff-8hd2f" Aug 05 17:22:19.973422 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:19.973298 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6f49dcd9ff-cm7s8" Aug 05 17:22:19.991810 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:19.991784 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20e5fdeb-abe3-4435-bbd3-33271ba125b2-cert\") pod \"20e5fdeb-abe3-4435-bbd3-33271ba125b2\" (UID: \"20e5fdeb-abe3-4435-bbd3-33271ba125b2\") " Aug 05 17:22:19.991955 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:19.991820 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqn2g\" (UniqueName: \"kubernetes.io/projected/20e5fdeb-abe3-4435-bbd3-33271ba125b2-kube-api-access-sqn2g\") pod \"20e5fdeb-abe3-4435-bbd3-33271ba125b2\" (UID: \"20e5fdeb-abe3-4435-bbd3-33271ba125b2\") " Aug 05 17:22:19.993999 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:19.993974 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20e5fdeb-abe3-4435-bbd3-33271ba125b2-kube-api-access-sqn2g" (OuterVolumeSpecName: "kube-api-access-sqn2g") pod "20e5fdeb-abe3-4435-bbd3-33271ba125b2" (UID: "20e5fdeb-abe3-4435-bbd3-33271ba125b2"). InnerVolumeSpecName "kube-api-access-sqn2g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:22:19.994098 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:19.994077 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20e5fdeb-abe3-4435-bbd3-33271ba125b2-cert" (OuterVolumeSpecName: "cert") pod "20e5fdeb-abe3-4435-bbd3-33271ba125b2" (UID: "20e5fdeb-abe3-4435-bbd3-33271ba125b2"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:22:20.093053 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:20.093022 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqn2g\" (UniqueName: \"kubernetes.io/projected/20e5fdeb-abe3-4435-bbd3-33271ba125b2-kube-api-access-sqn2g\") on node \"ip-10-0-137-104.ec2.internal\" DevicePath \"\"" Aug 05 17:22:20.093053 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:20.093049 2562 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20e5fdeb-abe3-4435-bbd3-33271ba125b2-cert\") on node \"ip-10-0-137-104.ec2.internal\" DevicePath \"\"" Aug 05 17:22:20.109165 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:20.109137 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-6f49dcd9ff-cm7s8"] Aug 05 17:22:20.114230 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:22:20.114204 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d534ddb_a76f_4f32_b520_7371e8f49765.slice/crio-af5c19da168f8d25316c74c383a8887c0eecb52f243126b3a8d38663dc3c9a6d WatchSource:0}: Error finding container af5c19da168f8d25316c74c383a8887c0eecb52f243126b3a8d38663dc3c9a6d: Status 404 returned error can't find the container with id af5c19da168f8d25316c74c383a8887c0eecb52f243126b3a8d38663dc3c9a6d Aug 05 17:22:20.566064 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:20.566028 2562 generic.go:356] "Generic (PLEG): container finished" podID="20e5fdeb-abe3-4435-bbd3-33271ba125b2" containerID="5d766d69f4d30a8a2950cbdebe323aafa350d953ab4c0463ec66766a8362013b" exitCode=0 Aug 05 17:22:20.566229 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:20.566072 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6f49dcd9ff-8hd2f" Aug 05 17:22:20.566229 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:20.566106 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6f49dcd9ff-8hd2f" event={"ID":"20e5fdeb-abe3-4435-bbd3-33271ba125b2","Type":"ContainerDied","Data":"5d766d69f4d30a8a2950cbdebe323aafa350d953ab4c0463ec66766a8362013b"} Aug 05 17:22:20.566229 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:20.566152 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6f49dcd9ff-8hd2f" event={"ID":"20e5fdeb-abe3-4435-bbd3-33271ba125b2","Type":"ContainerDied","Data":"63fa76aa4ad9c2a4e4a9ab5c25250e2190459b9c247f43565e4dedf7404a7e6d"} Aug 05 17:22:20.566229 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:20.566181 2562 scope.go:117] "RemoveContainer" containerID="5d766d69f4d30a8a2950cbdebe323aafa350d953ab4c0463ec66766a8362013b" Aug 05 17:22:20.568044 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:20.568019 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6f49dcd9ff-cm7s8" event={"ID":"7d534ddb-a76f-4f32-b520-7371e8f49765","Type":"ContainerStarted","Data":"f21ea010e3259c92535daabb011c6734f1d4f03ed018e916cb6eeda3efc8dae6"} Aug 05 17:22:20.568184 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:20.568064 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6f49dcd9ff-cm7s8" event={"ID":"7d534ddb-a76f-4f32-b520-7371e8f49765","Type":"ContainerStarted","Data":"af5c19da168f8d25316c74c383a8887c0eecb52f243126b3a8d38663dc3c9a6d"} Aug 05 17:22:20.568184 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:20.568143 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-6f49dcd9ff-cm7s8" Aug 05 17:22:20.575286 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:20.575267 2562 scope.go:117] "RemoveContainer" containerID="5d766d69f4d30a8a2950cbdebe323aafa350d953ab4c0463ec66766a8362013b" Aug 05 17:22:20.575617 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:22:20.575593 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d766d69f4d30a8a2950cbdebe323aafa350d953ab4c0463ec66766a8362013b\": container with ID starting with 5d766d69f4d30a8a2950cbdebe323aafa350d953ab4c0463ec66766a8362013b not found: ID does not exist" containerID="5d766d69f4d30a8a2950cbdebe323aafa350d953ab4c0463ec66766a8362013b" Aug 05 17:22:20.575691 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:20.575631 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d766d69f4d30a8a2950cbdebe323aafa350d953ab4c0463ec66766a8362013b"} err="failed to get container status \"5d766d69f4d30a8a2950cbdebe323aafa350d953ab4c0463ec66766a8362013b\": rpc error: code = NotFound desc = could not find container \"5d766d69f4d30a8a2950cbdebe323aafa350d953ab4c0463ec66766a8362013b\": container with ID starting with 5d766d69f4d30a8a2950cbdebe323aafa350d953ab4c0463ec66766a8362013b not found: ID does not exist" Aug 05 17:22:20.590419 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:20.590376 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-6f49dcd9ff-cm7s8" podStartSLOduration=1.280473367 podStartE2EDuration="1.590361903s" totalImagesPullingTime="309.888536ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:22:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:22:20.588294364 +0000 UTC m=+591.760818287" watchObservedRunningTime="2026-08-05 17:22:20.590361903 +0000 UTC m=+591.762886145" Aug 05 17:22:20.603120 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:20.602992 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-6f49dcd9ff-8hd2f"] Aug 05 17:22:20.605099 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:20.605078 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-6f49dcd9ff-8hd2f"] Aug 05 17:22:21.440284 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:21.440244 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20e5fdeb-abe3-4435-bbd3-33271ba125b2" path="/var/lib/kubelet/pods/20e5fdeb-abe3-4435-bbd3-33271ba125b2/volumes" Aug 05 17:22:51.578709 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:51.578627 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-6f49dcd9ff-cm7s8" Aug 05 17:22:52.921637 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:52.921604 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-7b954ffc95-s88zv"] Aug 05 17:22:52.922019 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:52.921883 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20e5fdeb-abe3-4435-bbd3-33271ba125b2" containerName="manager" Aug 05 17:22:52.922019 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:52.921893 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="20e5fdeb-abe3-4435-bbd3-33271ba125b2" containerName="manager" Aug 05 17:22:52.922019 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:52.921953 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="20e5fdeb-abe3-4435-bbd3-33271ba125b2" containerName="manager" Aug 05 17:22:52.925832 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:52.925813 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-s88zv" Aug 05 17:22:52.931833 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:52.931804 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-f6nr6\"" Aug 05 17:22:52.932733 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:52.932687 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\"" Aug 05 17:22:52.940026 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:52.940003 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-s88zv"] Aug 05 17:22:53.048930 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:53.048886 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq226\" (UniqueName: \"kubernetes.io/projected/c85c19ca-6225-4b34-9262-1efea0ca1d6a-kube-api-access-dq226\") pod \"model-serving-api-7b954ffc95-s88zv\" (UID: \"c85c19ca-6225-4b34-9262-1efea0ca1d6a\") " pod="kserve/model-serving-api-7b954ffc95-s88zv" Aug 05 17:22:53.048930 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:53.048929 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c85c19ca-6225-4b34-9262-1efea0ca1d6a-tls-certs\") pod \"model-serving-api-7b954ffc95-s88zv\" (UID: \"c85c19ca-6225-4b34-9262-1efea0ca1d6a\") " pod="kserve/model-serving-api-7b954ffc95-s88zv" Aug 05 17:22:53.150386 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:53.150327 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq226\" (UniqueName: \"kubernetes.io/projected/c85c19ca-6225-4b34-9262-1efea0ca1d6a-kube-api-access-dq226\") pod \"model-serving-api-7b954ffc95-s88zv\" (UID: \"c85c19ca-6225-4b34-9262-1efea0ca1d6a\") " pod="kserve/model-serving-api-7b954ffc95-s88zv" Aug 05 17:22:53.150526 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:53.150400 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c85c19ca-6225-4b34-9262-1efea0ca1d6a-tls-certs\") pod \"model-serving-api-7b954ffc95-s88zv\" (UID: \"c85c19ca-6225-4b34-9262-1efea0ca1d6a\") " pod="kserve/model-serving-api-7b954ffc95-s88zv" Aug 05 17:22:53.152966 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:53.152927 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c85c19ca-6225-4b34-9262-1efea0ca1d6a-tls-certs\") pod \"model-serving-api-7b954ffc95-s88zv\" (UID: \"c85c19ca-6225-4b34-9262-1efea0ca1d6a\") " pod="kserve/model-serving-api-7b954ffc95-s88zv" Aug 05 17:22:53.159883 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:53.159855 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq226\" (UniqueName: \"kubernetes.io/projected/c85c19ca-6225-4b34-9262-1efea0ca1d6a-kube-api-access-dq226\") pod \"model-serving-api-7b954ffc95-s88zv\" (UID: \"c85c19ca-6225-4b34-9262-1efea0ca1d6a\") " pod="kserve/model-serving-api-7b954ffc95-s88zv" Aug 05 17:22:53.236666 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:53.236583 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-s88zv" Aug 05 17:22:53.365806 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:53.365764 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-s88zv"] Aug 05 17:22:53.369422 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:22:53.369393 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc85c19ca_6225_4b34_9262_1efea0ca1d6a.slice/crio-4401c59bdefed13d2a62bab2a2e3e166bcdcb0a194f5d7731fd75a58adcfbea0 WatchSource:0}: Error finding container 4401c59bdefed13d2a62bab2a2e3e166bcdcb0a194f5d7731fd75a58adcfbea0: Status 404 returned error can't find the container with id 4401c59bdefed13d2a62bab2a2e3e166bcdcb0a194f5d7731fd75a58adcfbea0 Aug 05 17:22:53.699965 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:53.699929 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-s88zv" event={"ID":"c85c19ca-6225-4b34-9262-1efea0ca1d6a","Type":"ContainerStarted","Data":"4401c59bdefed13d2a62bab2a2e3e166bcdcb0a194f5d7731fd75a58adcfbea0"} Aug 05 17:22:55.710282 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:55.710182 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-s88zv" event={"ID":"c85c19ca-6225-4b34-9262-1efea0ca1d6a","Type":"ContainerStarted","Data":"7390c5cca34f86b922f5245ad38cfa804b0227485725dc1cd97f8c70418ca13e"} Aug 05 17:22:55.710674 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:55.710298 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-7b954ffc95-s88zv" Aug 05 17:22:55.728482 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:22:55.728433 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-7b954ffc95-s88zv" podStartSLOduration=1.6550286330000001 podStartE2EDuration="3.728417309s" totalImagesPullingTime="2.073388676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:22:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:22:55.72745199 +0000 UTC m=+626.899975901" watchObservedRunningTime="2026-08-05 17:22:55.728417309 +0000 UTC m=+626.900941220" Aug 05 17:23:06.718483 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:23:06.718454 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-7b954ffc95-s88zv" Aug 05 17:26:00.898692 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:00.898603 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-829a9-54c877bfc8-tsdm4"] Aug 05 17:26:00.901723 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:00.901704 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-829a9-54c877bfc8-tsdm4" Aug 05 17:26:00.904403 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:00.904378 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-829a9-serving-cert\"" Aug 05 17:26:00.904534 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:00.904412 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-829a9-kube-rbac-proxy-sar-config\"" Aug 05 17:26:00.904534 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:00.904418 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Aug 05 17:26:00.904534 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:00.904482 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-5hw69\"" Aug 05 17:26:00.911958 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:00.911930 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-829a9-54c877bfc8-tsdm4"] Aug 05 17:26:00.913933 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:00.913908 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62a317fa-a65b-4257-b262-b2bc5c93945a-openshift-service-ca-bundle\") pod \"switch-graph-829a9-54c877bfc8-tsdm4\" (UID: \"62a317fa-a65b-4257-b262-b2bc5c93945a\") " pod="kserve-ci-e2e-test/switch-graph-829a9-54c877bfc8-tsdm4" Aug 05 17:26:00.914051 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:00.913974 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/62a317fa-a65b-4257-b262-b2bc5c93945a-proxy-tls\") pod \"switch-graph-829a9-54c877bfc8-tsdm4\" (UID: \"62a317fa-a65b-4257-b262-b2bc5c93945a\") " pod="kserve-ci-e2e-test/switch-graph-829a9-54c877bfc8-tsdm4" Aug 05 17:26:01.015408 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:01.015361 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62a317fa-a65b-4257-b262-b2bc5c93945a-openshift-service-ca-bundle\") pod \"switch-graph-829a9-54c877bfc8-tsdm4\" (UID: \"62a317fa-a65b-4257-b262-b2bc5c93945a\") " pod="kserve-ci-e2e-test/switch-graph-829a9-54c877bfc8-tsdm4" Aug 05 17:26:01.015612 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:01.015430 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/62a317fa-a65b-4257-b262-b2bc5c93945a-proxy-tls\") pod \"switch-graph-829a9-54c877bfc8-tsdm4\" (UID: \"62a317fa-a65b-4257-b262-b2bc5c93945a\") " pod="kserve-ci-e2e-test/switch-graph-829a9-54c877bfc8-tsdm4" Aug 05 17:26:01.015612 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:26:01.015537 2562 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-829a9-serving-cert: secret "switch-graph-829a9-serving-cert" not found Aug 05 17:26:01.015729 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:26:01.015616 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62a317fa-a65b-4257-b262-b2bc5c93945a-proxy-tls podName:62a317fa-a65b-4257-b262-b2bc5c93945a nodeName:}" failed. No retries permitted until 2026-08-05 17:26:01.5155952 +0000 UTC m=+812.688119090 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/62a317fa-a65b-4257-b262-b2bc5c93945a-proxy-tls") pod "switch-graph-829a9-54c877bfc8-tsdm4" (UID: "62a317fa-a65b-4257-b262-b2bc5c93945a") : secret "switch-graph-829a9-serving-cert" not found Aug 05 17:26:01.016015 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:01.015996 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62a317fa-a65b-4257-b262-b2bc5c93945a-openshift-service-ca-bundle\") pod \"switch-graph-829a9-54c877bfc8-tsdm4\" (UID: \"62a317fa-a65b-4257-b262-b2bc5c93945a\") " pod="kserve-ci-e2e-test/switch-graph-829a9-54c877bfc8-tsdm4" Aug 05 17:26:01.519835 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:01.519773 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/62a317fa-a65b-4257-b262-b2bc5c93945a-proxy-tls\") pod \"switch-graph-829a9-54c877bfc8-tsdm4\" (UID: \"62a317fa-a65b-4257-b262-b2bc5c93945a\") " pod="kserve-ci-e2e-test/switch-graph-829a9-54c877bfc8-tsdm4" Aug 05 17:26:01.522246 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:01.522222 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/62a317fa-a65b-4257-b262-b2bc5c93945a-proxy-tls\") pod \"switch-graph-829a9-54c877bfc8-tsdm4\" (UID: \"62a317fa-a65b-4257-b262-b2bc5c93945a\") " pod="kserve-ci-e2e-test/switch-graph-829a9-54c877bfc8-tsdm4" Aug 05 17:26:01.813408 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:01.813292 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-829a9-54c877bfc8-tsdm4" Aug 05 17:26:01.940226 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:01.940197 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-829a9-54c877bfc8-tsdm4"] Aug 05 17:26:01.943071 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:26:01.943037 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62a317fa_a65b_4257_b262_b2bc5c93945a.slice/crio-bcb583533138ea1ebc18edd5d5681a8ead0e25a234490ad06e1b0652bdc8bb07 WatchSource:0}: Error finding container bcb583533138ea1ebc18edd5d5681a8ead0e25a234490ad06e1b0652bdc8bb07: Status 404 returned error can't find the container with id bcb583533138ea1ebc18edd5d5681a8ead0e25a234490ad06e1b0652bdc8bb07 Aug 05 17:26:01.944986 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:01.944969 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 05 17:26:02.457326 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:02.457289 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-829a9-54c877bfc8-tsdm4" event={"ID":"62a317fa-a65b-4257-b262-b2bc5c93945a","Type":"ContainerStarted","Data":"bcb583533138ea1ebc18edd5d5681a8ead0e25a234490ad06e1b0652bdc8bb07"} Aug 05 17:26:04.466815 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:04.466775 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-829a9-54c877bfc8-tsdm4" event={"ID":"62a317fa-a65b-4257-b262-b2bc5c93945a","Type":"ContainerStarted","Data":"44670fd2b9806833a70f7c7c368678704f9d16f52f2830348beb146e6ab5f476"} Aug 05 17:26:04.467236 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:04.466842 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-829a9-54c877bfc8-tsdm4" Aug 05 17:26:04.485019 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:04.484969 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-829a9-54c877bfc8-tsdm4" podStartSLOduration=2.1692399350000002 podStartE2EDuration="4.484952593s" totalImagesPullingTime="2.315712658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:26:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:26:04.484573416 +0000 UTC m=+815.657097327" watchObservedRunningTime="2026-08-05 17:26:04.484952593 +0000 UTC m=+815.657476504" Aug 05 17:26:10.477080 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:10.477052 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-829a9-54c877bfc8-tsdm4" Aug 05 17:26:11.101081 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:11.101051 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-829a9-54c877bfc8-tsdm4"] Aug 05 17:26:11.101257 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:11.101214 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-829a9-54c877bfc8-tsdm4" podUID="62a317fa-a65b-4257-b262-b2bc5c93945a" containerName="switch-graph-829a9" containerID="cri-o://44670fd2b9806833a70f7c7c368678704f9d16f52f2830348beb146e6ab5f476" gracePeriod=30 Aug 05 17:26:15.475165 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:15.475121 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-829a9-54c877bfc8-tsdm4" podUID="62a317fa-a65b-4257-b262-b2bc5c93945a" containerName="switch-graph-829a9" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:26:20.474907 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:20.474860 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-829a9-54c877bfc8-tsdm4" podUID="62a317fa-a65b-4257-b262-b2bc5c93945a" containerName="switch-graph-829a9" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:26:25.474982 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:25.474945 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-829a9-54c877bfc8-tsdm4" podUID="62a317fa-a65b-4257-b262-b2bc5c93945a" containerName="switch-graph-829a9" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:26:25.475484 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:25.475050 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-829a9-54c877bfc8-tsdm4" Aug 05 17:26:30.474408 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:30.474362 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-829a9-54c877bfc8-tsdm4" podUID="62a317fa-a65b-4257-b262-b2bc5c93945a" containerName="switch-graph-829a9" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:26:35.474846 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:35.474804 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-829a9-54c877bfc8-tsdm4" podUID="62a317fa-a65b-4257-b262-b2bc5c93945a" containerName="switch-graph-829a9" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:26:40.475348 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:40.475288 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-829a9-54c877bfc8-tsdm4" podUID="62a317fa-a65b-4257-b262-b2bc5c93945a" containerName="switch-graph-829a9" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:26:41.616939 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:41.616906 2562 generic.go:356] "Generic (PLEG): container finished" podID="62a317fa-a65b-4257-b262-b2bc5c93945a" containerID="44670fd2b9806833a70f7c7c368678704f9d16f52f2830348beb146e6ab5f476" exitCode=0 Aug 05 17:26:41.617296 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:41.616965 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-829a9-54c877bfc8-tsdm4" event={"ID":"62a317fa-a65b-4257-b262-b2bc5c93945a","Type":"ContainerDied","Data":"44670fd2b9806833a70f7c7c368678704f9d16f52f2830348beb146e6ab5f476"} Aug 05 17:26:41.746483 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:41.746455 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-829a9-54c877bfc8-tsdm4" Aug 05 17:26:41.836296 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:41.836263 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62a317fa-a65b-4257-b262-b2bc5c93945a-openshift-service-ca-bundle\") pod \"62a317fa-a65b-4257-b262-b2bc5c93945a\" (UID: \"62a317fa-a65b-4257-b262-b2bc5c93945a\") " Aug 05 17:26:41.836296 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:41.836303 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/62a317fa-a65b-4257-b262-b2bc5c93945a-proxy-tls\") pod \"62a317fa-a65b-4257-b262-b2bc5c93945a\" (UID: \"62a317fa-a65b-4257-b262-b2bc5c93945a\") " Aug 05 17:26:41.836710 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:41.836683 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62a317fa-a65b-4257-b262-b2bc5c93945a-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "62a317fa-a65b-4257-b262-b2bc5c93945a" (UID: "62a317fa-a65b-4257-b262-b2bc5c93945a"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:26:41.838491 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:41.838463 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62a317fa-a65b-4257-b262-b2bc5c93945a-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "62a317fa-a65b-4257-b262-b2bc5c93945a" (UID: "62a317fa-a65b-4257-b262-b2bc5c93945a"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:26:41.937901 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:41.937813 2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62a317fa-a65b-4257-b262-b2bc5c93945a-openshift-service-ca-bundle\") on node \"ip-10-0-137-104.ec2.internal\" DevicePath \"\"" Aug 05 17:26:41.937901 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:41.937843 2562 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/62a317fa-a65b-4257-b262-b2bc5c93945a-proxy-tls\") on node \"ip-10-0-137-104.ec2.internal\" DevicePath \"\"" Aug 05 17:26:42.622230 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:42.622192 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-829a9-54c877bfc8-tsdm4" Aug 05 17:26:42.622230 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:42.622214 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-829a9-54c877bfc8-tsdm4" event={"ID":"62a317fa-a65b-4257-b262-b2bc5c93945a","Type":"ContainerDied","Data":"bcb583533138ea1ebc18edd5d5681a8ead0e25a234490ad06e1b0652bdc8bb07"} Aug 05 17:26:42.622768 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:42.622279 2562 scope.go:117] "RemoveContainer" containerID="44670fd2b9806833a70f7c7c368678704f9d16f52f2830348beb146e6ab5f476" Aug 05 17:26:42.644559 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:42.644533 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-829a9-54c877bfc8-tsdm4"] Aug 05 17:26:42.648489 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:42.648469 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-829a9-54c877bfc8-tsdm4"] Aug 05 17:26:43.440555 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:26:43.440521 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62a317fa-a65b-4257-b262-b2bc5c93945a" path="/var/lib/kubelet/pods/62a317fa-a65b-4257-b262-b2bc5c93945a/volumes" Aug 05 17:27:00.922365 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:00.922316 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-d84c755c4-7922z"] Aug 05 17:27:00.922735 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:00.922662 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62a317fa-a65b-4257-b262-b2bc5c93945a" containerName="switch-graph-829a9" Aug 05 17:27:00.922735 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:00.922675 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="62a317fa-a65b-4257-b262-b2bc5c93945a" containerName="switch-graph-829a9" Aug 05 17:27:00.922810 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:00.922740 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="62a317fa-a65b-4257-b262-b2bc5c93945a" containerName="switch-graph-829a9" Aug 05 17:27:00.925541 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:00.925522 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-d84c755c4-7922z" Aug 05 17:27:00.928113 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:00.928092 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-kube-rbac-proxy-sar-config\"" Aug 05 17:27:00.928328 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:00.928314 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-serving-cert\"" Aug 05 17:27:00.928449 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:00.928385 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-5hw69\"" Aug 05 17:27:00.928449 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:00.928435 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Aug 05 17:27:00.934388 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:00.934365 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-d84c755c4-7922z"] Aug 05 17:27:01.089562 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:01.089524 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec59023a-b86f-4b3a-9bcb-f4931640a3a7-openshift-service-ca-bundle\") pod \"model-chainer-d84c755c4-7922z\" (UID: \"ec59023a-b86f-4b3a-9bcb-f4931640a3a7\") " pod="kserve-ci-e2e-test/model-chainer-d84c755c4-7922z" Aug 05 17:27:01.089736 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:01.089574 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ec59023a-b86f-4b3a-9bcb-f4931640a3a7-proxy-tls\") pod \"model-chainer-d84c755c4-7922z\" (UID: \"ec59023a-b86f-4b3a-9bcb-f4931640a3a7\") " pod="kserve-ci-e2e-test/model-chainer-d84c755c4-7922z" Aug 05 17:27:01.190226 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:01.190130 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec59023a-b86f-4b3a-9bcb-f4931640a3a7-openshift-service-ca-bundle\") pod \"model-chainer-d84c755c4-7922z\" (UID: \"ec59023a-b86f-4b3a-9bcb-f4931640a3a7\") " pod="kserve-ci-e2e-test/model-chainer-d84c755c4-7922z" Aug 05 17:27:01.190226 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:01.190179 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ec59023a-b86f-4b3a-9bcb-f4931640a3a7-proxy-tls\") pod \"model-chainer-d84c755c4-7922z\" (UID: \"ec59023a-b86f-4b3a-9bcb-f4931640a3a7\") " pod="kserve-ci-e2e-test/model-chainer-d84c755c4-7922z" Aug 05 17:27:01.190871 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:01.190845 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec59023a-b86f-4b3a-9bcb-f4931640a3a7-openshift-service-ca-bundle\") pod \"model-chainer-d84c755c4-7922z\" (UID: \"ec59023a-b86f-4b3a-9bcb-f4931640a3a7\") " pod="kserve-ci-e2e-test/model-chainer-d84c755c4-7922z" Aug 05 17:27:01.192776 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:01.192754 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ec59023a-b86f-4b3a-9bcb-f4931640a3a7-proxy-tls\") pod \"model-chainer-d84c755c4-7922z\" (UID: \"ec59023a-b86f-4b3a-9bcb-f4931640a3a7\") " pod="kserve-ci-e2e-test/model-chainer-d84c755c4-7922z" Aug 05 17:27:01.236359 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:01.236304 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-d84c755c4-7922z" Aug 05 17:27:01.368169 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:01.368103 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-d84c755c4-7922z"] Aug 05 17:27:01.370862 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:27:01.370833 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec59023a_b86f_4b3a_9bcb_f4931640a3a7.slice/crio-9698dce67f88db0a69fdd5e9a5992b4ac516aa982231e47a5c6c025a391013a1 WatchSource:0}: Error finding container 9698dce67f88db0a69fdd5e9a5992b4ac516aa982231e47a5c6c025a391013a1: Status 404 returned error can't find the container with id 9698dce67f88db0a69fdd5e9a5992b4ac516aa982231e47a5c6c025a391013a1 Aug 05 17:27:01.701859 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:01.701827 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-d84c755c4-7922z" event={"ID":"ec59023a-b86f-4b3a-9bcb-f4931640a3a7","Type":"ContainerStarted","Data":"d9bf5c55cd1ff80ba425da42b433a774eca53c65c173ec7061e14725f408b1bb"} Aug 05 17:27:01.702033 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:01.701877 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-d84c755c4-7922z" event={"ID":"ec59023a-b86f-4b3a-9bcb-f4931640a3a7","Type":"ContainerStarted","Data":"9698dce67f88db0a69fdd5e9a5992b4ac516aa982231e47a5c6c025a391013a1"} Aug 05 17:27:01.702033 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:01.701903 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-d84c755c4-7922z" Aug 05 17:27:01.718829 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:01.718782 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-d84c755c4-7922z" podStartSLOduration=1.718758555 podStartE2EDuration="1.718758555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:27:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:27:01.717235494 +0000 UTC m=+872.889759406" watchObservedRunningTime="2026-08-05 17:27:01.718758555 +0000 UTC m=+872.891282465" Aug 05 17:27:07.713916 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:07.713879 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-d84c755c4-7922z" Aug 05 17:27:11.021350 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:11.021311 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-d84c755c4-7922z"] Aug 05 17:27:11.021809 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:11.021669 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-d84c755c4-7922z" podUID="ec59023a-b86f-4b3a-9bcb-f4931640a3a7" containerName="model-chainer" containerID="cri-o://d9bf5c55cd1ff80ba425da42b433a774eca53c65c173ec7061e14725f408b1bb" gracePeriod=30 Aug 05 17:27:11.372346 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:11.372254 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-a0ee2-54954f7959-hxcg6"] Aug 05 17:27:11.374575 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:11.374559 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-a0ee2-54954f7959-hxcg6" Aug 05 17:27:11.378409 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:11.378385 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-a0ee2-kube-rbac-proxy-sar-config\"" Aug 05 17:27:11.378545 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:11.378434 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-a0ee2-serving-cert\"" Aug 05 17:27:11.388565 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:11.388543 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-a0ee2-54954f7959-hxcg6"] Aug 05 17:27:11.469805 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:11.469767 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72df30ba-8071-45e0-98cc-da8ff0a18f61-openshift-service-ca-bundle\") pod \"switch-graph-a0ee2-54954f7959-hxcg6\" (UID: \"72df30ba-8071-45e0-98cc-da8ff0a18f61\") " pod="kserve-ci-e2e-test/switch-graph-a0ee2-54954f7959-hxcg6" Aug 05 17:27:11.470021 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:11.469814 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/72df30ba-8071-45e0-98cc-da8ff0a18f61-proxy-tls\") pod \"switch-graph-a0ee2-54954f7959-hxcg6\" (UID: \"72df30ba-8071-45e0-98cc-da8ff0a18f61\") " pod="kserve-ci-e2e-test/switch-graph-a0ee2-54954f7959-hxcg6" Aug 05 17:27:11.571091 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:11.571056 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72df30ba-8071-45e0-98cc-da8ff0a18f61-openshift-service-ca-bundle\") pod \"switch-graph-a0ee2-54954f7959-hxcg6\" (UID: \"72df30ba-8071-45e0-98cc-da8ff0a18f61\") " pod="kserve-ci-e2e-test/switch-graph-a0ee2-54954f7959-hxcg6" Aug 05 17:27:11.571242 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:11.571100 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/72df30ba-8071-45e0-98cc-da8ff0a18f61-proxy-tls\") pod \"switch-graph-a0ee2-54954f7959-hxcg6\" (UID: \"72df30ba-8071-45e0-98cc-da8ff0a18f61\") " pod="kserve-ci-e2e-test/switch-graph-a0ee2-54954f7959-hxcg6" Aug 05 17:27:11.571740 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:11.571711 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72df30ba-8071-45e0-98cc-da8ff0a18f61-openshift-service-ca-bundle\") pod \"switch-graph-a0ee2-54954f7959-hxcg6\" (UID: \"72df30ba-8071-45e0-98cc-da8ff0a18f61\") " pod="kserve-ci-e2e-test/switch-graph-a0ee2-54954f7959-hxcg6" Aug 05 17:27:11.573805 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:11.573776 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/72df30ba-8071-45e0-98cc-da8ff0a18f61-proxy-tls\") pod \"switch-graph-a0ee2-54954f7959-hxcg6\" (UID: \"72df30ba-8071-45e0-98cc-da8ff0a18f61\") " pod="kserve-ci-e2e-test/switch-graph-a0ee2-54954f7959-hxcg6" Aug 05 17:27:11.685376 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:11.685267 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-a0ee2-54954f7959-hxcg6" Aug 05 17:27:11.827386 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:11.827357 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-a0ee2-54954f7959-hxcg6"] Aug 05 17:27:11.830030 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:27:11.830003 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72df30ba_8071_45e0_98cc_da8ff0a18f61.slice/crio-f8a1caac0529c92c2c3297259657a2f9c01e019830c7e2351a64203b4f3c20df WatchSource:0}: Error finding container f8a1caac0529c92c2c3297259657a2f9c01e019830c7e2351a64203b4f3c20df: Status 404 returned error can't find the container with id f8a1caac0529c92c2c3297259657a2f9c01e019830c7e2351a64203b4f3c20df Aug 05 17:27:12.711722 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:12.711680 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-d84c755c4-7922z" podUID="ec59023a-b86f-4b3a-9bcb-f4931640a3a7" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:27:12.748638 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:12.748605 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-a0ee2-54954f7959-hxcg6" event={"ID":"72df30ba-8071-45e0-98cc-da8ff0a18f61","Type":"ContainerStarted","Data":"5d6c82d8e905d0a6a1b1716f0f4ceca8be69e525494382a279f222ca185b01d0"} Aug 05 17:27:12.748830 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:12.748660 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-a0ee2-54954f7959-hxcg6" event={"ID":"72df30ba-8071-45e0-98cc-da8ff0a18f61","Type":"ContainerStarted","Data":"f8a1caac0529c92c2c3297259657a2f9c01e019830c7e2351a64203b4f3c20df"} Aug 05 17:27:12.748830 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:12.748742 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-a0ee2-54954f7959-hxcg6" Aug 05 17:27:12.770155 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:12.770097 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-a0ee2-54954f7959-hxcg6" podStartSLOduration=1.7700776 podStartE2EDuration="1.7700776s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:27:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:27:12.768800984 +0000 UTC m=+883.941324895" watchObservedRunningTime="2026-08-05 17:27:12.7700776 +0000 UTC m=+883.942601510" Aug 05 17:27:17.711399 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:17.711354 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-d84c755c4-7922z" podUID="ec59023a-b86f-4b3a-9bcb-f4931640a3a7" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:27:18.757918 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:18.757884 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-a0ee2-54954f7959-hxcg6" Aug 05 17:27:22.711712 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:22.711629 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-d84c755c4-7922z" podUID="ec59023a-b86f-4b3a-9bcb-f4931640a3a7" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:27:22.712136 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:22.711755 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-d84c755c4-7922z" Aug 05 17:27:27.710878 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:27.710841 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-d84c755c4-7922z" podUID="ec59023a-b86f-4b3a-9bcb-f4931640a3a7" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:27:32.710816 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:32.710772 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-d84c755c4-7922z" podUID="ec59023a-b86f-4b3a-9bcb-f4931640a3a7" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:27:37.711774 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:37.711736 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-d84c755c4-7922z" podUID="ec59023a-b86f-4b3a-9bcb-f4931640a3a7" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:27:41.661414 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:41.661385 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-d84c755c4-7922z" Aug 05 17:27:41.809643 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:41.809556 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ec59023a-b86f-4b3a-9bcb-f4931640a3a7-proxy-tls\") pod \"ec59023a-b86f-4b3a-9bcb-f4931640a3a7\" (UID: \"ec59023a-b86f-4b3a-9bcb-f4931640a3a7\") " Aug 05 17:27:41.809811 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:41.809669 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec59023a-b86f-4b3a-9bcb-f4931640a3a7-openshift-service-ca-bundle\") pod \"ec59023a-b86f-4b3a-9bcb-f4931640a3a7\" (UID: \"ec59023a-b86f-4b3a-9bcb-f4931640a3a7\") " Aug 05 17:27:41.810019 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:41.809996 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec59023a-b86f-4b3a-9bcb-f4931640a3a7-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "ec59023a-b86f-4b3a-9bcb-f4931640a3a7" (UID: "ec59023a-b86f-4b3a-9bcb-f4931640a3a7"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:27:41.811641 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:41.811617 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec59023a-b86f-4b3a-9bcb-f4931640a3a7-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "ec59023a-b86f-4b3a-9bcb-f4931640a3a7" (UID: "ec59023a-b86f-4b3a-9bcb-f4931640a3a7"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:27:41.865893 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:41.865860 2562 generic.go:356] "Generic (PLEG): container finished" podID="ec59023a-b86f-4b3a-9bcb-f4931640a3a7" containerID="d9bf5c55cd1ff80ba425da42b433a774eca53c65c173ec7061e14725f408b1bb" exitCode=0 Aug 05 17:27:41.866030 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:41.865916 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-d84c755c4-7922z" Aug 05 17:27:41.866030 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:41.865939 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-d84c755c4-7922z" event={"ID":"ec59023a-b86f-4b3a-9bcb-f4931640a3a7","Type":"ContainerDied","Data":"d9bf5c55cd1ff80ba425da42b433a774eca53c65c173ec7061e14725f408b1bb"} Aug 05 17:27:41.866030 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:41.865991 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-d84c755c4-7922z" event={"ID":"ec59023a-b86f-4b3a-9bcb-f4931640a3a7","Type":"ContainerDied","Data":"9698dce67f88db0a69fdd5e9a5992b4ac516aa982231e47a5c6c025a391013a1"} Aug 05 17:27:41.866030 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:41.866015 2562 scope.go:117] "RemoveContainer" containerID="d9bf5c55cd1ff80ba425da42b433a774eca53c65c173ec7061e14725f408b1bb" Aug 05 17:27:41.873960 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:41.873940 2562 scope.go:117] "RemoveContainer" containerID="d9bf5c55cd1ff80ba425da42b433a774eca53c65c173ec7061e14725f408b1bb" Aug 05 17:27:41.874228 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:27:41.874209 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9bf5c55cd1ff80ba425da42b433a774eca53c65c173ec7061e14725f408b1bb\": container with ID starting with d9bf5c55cd1ff80ba425da42b433a774eca53c65c173ec7061e14725f408b1bb not found: ID does not exist" containerID="d9bf5c55cd1ff80ba425da42b433a774eca53c65c173ec7061e14725f408b1bb" Aug 05 17:27:41.874311 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:41.874235 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9bf5c55cd1ff80ba425da42b433a774eca53c65c173ec7061e14725f408b1bb"} err="failed to get container status \"d9bf5c55cd1ff80ba425da42b433a774eca53c65c173ec7061e14725f408b1bb\": rpc error: code = NotFound desc = could not find container \"d9bf5c55cd1ff80ba425da42b433a774eca53c65c173ec7061e14725f408b1bb\": container with ID starting with d9bf5c55cd1ff80ba425da42b433a774eca53c65c173ec7061e14725f408b1bb not found: ID does not exist" Aug 05 17:27:41.887217 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:41.887191 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-d84c755c4-7922z"] Aug 05 17:27:41.891031 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:41.891011 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-d84c755c4-7922z"] Aug 05 17:27:41.910999 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:41.910977 2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec59023a-b86f-4b3a-9bcb-f4931640a3a7-openshift-service-ca-bundle\") on node \"ip-10-0-137-104.ec2.internal\" DevicePath \"\"" Aug 05 17:27:41.910999 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:41.910999 2562 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ec59023a-b86f-4b3a-9bcb-f4931640a3a7-proxy-tls\") on node \"ip-10-0-137-104.ec2.internal\" DevicePath \"\"" Aug 05 17:27:43.440605 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:27:43.440570 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec59023a-b86f-4b3a-9bcb-f4931640a3a7" path="/var/lib/kubelet/pods/ec59023a-b86f-4b3a-9bcb-f4931640a3a7/volumes" Aug 05 17:28:11.251651 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:28:11.251617 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-d9755-5544975675-kch4r"] Aug 05 17:28:11.254200 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:28:11.251909 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec59023a-b86f-4b3a-9bcb-f4931640a3a7" containerName="model-chainer" Aug 05 17:28:11.254200 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:28:11.251920 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec59023a-b86f-4b3a-9bcb-f4931640a3a7" containerName="model-chainer" Aug 05 17:28:11.254200 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:28:11.251974 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec59023a-b86f-4b3a-9bcb-f4931640a3a7" containerName="model-chainer" Aug 05 17:28:11.255136 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:28:11.255120 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-d9755-5544975675-kch4r" Aug 05 17:28:11.258274 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:28:11.258248 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-d9755-kube-rbac-proxy-sar-config\"" Aug 05 17:28:11.258399 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:28:11.258308 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-d9755-serving-cert\"" Aug 05 17:28:11.266642 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:28:11.266618 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-d9755-5544975675-kch4r"] Aug 05 17:28:11.436053 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:28:11.436020 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a265111b-fd39-47a5-bde4-7dec632e7dfc-openshift-service-ca-bundle\") pod \"sequence-graph-d9755-5544975675-kch4r\" (UID: \"a265111b-fd39-47a5-bde4-7dec632e7dfc\") " pod="kserve-ci-e2e-test/sequence-graph-d9755-5544975675-kch4r" Aug 05 17:28:11.436237 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:28:11.436070 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a265111b-fd39-47a5-bde4-7dec632e7dfc-proxy-tls\") pod \"sequence-graph-d9755-5544975675-kch4r\" (UID: \"a265111b-fd39-47a5-bde4-7dec632e7dfc\") " pod="kserve-ci-e2e-test/sequence-graph-d9755-5544975675-kch4r" Aug 05 17:28:11.537140 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:28:11.537059 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a265111b-fd39-47a5-bde4-7dec632e7dfc-openshift-service-ca-bundle\") pod \"sequence-graph-d9755-5544975675-kch4r\" (UID: \"a265111b-fd39-47a5-bde4-7dec632e7dfc\") " pod="kserve-ci-e2e-test/sequence-graph-d9755-5544975675-kch4r" Aug 05 17:28:11.537140 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:28:11.537109 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a265111b-fd39-47a5-bde4-7dec632e7dfc-proxy-tls\") pod \"sequence-graph-d9755-5544975675-kch4r\" (UID: \"a265111b-fd39-47a5-bde4-7dec632e7dfc\") " pod="kserve-ci-e2e-test/sequence-graph-d9755-5544975675-kch4r" Aug 05 17:28:11.537726 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:28:11.537700 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a265111b-fd39-47a5-bde4-7dec632e7dfc-openshift-service-ca-bundle\") pod \"sequence-graph-d9755-5544975675-kch4r\" (UID: \"a265111b-fd39-47a5-bde4-7dec632e7dfc\") " pod="kserve-ci-e2e-test/sequence-graph-d9755-5544975675-kch4r" Aug 05 17:28:11.539437 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:28:11.539420 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a265111b-fd39-47a5-bde4-7dec632e7dfc-proxy-tls\") pod \"sequence-graph-d9755-5544975675-kch4r\" (UID: \"a265111b-fd39-47a5-bde4-7dec632e7dfc\") " pod="kserve-ci-e2e-test/sequence-graph-d9755-5544975675-kch4r" Aug 05 17:28:11.565328 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:28:11.565306 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-d9755-5544975675-kch4r" Aug 05 17:28:11.687659 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:28:11.687635 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-d9755-5544975675-kch4r"] Aug 05 17:28:11.690096 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:28:11.690069 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda265111b_fd39_47a5_bde4_7dec632e7dfc.slice/crio-f49fb73bf77631450bbd0b2ee2033ad3a95402753968f3440423693b60857736 WatchSource:0}: Error finding container f49fb73bf77631450bbd0b2ee2033ad3a95402753968f3440423693b60857736: Status 404 returned error can't find the container with id f49fb73bf77631450bbd0b2ee2033ad3a95402753968f3440423693b60857736 Aug 05 17:28:11.986477 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:28:11.986394 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-d9755-5544975675-kch4r" event={"ID":"a265111b-fd39-47a5-bde4-7dec632e7dfc","Type":"ContainerStarted","Data":"f0118fe27e0b2df01da4fe4bc5fb5112ad90d13c5eda222b41d6acbfde62de48"} Aug 05 17:28:11.986477 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:28:11.986450 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-d9755-5544975675-kch4r" event={"ID":"a265111b-fd39-47a5-bde4-7dec632e7dfc","Type":"ContainerStarted","Data":"f49fb73bf77631450bbd0b2ee2033ad3a95402753968f3440423693b60857736"} Aug 05 17:28:11.986655 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:28:11.986527 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-d9755-5544975675-kch4r" Aug 05 17:28:12.004401 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:28:12.004331 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-d9755-5544975675-kch4r" podStartSLOduration=1.004316264 podStartE2EDuration="1.004316264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:28:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:28:12.002957208 +0000 UTC m=+943.175481120" watchObservedRunningTime="2026-08-05 17:28:12.004316264 +0000 UTC m=+943.176840175" Aug 05 17:28:17.996465 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:28:17.996437 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-d9755-5544975675-kch4r" Aug 05 17:35:25.967664 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:35:25.967626 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-a0ee2-54954f7959-hxcg6"] Aug 05 17:35:25.970202 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:35:25.967890 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-a0ee2-54954f7959-hxcg6" podUID="72df30ba-8071-45e0-98cc-da8ff0a18f61" containerName="switch-graph-a0ee2" containerID="cri-o://5d6c82d8e905d0a6a1b1716f0f4ceca8be69e525494382a279f222ca185b01d0" gracePeriod=30 Aug 05 17:35:28.756488 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:35:28.756443 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-a0ee2-54954f7959-hxcg6" podUID="72df30ba-8071-45e0-98cc-da8ff0a18f61" containerName="switch-graph-a0ee2" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:35:33.756357 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:35:33.756297 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-a0ee2-54954f7959-hxcg6" podUID="72df30ba-8071-45e0-98cc-da8ff0a18f61" containerName="switch-graph-a0ee2" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:35:38.756412 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:35:38.756373 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-a0ee2-54954f7959-hxcg6" podUID="72df30ba-8071-45e0-98cc-da8ff0a18f61" containerName="switch-graph-a0ee2" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:35:38.756862 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:35:38.756500 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-a0ee2-54954f7959-hxcg6" Aug 05 17:35:43.757239 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:35:43.757194 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-a0ee2-54954f7959-hxcg6" podUID="72df30ba-8071-45e0-98cc-da8ff0a18f61" containerName="switch-graph-a0ee2" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:35:48.756795 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:35:48.756753 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-a0ee2-54954f7959-hxcg6" podUID="72df30ba-8071-45e0-98cc-da8ff0a18f61" containerName="switch-graph-a0ee2" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:35:53.756830 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:35:53.756789 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-a0ee2-54954f7959-hxcg6" podUID="72df30ba-8071-45e0-98cc-da8ff0a18f61" containerName="switch-graph-a0ee2" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:35:56.120687 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:35:56.120650 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-a0ee2-54954f7959-hxcg6" Aug 05 17:35:56.228625 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:35:56.228530 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72df30ba-8071-45e0-98cc-da8ff0a18f61-openshift-service-ca-bundle\") pod \"72df30ba-8071-45e0-98cc-da8ff0a18f61\" (UID: \"72df30ba-8071-45e0-98cc-da8ff0a18f61\") " Aug 05 17:35:56.228625 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:35:56.228574 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/72df30ba-8071-45e0-98cc-da8ff0a18f61-proxy-tls\") pod \"72df30ba-8071-45e0-98cc-da8ff0a18f61\" (UID: \"72df30ba-8071-45e0-98cc-da8ff0a18f61\") " Aug 05 17:35:56.229000 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:35:56.228962 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72df30ba-8071-45e0-98cc-da8ff0a18f61-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "72df30ba-8071-45e0-98cc-da8ff0a18f61" (UID: "72df30ba-8071-45e0-98cc-da8ff0a18f61"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:35:56.230659 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:35:56.230637 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72df30ba-8071-45e0-98cc-da8ff0a18f61-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "72df30ba-8071-45e0-98cc-da8ff0a18f61" (UID: "72df30ba-8071-45e0-98cc-da8ff0a18f61"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:35:56.329502 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:35:56.329467 2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72df30ba-8071-45e0-98cc-da8ff0a18f61-openshift-service-ca-bundle\") on node \"ip-10-0-137-104.ec2.internal\" DevicePath \"\"" Aug 05 17:35:56.329502 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:35:56.329499 2562 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/72df30ba-8071-45e0-98cc-da8ff0a18f61-proxy-tls\") on node \"ip-10-0-137-104.ec2.internal\" DevicePath \"\"" Aug 05 17:35:56.866259 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:35:56.866227 2562 generic.go:356] "Generic (PLEG): container finished" podID="72df30ba-8071-45e0-98cc-da8ff0a18f61" containerID="5d6c82d8e905d0a6a1b1716f0f4ceca8be69e525494382a279f222ca185b01d0" exitCode=0 Aug 05 17:35:56.866452 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:35:56.866266 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-a0ee2-54954f7959-hxcg6" event={"ID":"72df30ba-8071-45e0-98cc-da8ff0a18f61","Type":"ContainerDied","Data":"5d6c82d8e905d0a6a1b1716f0f4ceca8be69e525494382a279f222ca185b01d0"} Aug 05 17:35:56.866452 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:35:56.866270 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-a0ee2-54954f7959-hxcg6" Aug 05 17:35:56.866452 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:35:56.866313 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-a0ee2-54954f7959-hxcg6" event={"ID":"72df30ba-8071-45e0-98cc-da8ff0a18f61","Type":"ContainerDied","Data":"f8a1caac0529c92c2c3297259657a2f9c01e019830c7e2351a64203b4f3c20df"} Aug 05 17:35:56.866452 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:35:56.866349 2562 scope.go:117] "RemoveContainer" containerID="5d6c82d8e905d0a6a1b1716f0f4ceca8be69e525494382a279f222ca185b01d0" Aug 05 17:35:56.874745 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:35:56.874727 2562 scope.go:117] "RemoveContainer" containerID="5d6c82d8e905d0a6a1b1716f0f4ceca8be69e525494382a279f222ca185b01d0" Aug 05 17:35:56.875014 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:35:56.874995 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d6c82d8e905d0a6a1b1716f0f4ceca8be69e525494382a279f222ca185b01d0\": container with ID starting with 5d6c82d8e905d0a6a1b1716f0f4ceca8be69e525494382a279f222ca185b01d0 not found: ID does not exist" containerID="5d6c82d8e905d0a6a1b1716f0f4ceca8be69e525494382a279f222ca185b01d0" Aug 05 17:35:56.875078 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:35:56.875028 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d6c82d8e905d0a6a1b1716f0f4ceca8be69e525494382a279f222ca185b01d0"} err="failed to get container status \"5d6c82d8e905d0a6a1b1716f0f4ceca8be69e525494382a279f222ca185b01d0\": rpc error: code = NotFound desc = could not find container \"5d6c82d8e905d0a6a1b1716f0f4ceca8be69e525494382a279f222ca185b01d0\": container with ID starting with 5d6c82d8e905d0a6a1b1716f0f4ceca8be69e525494382a279f222ca185b01d0 not found: ID does not exist" Aug 05 17:35:56.887810 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:35:56.887784 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-a0ee2-54954f7959-hxcg6"] Aug 05 17:35:56.894449 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:35:56.894424 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-a0ee2-54954f7959-hxcg6"] Aug 05 17:35:57.441155 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:35:57.441112 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72df30ba-8071-45e0-98cc-da8ff0a18f61" path="/var/lib/kubelet/pods/72df30ba-8071-45e0-98cc-da8ff0a18f61/volumes" Aug 05 17:36:25.934925 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:25.934846 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-d9755-5544975675-kch4r"] Aug 05 17:36:25.935298 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:25.935047 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-d9755-5544975675-kch4r" podUID="a265111b-fd39-47a5-bde4-7dec632e7dfc" containerName="sequence-graph-d9755" containerID="cri-o://f0118fe27e0b2df01da4fe4bc5fb5112ad90d13c5eda222b41d6acbfde62de48" gracePeriod=30 Aug 05 17:36:26.242140 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:26.242114 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-fba55-75554f9f4b-9xzw2"] Aug 05 17:36:26.242459 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:26.242444 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72df30ba-8071-45e0-98cc-da8ff0a18f61" containerName="switch-graph-a0ee2" Aug 05 17:36:26.242544 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:26.242460 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="72df30ba-8071-45e0-98cc-da8ff0a18f61" containerName="switch-graph-a0ee2" Aug 05 17:36:26.242544 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:26.242510 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="72df30ba-8071-45e0-98cc-da8ff0a18f61" containerName="switch-graph-a0ee2" Aug 05 17:36:26.245406 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:26.245385 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-fba55-75554f9f4b-9xzw2" Aug 05 17:36:26.249229 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:26.249209 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-fba55-serving-cert\"" Aug 05 17:36:26.249491 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:26.249471 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-fba55-kube-rbac-proxy-sar-config\"" Aug 05 17:36:26.257654 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:26.257627 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-fba55-75554f9f4b-9xzw2"] Aug 05 17:36:26.372129 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:26.372079 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0b4456d4-3d9f-4147-be8d-448129f3d2f3-proxy-tls\") pod \"ensemble-graph-fba55-75554f9f4b-9xzw2\" (UID: \"0b4456d4-3d9f-4147-be8d-448129f3d2f3\") " pod="kserve-ci-e2e-test/ensemble-graph-fba55-75554f9f4b-9xzw2" Aug 05 17:36:26.372325 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:26.372223 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b4456d4-3d9f-4147-be8d-448129f3d2f3-openshift-service-ca-bundle\") pod \"ensemble-graph-fba55-75554f9f4b-9xzw2\" (UID: \"0b4456d4-3d9f-4147-be8d-448129f3d2f3\") " pod="kserve-ci-e2e-test/ensemble-graph-fba55-75554f9f4b-9xzw2" Aug 05 17:36:26.473050 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:26.473007 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0b4456d4-3d9f-4147-be8d-448129f3d2f3-proxy-tls\") pod \"ensemble-graph-fba55-75554f9f4b-9xzw2\" (UID: \"0b4456d4-3d9f-4147-be8d-448129f3d2f3\") " pod="kserve-ci-e2e-test/ensemble-graph-fba55-75554f9f4b-9xzw2" Aug 05 17:36:26.473242 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:26.473068 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b4456d4-3d9f-4147-be8d-448129f3d2f3-openshift-service-ca-bundle\") pod \"ensemble-graph-fba55-75554f9f4b-9xzw2\" (UID: \"0b4456d4-3d9f-4147-be8d-448129f3d2f3\") " pod="kserve-ci-e2e-test/ensemble-graph-fba55-75554f9f4b-9xzw2" Aug 05 17:36:26.473704 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:26.473674 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b4456d4-3d9f-4147-be8d-448129f3d2f3-openshift-service-ca-bundle\") pod \"ensemble-graph-fba55-75554f9f4b-9xzw2\" (UID: \"0b4456d4-3d9f-4147-be8d-448129f3d2f3\") " pod="kserve-ci-e2e-test/ensemble-graph-fba55-75554f9f4b-9xzw2" Aug 05 17:36:26.475505 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:26.475482 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0b4456d4-3d9f-4147-be8d-448129f3d2f3-proxy-tls\") pod \"ensemble-graph-fba55-75554f9f4b-9xzw2\" (UID: \"0b4456d4-3d9f-4147-be8d-448129f3d2f3\") " pod="kserve-ci-e2e-test/ensemble-graph-fba55-75554f9f4b-9xzw2" Aug 05 17:36:26.556015 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:26.555921 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-fba55-75554f9f4b-9xzw2" Aug 05 17:36:26.689766 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:26.689742 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-fba55-75554f9f4b-9xzw2"] Aug 05 17:36:26.691948 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:36:26.691922 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b4456d4_3d9f_4147_be8d_448129f3d2f3.slice/crio-6571815c6f959628548ddf4dee2beaece6b26e0f583b8f01ad9592618f9fab1a WatchSource:0}: Error finding container 6571815c6f959628548ddf4dee2beaece6b26e0f583b8f01ad9592618f9fab1a: Status 404 returned error can't find the container with id 6571815c6f959628548ddf4dee2beaece6b26e0f583b8f01ad9592618f9fab1a Aug 05 17:36:26.991392 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:26.991279 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-fba55-75554f9f4b-9xzw2" event={"ID":"0b4456d4-3d9f-4147-be8d-448129f3d2f3","Type":"ContainerStarted","Data":"3383e892f67d4af6952cec6b77abddd0f98185b51fc4ab44d40a90c16f12b929"} Aug 05 17:36:26.991758 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:26.991406 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-fba55-75554f9f4b-9xzw2" Aug 05 17:36:26.991758 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:26.991427 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-fba55-75554f9f4b-9xzw2" event={"ID":"0b4456d4-3d9f-4147-be8d-448129f3d2f3","Type":"ContainerStarted","Data":"6571815c6f959628548ddf4dee2beaece6b26e0f583b8f01ad9592618f9fab1a"} Aug 05 17:36:27.010639 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:27.010588 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-fba55-75554f9f4b-9xzw2" podStartSLOduration=1.010570673 podStartE2EDuration="1.010570673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:36:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:36:27.008462682 +0000 UTC m=+1438.180986603" watchObservedRunningTime="2026-08-05 17:36:27.010570673 +0000 UTC m=+1438.183094584" Aug 05 17:36:27.995746 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:27.995706 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-d9755-5544975675-kch4r" podUID="a265111b-fd39-47a5-bde4-7dec632e7dfc" containerName="sequence-graph-d9755" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:36:32.994526 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:32.994486 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-d9755-5544975675-kch4r" podUID="a265111b-fd39-47a5-bde4-7dec632e7dfc" containerName="sequence-graph-d9755" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:36:33.001718 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:33.001693 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-fba55-75554f9f4b-9xzw2" Aug 05 17:36:36.278969 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:36.278936 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-fba55-75554f9f4b-9xzw2"] Aug 05 17:36:36.279387 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:36.279112 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-fba55-75554f9f4b-9xzw2" podUID="0b4456d4-3d9f-4147-be8d-448129f3d2f3" containerName="ensemble-graph-fba55" containerID="cri-o://3383e892f67d4af6952cec6b77abddd0f98185b51fc4ab44d40a90c16f12b929" gracePeriod=30 Aug 05 17:36:37.994280 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:37.994237 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-d9755-5544975675-kch4r" podUID="a265111b-fd39-47a5-bde4-7dec632e7dfc" containerName="sequence-graph-d9755" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:36:37.994714 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:37.994368 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-d9755-5544975675-kch4r" Aug 05 17:36:38.000483 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:38.000454 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-fba55-75554f9f4b-9xzw2" podUID="0b4456d4-3d9f-4147-be8d-448129f3d2f3" containerName="ensemble-graph-fba55" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:36:42.994786 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:42.994740 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-d9755-5544975675-kch4r" podUID="a265111b-fd39-47a5-bde4-7dec632e7dfc" containerName="sequence-graph-d9755" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:36:43.000296 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:43.000262 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-fba55-75554f9f4b-9xzw2" podUID="0b4456d4-3d9f-4147-be8d-448129f3d2f3" containerName="ensemble-graph-fba55" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:36:47.995225 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:47.995186 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-d9755-5544975675-kch4r" podUID="a265111b-fd39-47a5-bde4-7dec632e7dfc" containerName="sequence-graph-d9755" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:36:47.999622 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:47.999590 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-fba55-75554f9f4b-9xzw2" podUID="0b4456d4-3d9f-4147-be8d-448129f3d2f3" containerName="ensemble-graph-fba55" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:36:47.999730 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:47.999684 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-fba55-75554f9f4b-9xzw2" Aug 05 17:36:52.994318 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:52.994274 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-d9755-5544975675-kch4r" podUID="a265111b-fd39-47a5-bde4-7dec632e7dfc" containerName="sequence-graph-d9755" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:36:52.999788 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:52.999756 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-fba55-75554f9f4b-9xzw2" podUID="0b4456d4-3d9f-4147-be8d-448129f3d2f3" containerName="ensemble-graph-fba55" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:36:56.091544 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:56.091511 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-d9755-5544975675-kch4r" Aug 05 17:36:56.115102 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:56.114988 2562 generic.go:356] "Generic (PLEG): container finished" podID="a265111b-fd39-47a5-bde4-7dec632e7dfc" containerID="f0118fe27e0b2df01da4fe4bc5fb5112ad90d13c5eda222b41d6acbfde62de48" exitCode=0 Aug 05 17:36:56.115102 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:56.115042 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-d9755-5544975675-kch4r" Aug 05 17:36:56.115102 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:56.115043 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-d9755-5544975675-kch4r" event={"ID":"a265111b-fd39-47a5-bde4-7dec632e7dfc","Type":"ContainerDied","Data":"f0118fe27e0b2df01da4fe4bc5fb5112ad90d13c5eda222b41d6acbfde62de48"} Aug 05 17:36:56.115419 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:56.115122 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-d9755-5544975675-kch4r" event={"ID":"a265111b-fd39-47a5-bde4-7dec632e7dfc","Type":"ContainerDied","Data":"f49fb73bf77631450bbd0b2ee2033ad3a95402753968f3440423693b60857736"} Aug 05 17:36:56.115419 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:56.115157 2562 scope.go:117] "RemoveContainer" containerID="f0118fe27e0b2df01da4fe4bc5fb5112ad90d13c5eda222b41d6acbfde62de48" Aug 05 17:36:56.123754 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:56.123731 2562 scope.go:117] "RemoveContainer" containerID="f0118fe27e0b2df01da4fe4bc5fb5112ad90d13c5eda222b41d6acbfde62de48" Aug 05 17:36:56.124071 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:36:56.124053 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0118fe27e0b2df01da4fe4bc5fb5112ad90d13c5eda222b41d6acbfde62de48\": container with ID starting with f0118fe27e0b2df01da4fe4bc5fb5112ad90d13c5eda222b41d6acbfde62de48 not found: ID does not exist" containerID="f0118fe27e0b2df01da4fe4bc5fb5112ad90d13c5eda222b41d6acbfde62de48" Aug 05 17:36:56.124157 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:56.124078 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0118fe27e0b2df01da4fe4bc5fb5112ad90d13c5eda222b41d6acbfde62de48"} err="failed to get container status \"f0118fe27e0b2df01da4fe4bc5fb5112ad90d13c5eda222b41d6acbfde62de48\": rpc error: code = NotFound desc = could not find container \"f0118fe27e0b2df01da4fe4bc5fb5112ad90d13c5eda222b41d6acbfde62de48\": container with ID starting with f0118fe27e0b2df01da4fe4bc5fb5112ad90d13c5eda222b41d6acbfde62de48 not found: ID does not exist" Aug 05 17:36:56.214906 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:56.214817 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a265111b-fd39-47a5-bde4-7dec632e7dfc-openshift-service-ca-bundle\") pod \"a265111b-fd39-47a5-bde4-7dec632e7dfc\" (UID: \"a265111b-fd39-47a5-bde4-7dec632e7dfc\") " Aug 05 17:36:56.214906 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:56.214870 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a265111b-fd39-47a5-bde4-7dec632e7dfc-proxy-tls\") pod \"a265111b-fd39-47a5-bde4-7dec632e7dfc\" (UID: \"a265111b-fd39-47a5-bde4-7dec632e7dfc\") " Aug 05 17:36:56.215210 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:56.215186 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a265111b-fd39-47a5-bde4-7dec632e7dfc-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "a265111b-fd39-47a5-bde4-7dec632e7dfc" (UID: "a265111b-fd39-47a5-bde4-7dec632e7dfc"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:36:56.216940 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:56.216918 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a265111b-fd39-47a5-bde4-7dec632e7dfc-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "a265111b-fd39-47a5-bde4-7dec632e7dfc" (UID: "a265111b-fd39-47a5-bde4-7dec632e7dfc"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:36:56.315658 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:56.315622 2562 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a265111b-fd39-47a5-bde4-7dec632e7dfc-proxy-tls\") on node \"ip-10-0-137-104.ec2.internal\" DevicePath \"\"" Aug 05 17:36:56.315658 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:56.315652 2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a265111b-fd39-47a5-bde4-7dec632e7dfc-openshift-service-ca-bundle\") on node \"ip-10-0-137-104.ec2.internal\" DevicePath \"\"" Aug 05 17:36:56.438882 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:56.438846 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-d9755-5544975675-kch4r"] Aug 05 17:36:56.443928 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:56.443900 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-d9755-5544975675-kch4r"] Aug 05 17:36:57.440447 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:57.440414 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a265111b-fd39-47a5-bde4-7dec632e7dfc" path="/var/lib/kubelet/pods/a265111b-fd39-47a5-bde4-7dec632e7dfc/volumes" Aug 05 17:36:57.999986 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:36:57.999948 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-fba55-75554f9f4b-9xzw2" podUID="0b4456d4-3d9f-4147-be8d-448129f3d2f3" containerName="ensemble-graph-fba55" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:37:03.000089 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:03.000049 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-fba55-75554f9f4b-9xzw2" podUID="0b4456d4-3d9f-4147-be8d-448129f3d2f3" containerName="ensemble-graph-fba55" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:37:06.421684 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:06.421659 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-fba55-75554f9f4b-9xzw2" Aug 05 17:37:06.596247 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:06.596164 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0b4456d4-3d9f-4147-be8d-448129f3d2f3-proxy-tls\") pod \"0b4456d4-3d9f-4147-be8d-448129f3d2f3\" (UID: \"0b4456d4-3d9f-4147-be8d-448129f3d2f3\") " Aug 05 17:37:06.596247 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:06.596207 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b4456d4-3d9f-4147-be8d-448129f3d2f3-openshift-service-ca-bundle\") pod \"0b4456d4-3d9f-4147-be8d-448129f3d2f3\" (UID: \"0b4456d4-3d9f-4147-be8d-448129f3d2f3\") " Aug 05 17:37:06.596609 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:06.596577 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b4456d4-3d9f-4147-be8d-448129f3d2f3-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "0b4456d4-3d9f-4147-be8d-448129f3d2f3" (UID: "0b4456d4-3d9f-4147-be8d-448129f3d2f3"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:37:06.598223 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:06.598188 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b4456d4-3d9f-4147-be8d-448129f3d2f3-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "0b4456d4-3d9f-4147-be8d-448129f3d2f3" (UID: "0b4456d4-3d9f-4147-be8d-448129f3d2f3"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:37:06.697071 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:06.697031 2562 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0b4456d4-3d9f-4147-be8d-448129f3d2f3-proxy-tls\") on node \"ip-10-0-137-104.ec2.internal\" DevicePath \"\"" Aug 05 17:37:06.697071 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:06.697071 2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b4456d4-3d9f-4147-be8d-448129f3d2f3-openshift-service-ca-bundle\") on node \"ip-10-0-137-104.ec2.internal\" DevicePath \"\"" Aug 05 17:37:07.162020 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:07.161987 2562 generic.go:356] "Generic (PLEG): container finished" podID="0b4456d4-3d9f-4147-be8d-448129f3d2f3" containerID="3383e892f67d4af6952cec6b77abddd0f98185b51fc4ab44d40a90c16f12b929" exitCode=0 Aug 05 17:37:07.162196 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:07.162032 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-fba55-75554f9f4b-9xzw2" Aug 05 17:37:07.162196 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:07.162082 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-fba55-75554f9f4b-9xzw2" event={"ID":"0b4456d4-3d9f-4147-be8d-448129f3d2f3","Type":"ContainerDied","Data":"3383e892f67d4af6952cec6b77abddd0f98185b51fc4ab44d40a90c16f12b929"} Aug 05 17:37:07.162196 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:07.162135 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-fba55-75554f9f4b-9xzw2" event={"ID":"0b4456d4-3d9f-4147-be8d-448129f3d2f3","Type":"ContainerDied","Data":"6571815c6f959628548ddf4dee2beaece6b26e0f583b8f01ad9592618f9fab1a"} Aug 05 17:37:07.162196 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:07.162159 2562 scope.go:117] "RemoveContainer" containerID="3383e892f67d4af6952cec6b77abddd0f98185b51fc4ab44d40a90c16f12b929" Aug 05 17:37:07.170312 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:07.170297 2562 scope.go:117] "RemoveContainer" containerID="3383e892f67d4af6952cec6b77abddd0f98185b51fc4ab44d40a90c16f12b929" Aug 05 17:37:07.170578 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:37:07.170563 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3383e892f67d4af6952cec6b77abddd0f98185b51fc4ab44d40a90c16f12b929\": container with ID starting with 3383e892f67d4af6952cec6b77abddd0f98185b51fc4ab44d40a90c16f12b929 not found: ID does not exist" containerID="3383e892f67d4af6952cec6b77abddd0f98185b51fc4ab44d40a90c16f12b929" Aug 05 17:37:07.170625 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:07.170585 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3383e892f67d4af6952cec6b77abddd0f98185b51fc4ab44d40a90c16f12b929"} err="failed to get container status \"3383e892f67d4af6952cec6b77abddd0f98185b51fc4ab44d40a90c16f12b929\": rpc error: code = NotFound desc = could not find container \"3383e892f67d4af6952cec6b77abddd0f98185b51fc4ab44d40a90c16f12b929\": container with ID starting with 3383e892f67d4af6952cec6b77abddd0f98185b51fc4ab44d40a90c16f12b929 not found: ID does not exist" Aug 05 17:37:07.184515 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:07.184489 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-fba55-75554f9f4b-9xzw2"] Aug 05 17:37:07.190332 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:07.190311 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-fba55-75554f9f4b-9xzw2"] Aug 05 17:37:07.440263 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:07.440186 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b4456d4-3d9f-4147-be8d-448129f3d2f3" path="/var/lib/kubelet/pods/0b4456d4-3d9f-4147-be8d-448129f3d2f3/volumes" Aug 05 17:37:26.181419 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:26.181385 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-27640-6ff445f5cd-98hvc"] Aug 05 17:37:26.181814 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:26.181692 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a265111b-fd39-47a5-bde4-7dec632e7dfc" containerName="sequence-graph-d9755" Aug 05 17:37:26.181814 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:26.181705 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a265111b-fd39-47a5-bde4-7dec632e7dfc" containerName="sequence-graph-d9755" Aug 05 17:37:26.181814 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:26.181723 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b4456d4-3d9f-4147-be8d-448129f3d2f3" containerName="ensemble-graph-fba55" Aug 05 17:37:26.181814 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:26.181729 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b4456d4-3d9f-4147-be8d-448129f3d2f3" containerName="ensemble-graph-fba55" Aug 05 17:37:26.181814 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:26.181772 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b4456d4-3d9f-4147-be8d-448129f3d2f3" containerName="ensemble-graph-fba55" Aug 05 17:37:26.181814 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:26.181780 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a265111b-fd39-47a5-bde4-7dec632e7dfc" containerName="sequence-graph-d9755" Aug 05 17:37:26.186061 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:26.186039 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-27640-6ff445f5cd-98hvc" Aug 05 17:37:26.189066 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:26.189046 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-5hw69\"" Aug 05 17:37:26.189183 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:26.189098 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-27640-serving-cert\"" Aug 05 17:37:26.189183 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:26.189172 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Aug 05 17:37:26.190055 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:26.190039 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-27640-kube-rbac-proxy-sar-config\"" Aug 05 17:37:26.195166 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:26.195144 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-27640-6ff445f5cd-98hvc"] Aug 05 17:37:26.242384 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:26.242331 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34319feb-40bd-45aa-a2e1-13a9dcf8742c-openshift-service-ca-bundle\") pod \"sequence-graph-27640-6ff445f5cd-98hvc\" (UID: \"34319feb-40bd-45aa-a2e1-13a9dcf8742c\") " pod="kserve-ci-e2e-test/sequence-graph-27640-6ff445f5cd-98hvc" Aug 05 17:37:26.242543 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:26.242397 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/34319feb-40bd-45aa-a2e1-13a9dcf8742c-proxy-tls\") pod \"sequence-graph-27640-6ff445f5cd-98hvc\" (UID: \"34319feb-40bd-45aa-a2e1-13a9dcf8742c\") " pod="kserve-ci-e2e-test/sequence-graph-27640-6ff445f5cd-98hvc" Aug 05 17:37:26.342848 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:26.342808 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34319feb-40bd-45aa-a2e1-13a9dcf8742c-openshift-service-ca-bundle\") pod \"sequence-graph-27640-6ff445f5cd-98hvc\" (UID: \"34319feb-40bd-45aa-a2e1-13a9dcf8742c\") " pod="kserve-ci-e2e-test/sequence-graph-27640-6ff445f5cd-98hvc" Aug 05 17:37:26.343076 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:26.342854 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/34319feb-40bd-45aa-a2e1-13a9dcf8742c-proxy-tls\") pod \"sequence-graph-27640-6ff445f5cd-98hvc\" (UID: \"34319feb-40bd-45aa-a2e1-13a9dcf8742c\") " pod="kserve-ci-e2e-test/sequence-graph-27640-6ff445f5cd-98hvc" Aug 05 17:37:26.343076 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:37:26.342984 2562 secret.go:189] Couldn't get secret kserve-ci-e2e-test/sequence-graph-27640-serving-cert: secret "sequence-graph-27640-serving-cert" not found Aug 05 17:37:26.343076 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:37:26.343046 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34319feb-40bd-45aa-a2e1-13a9dcf8742c-proxy-tls podName:34319feb-40bd-45aa-a2e1-13a9dcf8742c nodeName:}" failed. No retries permitted until 2026-08-05 17:37:26.843030393 +0000 UTC m=+1498.015554284 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/34319feb-40bd-45aa-a2e1-13a9dcf8742c-proxy-tls") pod "sequence-graph-27640-6ff445f5cd-98hvc" (UID: "34319feb-40bd-45aa-a2e1-13a9dcf8742c") : secret "sequence-graph-27640-serving-cert" not found Aug 05 17:37:26.343576 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:26.343553 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34319feb-40bd-45aa-a2e1-13a9dcf8742c-openshift-service-ca-bundle\") pod \"sequence-graph-27640-6ff445f5cd-98hvc\" (UID: \"34319feb-40bd-45aa-a2e1-13a9dcf8742c\") " pod="kserve-ci-e2e-test/sequence-graph-27640-6ff445f5cd-98hvc" Aug 05 17:37:26.847116 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:26.847073 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/34319feb-40bd-45aa-a2e1-13a9dcf8742c-proxy-tls\") pod \"sequence-graph-27640-6ff445f5cd-98hvc\" (UID: \"34319feb-40bd-45aa-a2e1-13a9dcf8742c\") " pod="kserve-ci-e2e-test/sequence-graph-27640-6ff445f5cd-98hvc" Aug 05 17:37:26.849480 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:26.849449 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/34319feb-40bd-45aa-a2e1-13a9dcf8742c-proxy-tls\") pod \"sequence-graph-27640-6ff445f5cd-98hvc\" (UID: \"34319feb-40bd-45aa-a2e1-13a9dcf8742c\") " pod="kserve-ci-e2e-test/sequence-graph-27640-6ff445f5cd-98hvc" Aug 05 17:37:27.096897 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:27.096860 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-27640-6ff445f5cd-98hvc" Aug 05 17:37:27.231665 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:27.231611 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-27640-6ff445f5cd-98hvc"] Aug 05 17:37:27.234483 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:37:27.234453 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34319feb_40bd_45aa_a2e1_13a9dcf8742c.slice/crio-4900644a785aab8a6e2d115c34145b63f4db88e1f51c7f6784c2c1afa0b9dfef WatchSource:0}: Error finding container 4900644a785aab8a6e2d115c34145b63f4db88e1f51c7f6784c2c1afa0b9dfef: Status 404 returned error can't find the container with id 4900644a785aab8a6e2d115c34145b63f4db88e1f51c7f6784c2c1afa0b9dfef Aug 05 17:37:27.244870 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:27.244838 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-27640-6ff445f5cd-98hvc" event={"ID":"34319feb-40bd-45aa-a2e1-13a9dcf8742c","Type":"ContainerStarted","Data":"4900644a785aab8a6e2d115c34145b63f4db88e1f51c7f6784c2c1afa0b9dfef"} Aug 05 17:37:28.250199 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:28.250151 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-27640-6ff445f5cd-98hvc" event={"ID":"34319feb-40bd-45aa-a2e1-13a9dcf8742c","Type":"ContainerStarted","Data":"ddd75a5b4e6af4469f36f0c6080333b02760abe183891a9977aad54ed2e61c84"} Aug 05 17:37:28.250661 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:28.250284 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-27640-6ff445f5cd-98hvc" Aug 05 17:37:28.269681 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:28.269621 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-27640-6ff445f5cd-98hvc" podStartSLOduration=2.269604075 podStartE2EDuration="2.269604075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:37:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:37:28.268309218 +0000 UTC m=+1499.440833128" watchObservedRunningTime="2026-08-05 17:37:28.269604075 +0000 UTC m=+1499.442127987" Aug 05 17:37:34.260202 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:34.260168 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-27640-6ff445f5cd-98hvc" Aug 05 17:37:36.277944 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:36.277889 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-27640-6ff445f5cd-98hvc"] Aug 05 17:37:36.278444 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:36.278110 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-27640-6ff445f5cd-98hvc" podUID="34319feb-40bd-45aa-a2e1-13a9dcf8742c" containerName="sequence-graph-27640" containerID="cri-o://ddd75a5b4e6af4469f36f0c6080333b02760abe183891a9977aad54ed2e61c84" gracePeriod=30 Aug 05 17:37:36.540369 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:36.540271 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-8dddc-6dffc4bb86-lq88m"] Aug 05 17:37:36.544782 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:36.544759 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-8dddc-6dffc4bb86-lq88m" Aug 05 17:37:36.547529 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:36.547506 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-8dddc-kube-rbac-proxy-sar-config\"" Aug 05 17:37:36.547641 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:36.547587 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-8dddc-serving-cert\"" Aug 05 17:37:36.557131 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:36.557103 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-8dddc-6dffc4bb86-lq88m"] Aug 05 17:37:36.630431 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:36.630394 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e17e79b-772b-4ba5-873a-16336560d1bc-openshift-service-ca-bundle\") pod \"ensemble-graph-8dddc-6dffc4bb86-lq88m\" (UID: \"0e17e79b-772b-4ba5-873a-16336560d1bc\") " pod="kserve-ci-e2e-test/ensemble-graph-8dddc-6dffc4bb86-lq88m" Aug 05 17:37:36.630431 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:36.630431 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0e17e79b-772b-4ba5-873a-16336560d1bc-proxy-tls\") pod \"ensemble-graph-8dddc-6dffc4bb86-lq88m\" (UID: \"0e17e79b-772b-4ba5-873a-16336560d1bc\") " pod="kserve-ci-e2e-test/ensemble-graph-8dddc-6dffc4bb86-lq88m" Aug 05 17:37:36.730980 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:36.730950 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e17e79b-772b-4ba5-873a-16336560d1bc-openshift-service-ca-bundle\") pod \"ensemble-graph-8dddc-6dffc4bb86-lq88m\" (UID: \"0e17e79b-772b-4ba5-873a-16336560d1bc\") " pod="kserve-ci-e2e-test/ensemble-graph-8dddc-6dffc4bb86-lq88m" Aug 05 17:37:36.731159 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:36.730986 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0e17e79b-772b-4ba5-873a-16336560d1bc-proxy-tls\") pod \"ensemble-graph-8dddc-6dffc4bb86-lq88m\" (UID: \"0e17e79b-772b-4ba5-873a-16336560d1bc\") " pod="kserve-ci-e2e-test/ensemble-graph-8dddc-6dffc4bb86-lq88m" Aug 05 17:37:36.731617 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:36.731597 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e17e79b-772b-4ba5-873a-16336560d1bc-openshift-service-ca-bundle\") pod \"ensemble-graph-8dddc-6dffc4bb86-lq88m\" (UID: \"0e17e79b-772b-4ba5-873a-16336560d1bc\") " pod="kserve-ci-e2e-test/ensemble-graph-8dddc-6dffc4bb86-lq88m" Aug 05 17:37:36.733398 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:36.733379 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0e17e79b-772b-4ba5-873a-16336560d1bc-proxy-tls\") pod \"ensemble-graph-8dddc-6dffc4bb86-lq88m\" (UID: \"0e17e79b-772b-4ba5-873a-16336560d1bc\") " pod="kserve-ci-e2e-test/ensemble-graph-8dddc-6dffc4bb86-lq88m" Aug 05 17:37:36.857604 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:36.857511 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-8dddc-6dffc4bb86-lq88m" Aug 05 17:37:36.990292 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:36.990263 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-8dddc-6dffc4bb86-lq88m"] Aug 05 17:37:36.992912 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:37:36.992883 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e17e79b_772b_4ba5_873a_16336560d1bc.slice/crio-0ef464e192fbeab02c66dce6db209c475c0b878cdcb4512b386c2b9da6ac60d8 WatchSource:0}: Error finding container 0ef464e192fbeab02c66dce6db209c475c0b878cdcb4512b386c2b9da6ac60d8: Status 404 returned error can't find the container with id 0ef464e192fbeab02c66dce6db209c475c0b878cdcb4512b386c2b9da6ac60d8 Aug 05 17:37:37.289747 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:37.289712 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-8dddc-6dffc4bb86-lq88m" event={"ID":"0e17e79b-772b-4ba5-873a-16336560d1bc","Type":"ContainerStarted","Data":"28ab2b962338ecc888799419fc2892f4cff5e23699d94ac2b67d44bd72263229"} Aug 05 17:37:37.290126 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:37.289769 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-8dddc-6dffc4bb86-lq88m" event={"ID":"0e17e79b-772b-4ba5-873a-16336560d1bc","Type":"ContainerStarted","Data":"0ef464e192fbeab02c66dce6db209c475c0b878cdcb4512b386c2b9da6ac60d8"} Aug 05 17:37:37.290126 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:37.289853 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-8dddc-6dffc4bb86-lq88m" Aug 05 17:37:37.309394 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:37.309316 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-8dddc-6dffc4bb86-lq88m" podStartSLOduration=1.309278689 podStartE2EDuration="1.309278689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:37:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:37:37.309200363 +0000 UTC m=+1508.481724275" watchObservedRunningTime="2026-08-05 17:37:37.309278689 +0000 UTC m=+1508.481802602" Aug 05 17:37:39.258491 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:39.258451 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-27640-6ff445f5cd-98hvc" podUID="34319feb-40bd-45aa-a2e1-13a9dcf8742c" containerName="sequence-graph-27640" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:37:43.300937 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:43.300903 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-8dddc-6dffc4bb86-lq88m" Aug 05 17:37:44.258767 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:44.258717 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-27640-6ff445f5cd-98hvc" podUID="34319feb-40bd-45aa-a2e1-13a9dcf8742c" containerName="sequence-graph-27640" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:37:49.257970 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:49.257921 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-27640-6ff445f5cd-98hvc" podUID="34319feb-40bd-45aa-a2e1-13a9dcf8742c" containerName="sequence-graph-27640" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:37:49.258380 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:49.258046 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-27640-6ff445f5cd-98hvc" Aug 05 17:37:54.258732 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:54.258627 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-27640-6ff445f5cd-98hvc" podUID="34319feb-40bd-45aa-a2e1-13a9dcf8742c" containerName="sequence-graph-27640" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:37:59.258207 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:37:59.258165 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-27640-6ff445f5cd-98hvc" podUID="34319feb-40bd-45aa-a2e1-13a9dcf8742c" containerName="sequence-graph-27640" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:38:04.258317 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:04.258268 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-27640-6ff445f5cd-98hvc" podUID="34319feb-40bd-45aa-a2e1-13a9dcf8742c" containerName="sequence-graph-27640" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:38:06.405892 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:06.405850 2562 generic.go:356] "Generic (PLEG): container finished" podID="34319feb-40bd-45aa-a2e1-13a9dcf8742c" containerID="ddd75a5b4e6af4469f36f0c6080333b02760abe183891a9977aad54ed2e61c84" exitCode=0 Aug 05 17:38:06.406281 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:06.405917 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-27640-6ff445f5cd-98hvc" event={"ID":"34319feb-40bd-45aa-a2e1-13a9dcf8742c","Type":"ContainerDied","Data":"ddd75a5b4e6af4469f36f0c6080333b02760abe183891a9977aad54ed2e61c84"} Aug 05 17:38:06.428785 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:06.428763 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-27640-6ff445f5cd-98hvc" Aug 05 17:38:06.573299 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:06.573204 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34319feb-40bd-45aa-a2e1-13a9dcf8742c-openshift-service-ca-bundle\") pod \"34319feb-40bd-45aa-a2e1-13a9dcf8742c\" (UID: \"34319feb-40bd-45aa-a2e1-13a9dcf8742c\") " Aug 05 17:38:06.573299 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:06.573265 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/34319feb-40bd-45aa-a2e1-13a9dcf8742c-proxy-tls\") pod \"34319feb-40bd-45aa-a2e1-13a9dcf8742c\" (UID: \"34319feb-40bd-45aa-a2e1-13a9dcf8742c\") " Aug 05 17:38:06.573745 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:06.573674 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34319feb-40bd-45aa-a2e1-13a9dcf8742c-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "34319feb-40bd-45aa-a2e1-13a9dcf8742c" (UID: "34319feb-40bd-45aa-a2e1-13a9dcf8742c"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:38:06.575562 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:06.575534 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34319feb-40bd-45aa-a2e1-13a9dcf8742c-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "34319feb-40bd-45aa-a2e1-13a9dcf8742c" (UID: "34319feb-40bd-45aa-a2e1-13a9dcf8742c"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:38:06.674347 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:06.674308 2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34319feb-40bd-45aa-a2e1-13a9dcf8742c-openshift-service-ca-bundle\") on node \"ip-10-0-137-104.ec2.internal\" DevicePath \"\"" Aug 05 17:38:06.674526 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:06.674367 2562 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/34319feb-40bd-45aa-a2e1-13a9dcf8742c-proxy-tls\") on node \"ip-10-0-137-104.ec2.internal\" DevicePath \"\"" Aug 05 17:38:07.411173 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:07.411134 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-27640-6ff445f5cd-98hvc" event={"ID":"34319feb-40bd-45aa-a2e1-13a9dcf8742c","Type":"ContainerDied","Data":"4900644a785aab8a6e2d115c34145b63f4db88e1f51c7f6784c2c1afa0b9dfef"} Aug 05 17:38:07.411173 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:07.411172 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-27640-6ff445f5cd-98hvc" Aug 05 17:38:07.411630 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:07.411212 2562 scope.go:117] "RemoveContainer" containerID="ddd75a5b4e6af4469f36f0c6080333b02760abe183891a9977aad54ed2e61c84" Aug 05 17:38:07.438415 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:07.436211 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-27640-6ff445f5cd-98hvc"] Aug 05 17:38:07.443833 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:07.443807 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-27640-6ff445f5cd-98hvc"] Aug 05 17:38:09.440265 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:09.440230 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34319feb-40bd-45aa-a2e1-13a9dcf8742c" path="/var/lib/kubelet/pods/34319feb-40bd-45aa-a2e1-13a9dcf8742c/volumes" Aug 05 17:38:36.558132 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:36.558103 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-e149b-85d74f945f-mjk8l"] Aug 05 17:38:36.558498 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:36.558412 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34319feb-40bd-45aa-a2e1-13a9dcf8742c" containerName="sequence-graph-27640" Aug 05 17:38:36.558498 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:36.558422 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="34319feb-40bd-45aa-a2e1-13a9dcf8742c" containerName="sequence-graph-27640" Aug 05 17:38:36.558498 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:36.558477 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="34319feb-40bd-45aa-a2e1-13a9dcf8742c" containerName="sequence-graph-27640" Aug 05 17:38:36.567054 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:36.567027 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-e149b-85d74f945f-mjk8l" Aug 05 17:38:36.569628 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:36.569585 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-e149b-kube-rbac-proxy-sar-config\"" Aug 05 17:38:36.569822 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:36.569707 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-e149b-serving-cert\"" Aug 05 17:38:36.571823 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:36.571801 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-e149b-85d74f945f-mjk8l"] Aug 05 17:38:36.600807 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:36.600781 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bf18f3a-6dc8-41ce-b6ed-eed260aca688-openshift-service-ca-bundle\") pod \"sequence-graph-e149b-85d74f945f-mjk8l\" (UID: \"8bf18f3a-6dc8-41ce-b6ed-eed260aca688\") " pod="kserve-ci-e2e-test/sequence-graph-e149b-85d74f945f-mjk8l" Aug 05 17:38:36.600994 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:36.600848 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8bf18f3a-6dc8-41ce-b6ed-eed260aca688-proxy-tls\") pod \"sequence-graph-e149b-85d74f945f-mjk8l\" (UID: \"8bf18f3a-6dc8-41ce-b6ed-eed260aca688\") " pod="kserve-ci-e2e-test/sequence-graph-e149b-85d74f945f-mjk8l" Aug 05 17:38:36.701374 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:36.701327 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8bf18f3a-6dc8-41ce-b6ed-eed260aca688-proxy-tls\") pod \"sequence-graph-e149b-85d74f945f-mjk8l\" (UID: \"8bf18f3a-6dc8-41ce-b6ed-eed260aca688\") " pod="kserve-ci-e2e-test/sequence-graph-e149b-85d74f945f-mjk8l" Aug 05 17:38:36.701570 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:36.701406 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bf18f3a-6dc8-41ce-b6ed-eed260aca688-openshift-service-ca-bundle\") pod \"sequence-graph-e149b-85d74f945f-mjk8l\" (UID: \"8bf18f3a-6dc8-41ce-b6ed-eed260aca688\") " pod="kserve-ci-e2e-test/sequence-graph-e149b-85d74f945f-mjk8l" Aug 05 17:38:36.701570 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:38:36.701494 2562 secret.go:189] Couldn't get secret kserve-ci-e2e-test/sequence-graph-e149b-serving-cert: secret "sequence-graph-e149b-serving-cert" not found Aug 05 17:38:36.701750 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:38:36.701575 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf18f3a-6dc8-41ce-b6ed-eed260aca688-proxy-tls podName:8bf18f3a-6dc8-41ce-b6ed-eed260aca688 nodeName:}" failed. No retries permitted until 2026-08-05 17:38:37.20155284 +0000 UTC m=+1568.374076745 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/8bf18f3a-6dc8-41ce-b6ed-eed260aca688-proxy-tls") pod "sequence-graph-e149b-85d74f945f-mjk8l" (UID: "8bf18f3a-6dc8-41ce-b6ed-eed260aca688") : secret "sequence-graph-e149b-serving-cert" not found Aug 05 17:38:36.701969 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:36.701951 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bf18f3a-6dc8-41ce-b6ed-eed260aca688-openshift-service-ca-bundle\") pod \"sequence-graph-e149b-85d74f945f-mjk8l\" (UID: \"8bf18f3a-6dc8-41ce-b6ed-eed260aca688\") " pod="kserve-ci-e2e-test/sequence-graph-e149b-85d74f945f-mjk8l" Aug 05 17:38:37.205083 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:37.205037 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8bf18f3a-6dc8-41ce-b6ed-eed260aca688-proxy-tls\") pod \"sequence-graph-e149b-85d74f945f-mjk8l\" (UID: \"8bf18f3a-6dc8-41ce-b6ed-eed260aca688\") " pod="kserve-ci-e2e-test/sequence-graph-e149b-85d74f945f-mjk8l" Aug 05 17:38:37.207478 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:37.207453 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8bf18f3a-6dc8-41ce-b6ed-eed260aca688-proxy-tls\") pod \"sequence-graph-e149b-85d74f945f-mjk8l\" (UID: \"8bf18f3a-6dc8-41ce-b6ed-eed260aca688\") " pod="kserve-ci-e2e-test/sequence-graph-e149b-85d74f945f-mjk8l" Aug 05 17:38:37.478261 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:37.478158 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-e149b-85d74f945f-mjk8l" Aug 05 17:38:37.614088 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:37.614057 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-e149b-85d74f945f-mjk8l"] Aug 05 17:38:37.617289 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:38:37.617263 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bf18f3a_6dc8_41ce_b6ed_eed260aca688.slice/crio-2adfad655c86e0bb99db7757ad21b94dc46e65373e82a997d87fa0f44919e64f WatchSource:0}: Error finding container 2adfad655c86e0bb99db7757ad21b94dc46e65373e82a997d87fa0f44919e64f: Status 404 returned error can't find the container with id 2adfad655c86e0bb99db7757ad21b94dc46e65373e82a997d87fa0f44919e64f Aug 05 17:38:38.530058 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:38.530021 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-e149b-85d74f945f-mjk8l" event={"ID":"8bf18f3a-6dc8-41ce-b6ed-eed260aca688","Type":"ContainerStarted","Data":"3e5c3d0ee13a67b49ae4dc80773225a0c7740fe2dbd761835711b8f97ca56813"} Aug 05 17:38:38.530266 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:38.530083 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-e149b-85d74f945f-mjk8l" Aug 05 17:38:38.530266 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:38.530103 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-e149b-85d74f945f-mjk8l" event={"ID":"8bf18f3a-6dc8-41ce-b6ed-eed260aca688","Type":"ContainerStarted","Data":"2adfad655c86e0bb99db7757ad21b94dc46e65373e82a997d87fa0f44919e64f"} Aug 05 17:38:38.552302 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:38.552253 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-e149b-85d74f945f-mjk8l" podStartSLOduration=2.552236863 podStartE2EDuration="2.552236863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:38:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:38:38.550642846 +0000 UTC m=+1569.723166758" watchObservedRunningTime="2026-08-05 17:38:38.552236863 +0000 UTC m=+1569.724760822" Aug 05 17:38:44.539891 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:38:44.539858 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-e149b-85d74f945f-mjk8l" Aug 05 17:45:51.117327 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:45:51.117286 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-8dddc-6dffc4bb86-lq88m"] Aug 05 17:45:51.119748 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:45:51.117512 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-8dddc-6dffc4bb86-lq88m" podUID="0e17e79b-772b-4ba5-873a-16336560d1bc" containerName="ensemble-graph-8dddc" containerID="cri-o://28ab2b962338ecc888799419fc2892f4cff5e23699d94ac2b67d44bd72263229" gracePeriod=30 Aug 05 17:45:53.299671 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:45:53.299615 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-8dddc-6dffc4bb86-lq88m" podUID="0e17e79b-772b-4ba5-873a-16336560d1bc" containerName="ensemble-graph-8dddc" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:45:58.299711 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:45:58.299668 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-8dddc-6dffc4bb86-lq88m" podUID="0e17e79b-772b-4ba5-873a-16336560d1bc" containerName="ensemble-graph-8dddc" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:46:03.299274 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:03.299229 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-8dddc-6dffc4bb86-lq88m" podUID="0e17e79b-772b-4ba5-873a-16336560d1bc" containerName="ensemble-graph-8dddc" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:46:03.299738 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:03.299368 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-8dddc-6dffc4bb86-lq88m" Aug 05 17:46:08.299550 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:08.299512 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-8dddc-6dffc4bb86-lq88m" podUID="0e17e79b-772b-4ba5-873a-16336560d1bc" containerName="ensemble-graph-8dddc" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:46:13.298755 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:13.298709 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-8dddc-6dffc4bb86-lq88m" podUID="0e17e79b-772b-4ba5-873a-16336560d1bc" containerName="ensemble-graph-8dddc" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:46:18.299797 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:18.299756 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-8dddc-6dffc4bb86-lq88m" podUID="0e17e79b-772b-4ba5-873a-16336560d1bc" containerName="ensemble-graph-8dddc" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:46:21.312167 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:21.312141 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-8dddc-6dffc4bb86-lq88m" Aug 05 17:46:21.418839 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:21.418756 2562 generic.go:356] "Generic (PLEG): container finished" podID="0e17e79b-772b-4ba5-873a-16336560d1bc" containerID="28ab2b962338ecc888799419fc2892f4cff5e23699d94ac2b67d44bd72263229" exitCode=0 Aug 05 17:46:21.418839 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:21.418797 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-8dddc-6dffc4bb86-lq88m" Aug 05 17:46:21.419021 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:21.418801 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-8dddc-6dffc4bb86-lq88m" event={"ID":"0e17e79b-772b-4ba5-873a-16336560d1bc","Type":"ContainerDied","Data":"28ab2b962338ecc888799419fc2892f4cff5e23699d94ac2b67d44bd72263229"} Aug 05 17:46:21.419021 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:21.418941 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-8dddc-6dffc4bb86-lq88m" event={"ID":"0e17e79b-772b-4ba5-873a-16336560d1bc","Type":"ContainerDied","Data":"0ef464e192fbeab02c66dce6db209c475c0b878cdcb4512b386c2b9da6ac60d8"} Aug 05 17:46:21.419021 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:21.418969 2562 scope.go:117] "RemoveContainer" containerID="28ab2b962338ecc888799419fc2892f4cff5e23699d94ac2b67d44bd72263229" Aug 05 17:46:21.426899 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:21.426881 2562 scope.go:117] "RemoveContainer" containerID="28ab2b962338ecc888799419fc2892f4cff5e23699d94ac2b67d44bd72263229" Aug 05 17:46:21.427164 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:46:21.427146 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28ab2b962338ecc888799419fc2892f4cff5e23699d94ac2b67d44bd72263229\": container with ID starting with 28ab2b962338ecc888799419fc2892f4cff5e23699d94ac2b67d44bd72263229 not found: ID does not exist" containerID="28ab2b962338ecc888799419fc2892f4cff5e23699d94ac2b67d44bd72263229" Aug 05 17:46:21.427209 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:21.427175 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28ab2b962338ecc888799419fc2892f4cff5e23699d94ac2b67d44bd72263229"} err="failed to get container status \"28ab2b962338ecc888799419fc2892f4cff5e23699d94ac2b67d44bd72263229\": rpc error: code = NotFound desc = could not find container \"28ab2b962338ecc888799419fc2892f4cff5e23699d94ac2b67d44bd72263229\": container with ID starting with 28ab2b962338ecc888799419fc2892f4cff5e23699d94ac2b67d44bd72263229 not found: ID does not exist" Aug 05 17:46:21.477149 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:21.477120 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e17e79b-772b-4ba5-873a-16336560d1bc-openshift-service-ca-bundle\") pod \"0e17e79b-772b-4ba5-873a-16336560d1bc\" (UID: \"0e17e79b-772b-4ba5-873a-16336560d1bc\") " Aug 05 17:46:21.477149 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:21.477155 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0e17e79b-772b-4ba5-873a-16336560d1bc-proxy-tls\") pod \"0e17e79b-772b-4ba5-873a-16336560d1bc\" (UID: \"0e17e79b-772b-4ba5-873a-16336560d1bc\") " Aug 05 17:46:21.477477 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:21.477442 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e17e79b-772b-4ba5-873a-16336560d1bc-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "0e17e79b-772b-4ba5-873a-16336560d1bc" (UID: "0e17e79b-772b-4ba5-873a-16336560d1bc"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:46:21.479197 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:21.479177 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e17e79b-772b-4ba5-873a-16336560d1bc-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "0e17e79b-772b-4ba5-873a-16336560d1bc" (UID: "0e17e79b-772b-4ba5-873a-16336560d1bc"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:46:21.578143 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:21.578113 2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e17e79b-772b-4ba5-873a-16336560d1bc-openshift-service-ca-bundle\") on node \"ip-10-0-137-104.ec2.internal\" DevicePath \"\"" Aug 05 17:46:21.578143 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:21.578140 2562 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0e17e79b-772b-4ba5-873a-16336560d1bc-proxy-tls\") on node \"ip-10-0-137-104.ec2.internal\" DevicePath \"\"" Aug 05 17:46:21.752375 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:21.752328 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-8dddc-6dffc4bb86-lq88m"] Aug 05 17:46:21.761847 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:21.761814 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-8dddc-6dffc4bb86-lq88m"] Aug 05 17:46:23.440148 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:23.440114 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e17e79b-772b-4ba5-873a-16336560d1bc" path="/var/lib/kubelet/pods/0e17e79b-772b-4ba5-873a-16336560d1bc/volumes" Aug 05 17:46:51.114566 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:51.114528 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-e149b-85d74f945f-mjk8l"] Aug 05 17:46:51.115144 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:51.114802 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-e149b-85d74f945f-mjk8l" podUID="8bf18f3a-6dc8-41ce-b6ed-eed260aca688" containerName="sequence-graph-e149b" containerID="cri-o://3e5c3d0ee13a67b49ae4dc80773225a0c7740fe2dbd761835711b8f97ca56813" gracePeriod=30 Aug 05 17:46:51.377151 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:51.377070 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-92074-768886f666-wd429"] Aug 05 17:46:51.377440 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:51.377426 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e17e79b-772b-4ba5-873a-16336560d1bc" containerName="ensemble-graph-8dddc" Aug 05 17:46:51.377440 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:51.377441 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e17e79b-772b-4ba5-873a-16336560d1bc" containerName="ensemble-graph-8dddc" Aug 05 17:46:51.377538 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:51.377505 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e17e79b-772b-4ba5-873a-16336560d1bc" containerName="ensemble-graph-8dddc" Aug 05 17:46:51.379410 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:51.379393 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-92074-768886f666-wd429" Aug 05 17:46:51.383246 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:51.383220 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-92074-serving-cert\"" Aug 05 17:46:51.383246 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:51.383232 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-92074-kube-rbac-proxy-sar-config\"" Aug 05 17:46:51.392567 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:51.392540 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-92074-768886f666-wd429"] Aug 05 17:46:51.404852 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:51.404804 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc80bf0e-91ce-4e32-91f3-1fdb92e74706-openshift-service-ca-bundle\") pod \"splitter-graph-92074-768886f666-wd429\" (UID: \"cc80bf0e-91ce-4e32-91f3-1fdb92e74706\") " pod="kserve-ci-e2e-test/splitter-graph-92074-768886f666-wd429" Aug 05 17:46:51.405006 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:51.404889 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cc80bf0e-91ce-4e32-91f3-1fdb92e74706-proxy-tls\") pod \"splitter-graph-92074-768886f666-wd429\" (UID: \"cc80bf0e-91ce-4e32-91f3-1fdb92e74706\") " pod="kserve-ci-e2e-test/splitter-graph-92074-768886f666-wd429" Aug 05 17:46:51.506328 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:51.506281 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc80bf0e-91ce-4e32-91f3-1fdb92e74706-openshift-service-ca-bundle\") pod \"splitter-graph-92074-768886f666-wd429\" (UID: \"cc80bf0e-91ce-4e32-91f3-1fdb92e74706\") " pod="kserve-ci-e2e-test/splitter-graph-92074-768886f666-wd429" Aug 05 17:46:51.506514 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:51.506387 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cc80bf0e-91ce-4e32-91f3-1fdb92e74706-proxy-tls\") pod \"splitter-graph-92074-768886f666-wd429\" (UID: \"cc80bf0e-91ce-4e32-91f3-1fdb92e74706\") " pod="kserve-ci-e2e-test/splitter-graph-92074-768886f666-wd429" Aug 05 17:46:51.506956 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:51.506920 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc80bf0e-91ce-4e32-91f3-1fdb92e74706-openshift-service-ca-bundle\") pod \"splitter-graph-92074-768886f666-wd429\" (UID: \"cc80bf0e-91ce-4e32-91f3-1fdb92e74706\") " pod="kserve-ci-e2e-test/splitter-graph-92074-768886f666-wd429" Aug 05 17:46:51.508804 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:51.508783 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cc80bf0e-91ce-4e32-91f3-1fdb92e74706-proxy-tls\") pod \"splitter-graph-92074-768886f666-wd429\" (UID: \"cc80bf0e-91ce-4e32-91f3-1fdb92e74706\") " pod="kserve-ci-e2e-test/splitter-graph-92074-768886f666-wd429" Aug 05 17:46:51.690993 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:51.690869 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-92074-768886f666-wd429" Aug 05 17:46:51.826054 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:51.826029 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-92074-768886f666-wd429"] Aug 05 17:46:51.828692 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:46:51.828667 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc80bf0e_91ce_4e32_91f3_1fdb92e74706.slice/crio-d4bf9fe8f8db4d5ab605e583203db4dfccf7851158115307ca6569de7c3542d5 WatchSource:0}: Error finding container d4bf9fe8f8db4d5ab605e583203db4dfccf7851158115307ca6569de7c3542d5: Status 404 returned error can't find the container with id d4bf9fe8f8db4d5ab605e583203db4dfccf7851158115307ca6569de7c3542d5 Aug 05 17:46:52.552737 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:52.552699 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-92074-768886f666-wd429" event={"ID":"cc80bf0e-91ce-4e32-91f3-1fdb92e74706","Type":"ContainerStarted","Data":"a828c64b0c08fd43e07b34800ae2863799f4b0c07a2e820e47bd8c0a72eaaa50"} Aug 05 17:46:52.553142 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:52.552751 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-92074-768886f666-wd429" event={"ID":"cc80bf0e-91ce-4e32-91f3-1fdb92e74706","Type":"ContainerStarted","Data":"d4bf9fe8f8db4d5ab605e583203db4dfccf7851158115307ca6569de7c3542d5"} Aug 05 17:46:52.553142 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:52.552866 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-92074-768886f666-wd429" Aug 05 17:46:52.570185 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:52.570133 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-92074-768886f666-wd429" podStartSLOduration=1.570117387 podStartE2EDuration="1.570117387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:46:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:46:52.569374783 +0000 UTC m=+2063.741898696" watchObservedRunningTime="2026-08-05 17:46:52.570117387 +0000 UTC m=+2063.742641297" Aug 05 17:46:54.538054 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:54.538016 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-e149b-85d74f945f-mjk8l" podUID="8bf18f3a-6dc8-41ce-b6ed-eed260aca688" containerName="sequence-graph-e149b" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:46:58.563361 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:58.563309 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-92074-768886f666-wd429" Aug 05 17:46:59.538464 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:46:59.538422 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-e149b-85d74f945f-mjk8l" podUID="8bf18f3a-6dc8-41ce-b6ed-eed260aca688" containerName="sequence-graph-e149b" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:47:01.428083 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:01.428005 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-92074-768886f666-wd429"] Aug 05 17:47:01.428490 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:01.428178 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-92074-768886f666-wd429" podUID="cc80bf0e-91ce-4e32-91f3-1fdb92e74706" containerName="splitter-graph-92074" containerID="cri-o://a828c64b0c08fd43e07b34800ae2863799f4b0c07a2e820e47bd8c0a72eaaa50" gracePeriod=30 Aug 05 17:47:03.562226 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:03.562184 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-92074-768886f666-wd429" podUID="cc80bf0e-91ce-4e32-91f3-1fdb92e74706" containerName="splitter-graph-92074" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:47:04.538042 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:04.538003 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-e149b-85d74f945f-mjk8l" podUID="8bf18f3a-6dc8-41ce-b6ed-eed260aca688" containerName="sequence-graph-e149b" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:47:04.538222 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:04.538130 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-e149b-85d74f945f-mjk8l" Aug 05 17:47:08.561866 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:08.561826 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-92074-768886f666-wd429" podUID="cc80bf0e-91ce-4e32-91f3-1fdb92e74706" containerName="splitter-graph-92074" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:47:09.537609 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:09.537565 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-e149b-85d74f945f-mjk8l" podUID="8bf18f3a-6dc8-41ce-b6ed-eed260aca688" containerName="sequence-graph-e149b" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:47:13.561744 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:13.561701 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-92074-768886f666-wd429" podUID="cc80bf0e-91ce-4e32-91f3-1fdb92e74706" containerName="splitter-graph-92074" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:47:13.562190 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:13.561811 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-92074-768886f666-wd429" Aug 05 17:47:14.538419 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:14.538374 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-e149b-85d74f945f-mjk8l" podUID="8bf18f3a-6dc8-41ce-b6ed-eed260aca688" containerName="sequence-graph-e149b" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:47:18.562428 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:18.562382 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-92074-768886f666-wd429" podUID="cc80bf0e-91ce-4e32-91f3-1fdb92e74706" containerName="splitter-graph-92074" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:47:19.538195 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:19.538151 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-e149b-85d74f945f-mjk8l" podUID="8bf18f3a-6dc8-41ce-b6ed-eed260aca688" containerName="sequence-graph-e149b" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:47:21.674555 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:21.674522 2562 generic.go:356] "Generic (PLEG): container finished" podID="8bf18f3a-6dc8-41ce-b6ed-eed260aca688" containerID="3e5c3d0ee13a67b49ae4dc80773225a0c7740fe2dbd761835711b8f97ca56813" exitCode=0 Aug 05 17:47:21.674917 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:21.674599 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-e149b-85d74f945f-mjk8l" event={"ID":"8bf18f3a-6dc8-41ce-b6ed-eed260aca688","Type":"ContainerDied","Data":"3e5c3d0ee13a67b49ae4dc80773225a0c7740fe2dbd761835711b8f97ca56813"} Aug 05 17:47:21.755139 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:21.755114 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-e149b-85d74f945f-mjk8l" Aug 05 17:47:21.862392 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:21.862358 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8bf18f3a-6dc8-41ce-b6ed-eed260aca688-proxy-tls\") pod \"8bf18f3a-6dc8-41ce-b6ed-eed260aca688\" (UID: \"8bf18f3a-6dc8-41ce-b6ed-eed260aca688\") " Aug 05 17:47:21.862562 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:21.862438 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bf18f3a-6dc8-41ce-b6ed-eed260aca688-openshift-service-ca-bundle\") pod \"8bf18f3a-6dc8-41ce-b6ed-eed260aca688\" (UID: \"8bf18f3a-6dc8-41ce-b6ed-eed260aca688\") " Aug 05 17:47:21.862815 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:21.862796 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bf18f3a-6dc8-41ce-b6ed-eed260aca688-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "8bf18f3a-6dc8-41ce-b6ed-eed260aca688" (UID: "8bf18f3a-6dc8-41ce-b6ed-eed260aca688"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:47:21.864390 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:21.864368 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bf18f3a-6dc8-41ce-b6ed-eed260aca688-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "8bf18f3a-6dc8-41ce-b6ed-eed260aca688" (UID: "8bf18f3a-6dc8-41ce-b6ed-eed260aca688"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:47:21.963608 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:21.963535 2562 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8bf18f3a-6dc8-41ce-b6ed-eed260aca688-proxy-tls\") on node \"ip-10-0-137-104.ec2.internal\" DevicePath \"\"" Aug 05 17:47:21.963608 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:21.963561 2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bf18f3a-6dc8-41ce-b6ed-eed260aca688-openshift-service-ca-bundle\") on node \"ip-10-0-137-104.ec2.internal\" DevicePath \"\"" Aug 05 17:47:22.679351 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:22.679315 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-e149b-85d74f945f-mjk8l" Aug 05 17:47:22.679351 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:22.679329 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-e149b-85d74f945f-mjk8l" event={"ID":"8bf18f3a-6dc8-41ce-b6ed-eed260aca688","Type":"ContainerDied","Data":"2adfad655c86e0bb99db7757ad21b94dc46e65373e82a997d87fa0f44919e64f"} Aug 05 17:47:22.679916 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:22.679412 2562 scope.go:117] "RemoveContainer" containerID="3e5c3d0ee13a67b49ae4dc80773225a0c7740fe2dbd761835711b8f97ca56813" Aug 05 17:47:22.700752 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:22.700722 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-e149b-85d74f945f-mjk8l"] Aug 05 17:47:22.707656 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:22.707630 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-e149b-85d74f945f-mjk8l"] Aug 05 17:47:23.440661 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:23.440626 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bf18f3a-6dc8-41ce-b6ed-eed260aca688" path="/var/lib/kubelet/pods/8bf18f3a-6dc8-41ce-b6ed-eed260aca688/volumes" Aug 05 17:47:23.561927 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:23.561892 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-92074-768886f666-wd429" podUID="cc80bf0e-91ce-4e32-91f3-1fdb92e74706" containerName="splitter-graph-92074" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:47:28.561554 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:28.561518 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-92074-768886f666-wd429" podUID="cc80bf0e-91ce-4e32-91f3-1fdb92e74706" containerName="splitter-graph-92074" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:47:31.607971 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:31.607944 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-92074-768886f666-wd429" Aug 05 17:47:31.719382 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:31.719284 2562 generic.go:356] "Generic (PLEG): container finished" podID="cc80bf0e-91ce-4e32-91f3-1fdb92e74706" containerID="a828c64b0c08fd43e07b34800ae2863799f4b0c07a2e820e47bd8c0a72eaaa50" exitCode=0 Aug 05 17:47:31.719382 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:31.719349 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-92074-768886f666-wd429" event={"ID":"cc80bf0e-91ce-4e32-91f3-1fdb92e74706","Type":"ContainerDied","Data":"a828c64b0c08fd43e07b34800ae2863799f4b0c07a2e820e47bd8c0a72eaaa50"} Aug 05 17:47:31.719382 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:31.719364 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-92074-768886f666-wd429" Aug 05 17:47:31.719616 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:31.719396 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-92074-768886f666-wd429" event={"ID":"cc80bf0e-91ce-4e32-91f3-1fdb92e74706","Type":"ContainerDied","Data":"d4bf9fe8f8db4d5ab605e583203db4dfccf7851158115307ca6569de7c3542d5"} Aug 05 17:47:31.719616 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:31.719420 2562 scope.go:117] "RemoveContainer" containerID="a828c64b0c08fd43e07b34800ae2863799f4b0c07a2e820e47bd8c0a72eaaa50" Aug 05 17:47:31.727682 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:31.727664 2562 scope.go:117] "RemoveContainer" containerID="a828c64b0c08fd43e07b34800ae2863799f4b0c07a2e820e47bd8c0a72eaaa50" Aug 05 17:47:31.727913 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:47:31.727897 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a828c64b0c08fd43e07b34800ae2863799f4b0c07a2e820e47bd8c0a72eaaa50\": container with ID starting with a828c64b0c08fd43e07b34800ae2863799f4b0c07a2e820e47bd8c0a72eaaa50 not found: ID does not exist" containerID="a828c64b0c08fd43e07b34800ae2863799f4b0c07a2e820e47bd8c0a72eaaa50" Aug 05 17:47:31.727960 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:31.727922 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a828c64b0c08fd43e07b34800ae2863799f4b0c07a2e820e47bd8c0a72eaaa50"} err="failed to get container status \"a828c64b0c08fd43e07b34800ae2863799f4b0c07a2e820e47bd8c0a72eaaa50\": rpc error: code = NotFound desc = could not find container \"a828c64b0c08fd43e07b34800ae2863799f4b0c07a2e820e47bd8c0a72eaaa50\": container with ID starting with a828c64b0c08fd43e07b34800ae2863799f4b0c07a2e820e47bd8c0a72eaaa50 not found: ID does not exist" Aug 05 17:47:31.742282 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:31.742256 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc80bf0e-91ce-4e32-91f3-1fdb92e74706-openshift-service-ca-bundle\") pod \"cc80bf0e-91ce-4e32-91f3-1fdb92e74706\" (UID: \"cc80bf0e-91ce-4e32-91f3-1fdb92e74706\") " Aug 05 17:47:31.742409 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:31.742351 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cc80bf0e-91ce-4e32-91f3-1fdb92e74706-proxy-tls\") pod \"cc80bf0e-91ce-4e32-91f3-1fdb92e74706\" (UID: \"cc80bf0e-91ce-4e32-91f3-1fdb92e74706\") " Aug 05 17:47:31.742604 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:31.742582 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc80bf0e-91ce-4e32-91f3-1fdb92e74706-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "cc80bf0e-91ce-4e32-91f3-1fdb92e74706" (UID: "cc80bf0e-91ce-4e32-91f3-1fdb92e74706"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:47:31.744290 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:31.744267 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc80bf0e-91ce-4e32-91f3-1fdb92e74706-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "cc80bf0e-91ce-4e32-91f3-1fdb92e74706" (UID: "cc80bf0e-91ce-4e32-91f3-1fdb92e74706"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:47:31.843586 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:31.843555 2562 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cc80bf0e-91ce-4e32-91f3-1fdb92e74706-proxy-tls\") on node \"ip-10-0-137-104.ec2.internal\" DevicePath \"\"" Aug 05 17:47:31.843586 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:31.843582 2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc80bf0e-91ce-4e32-91f3-1fdb92e74706-openshift-service-ca-bundle\") on node \"ip-10-0-137-104.ec2.internal\" DevicePath \"\"" Aug 05 17:47:32.044353 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:32.044313 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-92074-768886f666-wd429"] Aug 05 17:47:32.048587 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:32.048563 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-92074-768886f666-wd429"] Aug 05 17:47:33.440858 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:47:33.440824 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc80bf0e-91ce-4e32-91f3-1fdb92e74706" path="/var/lib/kubelet/pods/cc80bf0e-91ce-4e32-91f3-1fdb92e74706/volumes" Aug 05 17:48:01.413529 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:01.413451 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-741a0-7dd5d757cf-bthq5"] Aug 05 17:48:01.413921 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:01.413795 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc80bf0e-91ce-4e32-91f3-1fdb92e74706" containerName="splitter-graph-92074" Aug 05 17:48:01.413921 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:01.413809 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc80bf0e-91ce-4e32-91f3-1fdb92e74706" containerName="splitter-graph-92074" Aug 05 17:48:01.413921 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:01.413825 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bf18f3a-6dc8-41ce-b6ed-eed260aca688" containerName="sequence-graph-e149b" Aug 05 17:48:01.413921 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:01.413832 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bf18f3a-6dc8-41ce-b6ed-eed260aca688" containerName="sequence-graph-e149b" Aug 05 17:48:01.413921 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:01.413883 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc80bf0e-91ce-4e32-91f3-1fdb92e74706" containerName="splitter-graph-92074" Aug 05 17:48:01.413921 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:01.413891 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bf18f3a-6dc8-41ce-b6ed-eed260aca688" containerName="sequence-graph-e149b" Aug 05 17:48:01.416986 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:01.416967 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-741a0-7dd5d757cf-bthq5" Aug 05 17:48:01.421390 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:01.421363 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Aug 05 17:48:01.421535 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:01.421515 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-741a0-kube-rbac-proxy-sar-config\"" Aug 05 17:48:01.426974 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:01.426953 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-5hw69\"" Aug 05 17:48:01.429480 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:01.429464 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-741a0-serving-cert\"" Aug 05 17:48:01.447030 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:01.447007 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-741a0-7dd5d757cf-bthq5"] Aug 05 17:48:01.463827 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:01.458626 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb0a6db1-307f-486e-acd8-ac0ff42fae2f-openshift-service-ca-bundle\") pod \"switch-graph-741a0-7dd5d757cf-bthq5\" (UID: \"eb0a6db1-307f-486e-acd8-ac0ff42fae2f\") " pod="kserve-ci-e2e-test/switch-graph-741a0-7dd5d757cf-bthq5" Aug 05 17:48:01.463827 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:01.458724 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/eb0a6db1-307f-486e-acd8-ac0ff42fae2f-proxy-tls\") pod \"switch-graph-741a0-7dd5d757cf-bthq5\" (UID: \"eb0a6db1-307f-486e-acd8-ac0ff42fae2f\") " pod="kserve-ci-e2e-test/switch-graph-741a0-7dd5d757cf-bthq5" Aug 05 17:48:01.559423 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:01.559385 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/eb0a6db1-307f-486e-acd8-ac0ff42fae2f-proxy-tls\") pod \"switch-graph-741a0-7dd5d757cf-bthq5\" (UID: \"eb0a6db1-307f-486e-acd8-ac0ff42fae2f\") " pod="kserve-ci-e2e-test/switch-graph-741a0-7dd5d757cf-bthq5" Aug 05 17:48:01.559593 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:01.559470 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb0a6db1-307f-486e-acd8-ac0ff42fae2f-openshift-service-ca-bundle\") pod \"switch-graph-741a0-7dd5d757cf-bthq5\" (UID: \"eb0a6db1-307f-486e-acd8-ac0ff42fae2f\") " pod="kserve-ci-e2e-test/switch-graph-741a0-7dd5d757cf-bthq5" Aug 05 17:48:01.560082 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:01.560058 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb0a6db1-307f-486e-acd8-ac0ff42fae2f-openshift-service-ca-bundle\") pod \"switch-graph-741a0-7dd5d757cf-bthq5\" (UID: \"eb0a6db1-307f-486e-acd8-ac0ff42fae2f\") " pod="kserve-ci-e2e-test/switch-graph-741a0-7dd5d757cf-bthq5" Aug 05 17:48:01.561754 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:01.561726 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/eb0a6db1-307f-486e-acd8-ac0ff42fae2f-proxy-tls\") pod \"switch-graph-741a0-7dd5d757cf-bthq5\" (UID: \"eb0a6db1-307f-486e-acd8-ac0ff42fae2f\") " pod="kserve-ci-e2e-test/switch-graph-741a0-7dd5d757cf-bthq5" Aug 05 17:48:01.696366 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:01.696268 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-db0ba-5f955c994d-pjzfw"] Aug 05 17:48:01.699419 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:01.699390 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-db0ba-5f955c994d-pjzfw" Aug 05 17:48:01.701935 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:01.701916 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-db0ba-serving-cert\"" Aug 05 17:48:01.702164 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:01.702144 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-db0ba-kube-rbac-proxy-sar-config\"" Aug 05 17:48:01.708622 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:01.708579 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-db0ba-5f955c994d-pjzfw"] Aug 05 17:48:01.726236 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:01.726208 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-741a0-7dd5d757cf-bthq5" Aug 05 17:48:01.761542 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:01.761510 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b-openshift-service-ca-bundle\") pod \"splitter-graph-db0ba-5f955c994d-pjzfw\" (UID: \"9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b\") " pod="kserve-ci-e2e-test/splitter-graph-db0ba-5f955c994d-pjzfw" Aug 05 17:48:01.761706 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:01.761555 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b-proxy-tls\") pod \"splitter-graph-db0ba-5f955c994d-pjzfw\" (UID: \"9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b\") " pod="kserve-ci-e2e-test/splitter-graph-db0ba-5f955c994d-pjzfw" Aug 05 17:48:01.862672 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:01.862636 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b-openshift-service-ca-bundle\") pod \"splitter-graph-db0ba-5f955c994d-pjzfw\" (UID: \"9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b\") " pod="kserve-ci-e2e-test/splitter-graph-db0ba-5f955c994d-pjzfw" Aug 05 17:48:01.862832 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:01.862684 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b-proxy-tls\") pod \"splitter-graph-db0ba-5f955c994d-pjzfw\" (UID: \"9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b\") " pod="kserve-ci-e2e-test/splitter-graph-db0ba-5f955c994d-pjzfw" Aug 05 17:48:01.862832 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:48:01.862794 2562 secret.go:189] Couldn't get secret kserve-ci-e2e-test/splitter-graph-db0ba-serving-cert: secret "splitter-graph-db0ba-serving-cert" not found Aug 05 17:48:01.862909 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:48:01.862846 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b-proxy-tls podName:9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b nodeName:}" failed. No retries permitted until 2026-08-05 17:48:02.362829858 +0000 UTC m=+2133.535353750 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b-proxy-tls") pod "splitter-graph-db0ba-5f955c994d-pjzfw" (UID: "9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b") : secret "splitter-graph-db0ba-serving-cert" not found Aug 05 17:48:01.863298 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:01.863278 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b-openshift-service-ca-bundle\") pod \"splitter-graph-db0ba-5f955c994d-pjzfw\" (UID: \"9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b\") " pod="kserve-ci-e2e-test/splitter-graph-db0ba-5f955c994d-pjzfw" Aug 05 17:48:01.872289 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:01.872261 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-741a0-7dd5d757cf-bthq5"] Aug 05 17:48:01.875578 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:48:01.875556 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb0a6db1_307f_486e_acd8_ac0ff42fae2f.slice/crio-1c8e090806fa1a5b0cf311732522c89b00d7c6c1c427484ad25c23ce8d4e4c73 WatchSource:0}: Error finding container 1c8e090806fa1a5b0cf311732522c89b00d7c6c1c427484ad25c23ce8d4e4c73: Status 404 returned error can't find the container with id 1c8e090806fa1a5b0cf311732522c89b00d7c6c1c427484ad25c23ce8d4e4c73 Aug 05 17:48:02.365122 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:02.365083 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b-proxy-tls\") pod \"splitter-graph-db0ba-5f955c994d-pjzfw\" (UID: \"9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b\") " pod="kserve-ci-e2e-test/splitter-graph-db0ba-5f955c994d-pjzfw" Aug 05 17:48:02.367488 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:02.367461 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b-proxy-tls\") pod \"splitter-graph-db0ba-5f955c994d-pjzfw\" (UID: \"9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b\") " pod="kserve-ci-e2e-test/splitter-graph-db0ba-5f955c994d-pjzfw" Aug 05 17:48:02.610230 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:02.610191 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-db0ba-5f955c994d-pjzfw" Aug 05 17:48:02.740312 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:02.740210 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-db0ba-5f955c994d-pjzfw"] Aug 05 17:48:02.742722 ip-10-0-137-104 kubenswrapper[2562]: W0805 17:48:02.742689 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9871ba28_54a9_4c9f_8ec8_8fd4d79c3b9b.slice/crio-e664d07501d5da1c7ecd94c1729872926d7bdfb1d9e718c520c03558d226bae6 WatchSource:0}: Error finding container e664d07501d5da1c7ecd94c1729872926d7bdfb1d9e718c520c03558d226bae6: Status 404 returned error can't find the container with id e664d07501d5da1c7ecd94c1729872926d7bdfb1d9e718c520c03558d226bae6 Aug 05 17:48:02.848437 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:02.848381 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-db0ba-5f955c994d-pjzfw" event={"ID":"9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b","Type":"ContainerStarted","Data":"ff6db8d75430d200e751e05f58bd4de9e9d0d3638a8e5b060ac78d9ad8e784d3"} Aug 05 17:48:02.848630 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:02.848451 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-db0ba-5f955c994d-pjzfw" event={"ID":"9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b","Type":"ContainerStarted","Data":"e664d07501d5da1c7ecd94c1729872926d7bdfb1d9e718c520c03558d226bae6"} Aug 05 17:48:02.848630 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:02.848482 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-db0ba-5f955c994d-pjzfw" Aug 05 17:48:02.849810 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:02.849780 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-741a0-7dd5d757cf-bthq5" event={"ID":"eb0a6db1-307f-486e-acd8-ac0ff42fae2f","Type":"ContainerStarted","Data":"36207bf4539e6d00984ba9a2f6bd4d8d9e86f357e590d02b58c58e96bfb213dc"} Aug 05 17:48:02.849931 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:02.849834 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-741a0-7dd5d757cf-bthq5" event={"ID":"eb0a6db1-307f-486e-acd8-ac0ff42fae2f","Type":"ContainerStarted","Data":"1c8e090806fa1a5b0cf311732522c89b00d7c6c1c427484ad25c23ce8d4e4c73"} Aug 05 17:48:02.849931 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:02.849856 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-741a0-7dd5d757cf-bthq5" Aug 05 17:48:02.865863 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:02.865820 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-db0ba-5f955c994d-pjzfw" podStartSLOduration=1.8658004780000002 podStartE2EDuration="1.865800478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:48:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:48:02.865277105 +0000 UTC m=+2134.037801010" watchObservedRunningTime="2026-08-05 17:48:02.865800478 +0000 UTC m=+2134.038324391" Aug 05 17:48:02.884599 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:02.884511 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-741a0-7dd5d757cf-bthq5" podStartSLOduration=1.884493931 podStartE2EDuration="1.884493931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:48:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:48:02.883491653 +0000 UTC m=+2134.056015565" watchObservedRunningTime="2026-08-05 17:48:02.884493931 +0000 UTC m=+2134.057017842" Aug 05 17:48:08.859897 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:08.859868 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-741a0-7dd5d757cf-bthq5" Aug 05 17:48:08.860302 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:48:08.860161 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-db0ba-5f955c994d-pjzfw" Aug 05 17:56:16.331906 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:56:16.331850 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-db0ba-5f955c994d-pjzfw"] Aug 05 17:56:16.334205 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:56:16.332163 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-db0ba-5f955c994d-pjzfw" podUID="9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b" containerName="splitter-graph-db0ba" containerID="cri-o://ff6db8d75430d200e751e05f58bd4de9e9d0d3638a8e5b060ac78d9ad8e784d3" gracePeriod=30 Aug 05 17:56:18.858229 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:56:18.858186 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-db0ba-5f955c994d-pjzfw" podUID="9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b" containerName="splitter-graph-db0ba" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:56:23.859780 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:56:23.859740 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-db0ba-5f955c994d-pjzfw" podUID="9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b" containerName="splitter-graph-db0ba" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:56:28.859048 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:56:28.858999 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-db0ba-5f955c994d-pjzfw" podUID="9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b" containerName="splitter-graph-db0ba" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:56:28.859569 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:56:28.859142 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-db0ba-5f955c994d-pjzfw" Aug 05 17:56:33.858561 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:56:33.858522 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-db0ba-5f955c994d-pjzfw" podUID="9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b" containerName="splitter-graph-db0ba" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:56:38.858426 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:56:38.858384 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-db0ba-5f955c994d-pjzfw" podUID="9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b" containerName="splitter-graph-db0ba" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:56:43.858231 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:56:43.858189 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-db0ba-5f955c994d-pjzfw" podUID="9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b" containerName="splitter-graph-db0ba" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:56:46.478769 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:56:46.478733 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-db0ba-5f955c994d-pjzfw" Aug 05 17:56:46.618403 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:56:46.618311 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b-proxy-tls\") pod \"9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b\" (UID: \"9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b\") " Aug 05 17:56:46.618403 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:56:46.618377 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b-openshift-service-ca-bundle\") pod \"9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b\" (UID: \"9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b\") " Aug 05 17:56:46.618771 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:56:46.618746 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b" (UID: "9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:56:46.620258 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:56:46.620233 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b" (UID: "9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:56:46.719668 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:56:46.719635 2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b-openshift-service-ca-bundle\") on node \"ip-10-0-137-104.ec2.internal\" DevicePath \"\"" Aug 05 17:56:46.719668 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:56:46.719663 2562 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b-proxy-tls\") on node \"ip-10-0-137-104.ec2.internal\" DevicePath \"\"" Aug 05 17:56:46.949473 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:56:46.949369 2562 generic.go:356] "Generic (PLEG): container finished" podID="9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b" containerID="ff6db8d75430d200e751e05f58bd4de9e9d0d3638a8e5b060ac78d9ad8e784d3" exitCode=0 Aug 05 17:56:46.949473 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:56:46.949414 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-db0ba-5f955c994d-pjzfw" Aug 05 17:56:46.949683 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:56:46.949471 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-db0ba-5f955c994d-pjzfw" event={"ID":"9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b","Type":"ContainerDied","Data":"ff6db8d75430d200e751e05f58bd4de9e9d0d3638a8e5b060ac78d9ad8e784d3"} Aug 05 17:56:46.949683 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:56:46.949521 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-db0ba-5f955c994d-pjzfw" event={"ID":"9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b","Type":"ContainerDied","Data":"e664d07501d5da1c7ecd94c1729872926d7bdfb1d9e718c520c03558d226bae6"} Aug 05 17:56:46.949683 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:56:46.949543 2562 scope.go:117] "RemoveContainer" containerID="ff6db8d75430d200e751e05f58bd4de9e9d0d3638a8e5b060ac78d9ad8e784d3" Aug 05 17:56:46.958415 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:56:46.958396 2562 scope.go:117] "RemoveContainer" containerID="ff6db8d75430d200e751e05f58bd4de9e9d0d3638a8e5b060ac78d9ad8e784d3" Aug 05 17:56:46.958740 ip-10-0-137-104 kubenswrapper[2562]: E0805 17:56:46.958721 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff6db8d75430d200e751e05f58bd4de9e9d0d3638a8e5b060ac78d9ad8e784d3\": container with ID starting with ff6db8d75430d200e751e05f58bd4de9e9d0d3638a8e5b060ac78d9ad8e784d3 not found: ID does not exist" containerID="ff6db8d75430d200e751e05f58bd4de9e9d0d3638a8e5b060ac78d9ad8e784d3" Aug 05 17:56:46.958800 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:56:46.958752 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff6db8d75430d200e751e05f58bd4de9e9d0d3638a8e5b060ac78d9ad8e784d3"} err="failed to get container status \"ff6db8d75430d200e751e05f58bd4de9e9d0d3638a8e5b060ac78d9ad8e784d3\": rpc error: code = NotFound desc = could not find container \"ff6db8d75430d200e751e05f58bd4de9e9d0d3638a8e5b060ac78d9ad8e784d3\": container with ID starting with ff6db8d75430d200e751e05f58bd4de9e9d0d3638a8e5b060ac78d9ad8e784d3 not found: ID does not exist" Aug 05 17:56:46.970372 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:56:46.970325 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-db0ba-5f955c994d-pjzfw"] Aug 05 17:56:46.973950 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:56:46.973924 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-db0ba-5f955c994d-pjzfw"] Aug 05 17:56:47.440980 ip-10-0-137-104 kubenswrapper[2562]: I0805 17:56:47.440946 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b" path="/var/lib/kubelet/pods/9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b/volumes" Aug 05 18:04:20.538408 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:20.538376 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-741a0-7dd5d757cf-bthq5"] Aug 05 18:04:20.540856 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:20.538655 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-741a0-7dd5d757cf-bthq5" podUID="eb0a6db1-307f-486e-acd8-ac0ff42fae2f" containerName="switch-graph-741a0" containerID="cri-o://36207bf4539e6d00984ba9a2f6bd4d8d9e86f357e590d02b58c58e96bfb213dc" gracePeriod=30 Aug 05 18:04:23.858513 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:23.858469 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-741a0-7dd5d757cf-bthq5" podUID="eb0a6db1-307f-486e-acd8-ac0ff42fae2f" containerName="switch-graph-741a0" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 18:04:28.858391 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:28.858329 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-741a0-7dd5d757cf-bthq5" podUID="eb0a6db1-307f-486e-acd8-ac0ff42fae2f" containerName="switch-graph-741a0" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 18:04:33.858236 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:33.858196 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-741a0-7dd5d757cf-bthq5" podUID="eb0a6db1-307f-486e-acd8-ac0ff42fae2f" containerName="switch-graph-741a0" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 18:04:33.858722 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:33.858312 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-741a0-7dd5d757cf-bthq5" Aug 05 18:04:36.573847 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:36.573818 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-741a0-7dd5d757cf-bthq5_eb0a6db1-307f-486e-acd8-ac0ff42fae2f/switch-graph-741a0/0.log" Aug 05 18:04:37.348265 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:37.348232 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-741a0-7dd5d757cf-bthq5_eb0a6db1-307f-486e-acd8-ac0ff42fae2f/switch-graph-741a0/0.log" Aug 05 18:04:38.142015 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:38.141970 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-741a0-7dd5d757cf-bthq5_eb0a6db1-307f-486e-acd8-ac0ff42fae2f/switch-graph-741a0/0.log" Aug 05 18:04:38.858299 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:38.858262 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-741a0-7dd5d757cf-bthq5" podUID="eb0a6db1-307f-486e-acd8-ac0ff42fae2f" containerName="switch-graph-741a0" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 18:04:38.895115 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:38.895092 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-741a0-7dd5d757cf-bthq5_eb0a6db1-307f-486e-acd8-ac0ff42fae2f/switch-graph-741a0/0.log" Aug 05 18:04:39.640137 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:39.640106 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-741a0-7dd5d757cf-bthq5_eb0a6db1-307f-486e-acd8-ac0ff42fae2f/switch-graph-741a0/0.log" Aug 05 18:04:40.405914 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:40.405883 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-741a0-7dd5d757cf-bthq5_eb0a6db1-307f-486e-acd8-ac0ff42fae2f/switch-graph-741a0/0.log" Aug 05 18:04:41.161480 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:41.161451 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-741a0-7dd5d757cf-bthq5_eb0a6db1-307f-486e-acd8-ac0ff42fae2f/switch-graph-741a0/0.log" Aug 05 18:04:41.920553 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:41.920524 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-741a0-7dd5d757cf-bthq5_eb0a6db1-307f-486e-acd8-ac0ff42fae2f/switch-graph-741a0/0.log" Aug 05 18:04:42.677537 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:42.677510 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-741a0-7dd5d757cf-bthq5_eb0a6db1-307f-486e-acd8-ac0ff42fae2f/switch-graph-741a0/0.log" Aug 05 18:04:43.471091 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:43.471058 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-741a0-7dd5d757cf-bthq5_eb0a6db1-307f-486e-acd8-ac0ff42fae2f/switch-graph-741a0/0.log" Aug 05 18:04:43.858251 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:43.858213 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-741a0-7dd5d757cf-bthq5" podUID="eb0a6db1-307f-486e-acd8-ac0ff42fae2f" containerName="switch-graph-741a0" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 18:04:44.275237 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:44.275210 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-741a0-7dd5d757cf-bthq5_eb0a6db1-307f-486e-acd8-ac0ff42fae2f/switch-graph-741a0/0.log" Aug 05 18:04:45.087861 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:45.087834 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-741a0-7dd5d757cf-bthq5_eb0a6db1-307f-486e-acd8-ac0ff42fae2f/switch-graph-741a0/0.log" Aug 05 18:04:45.912618 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:45.912592 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-741a0-7dd5d757cf-bthq5_eb0a6db1-307f-486e-acd8-ac0ff42fae2f/switch-graph-741a0/0.log" Aug 05 18:04:46.703626 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:46.703595 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-741a0-7dd5d757cf-bthq5_eb0a6db1-307f-486e-acd8-ac0ff42fae2f/switch-graph-741a0/0.log" Aug 05 18:04:48.858258 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:48.858217 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-741a0-7dd5d757cf-bthq5" podUID="eb0a6db1-307f-486e-acd8-ac0ff42fae2f" containerName="switch-graph-741a0" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 18:04:50.680588 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:50.680558 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-741a0-7dd5d757cf-bthq5" Aug 05 18:04:50.816474 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:50.816384 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/eb0a6db1-307f-486e-acd8-ac0ff42fae2f-proxy-tls\") pod \"eb0a6db1-307f-486e-acd8-ac0ff42fae2f\" (UID: \"eb0a6db1-307f-486e-acd8-ac0ff42fae2f\") " Aug 05 18:04:50.816474 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:50.816458 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb0a6db1-307f-486e-acd8-ac0ff42fae2f-openshift-service-ca-bundle\") pod \"eb0a6db1-307f-486e-acd8-ac0ff42fae2f\" (UID: \"eb0a6db1-307f-486e-acd8-ac0ff42fae2f\") " Aug 05 18:04:50.816799 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:50.816760 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb0a6db1-307f-486e-acd8-ac0ff42fae2f-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "eb0a6db1-307f-486e-acd8-ac0ff42fae2f" (UID: "eb0a6db1-307f-486e-acd8-ac0ff42fae2f"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 18:04:50.818496 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:50.818471 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb0a6db1-307f-486e-acd8-ac0ff42fae2f-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "eb0a6db1-307f-486e-acd8-ac0ff42fae2f" (UID: "eb0a6db1-307f-486e-acd8-ac0ff42fae2f"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 18:04:50.857385 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:50.857324 2562 generic.go:356] "Generic (PLEG): container finished" podID="eb0a6db1-307f-486e-acd8-ac0ff42fae2f" containerID="36207bf4539e6d00984ba9a2f6bd4d8d9e86f357e590d02b58c58e96bfb213dc" exitCode=0 Aug 05 18:04:50.857555 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:50.857390 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-741a0-7dd5d757cf-bthq5" Aug 05 18:04:50.857555 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:50.857404 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-741a0-7dd5d757cf-bthq5" event={"ID":"eb0a6db1-307f-486e-acd8-ac0ff42fae2f","Type":"ContainerDied","Data":"36207bf4539e6d00984ba9a2f6bd4d8d9e86f357e590d02b58c58e96bfb213dc"} Aug 05 18:04:50.857555 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:50.857460 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-741a0-7dd5d757cf-bthq5" event={"ID":"eb0a6db1-307f-486e-acd8-ac0ff42fae2f","Type":"ContainerDied","Data":"1c8e090806fa1a5b0cf311732522c89b00d7c6c1c427484ad25c23ce8d4e4c73"} Aug 05 18:04:50.857555 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:50.857483 2562 scope.go:117] "RemoveContainer" containerID="36207bf4539e6d00984ba9a2f6bd4d8d9e86f357e590d02b58c58e96bfb213dc" Aug 05 18:04:50.866068 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:50.866051 2562 scope.go:117] "RemoveContainer" containerID="36207bf4539e6d00984ba9a2f6bd4d8d9e86f357e590d02b58c58e96bfb213dc" Aug 05 18:04:50.866366 ip-10-0-137-104 kubenswrapper[2562]: E0805 18:04:50.866327 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36207bf4539e6d00984ba9a2f6bd4d8d9e86f357e590d02b58c58e96bfb213dc\": container with ID starting with 36207bf4539e6d00984ba9a2f6bd4d8d9e86f357e590d02b58c58e96bfb213dc not found: ID does not exist" containerID="36207bf4539e6d00984ba9a2f6bd4d8d9e86f357e590d02b58c58e96bfb213dc" Aug 05 18:04:50.866444 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:50.866378 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36207bf4539e6d00984ba9a2f6bd4d8d9e86f357e590d02b58c58e96bfb213dc"} err="failed to get container status \"36207bf4539e6d00984ba9a2f6bd4d8d9e86f357e590d02b58c58e96bfb213dc\": rpc error: code = NotFound desc = could not find container \"36207bf4539e6d00984ba9a2f6bd4d8d9e86f357e590d02b58c58e96bfb213dc\": container with ID starting with 36207bf4539e6d00984ba9a2f6bd4d8d9e86f357e590d02b58c58e96bfb213dc not found: ID does not exist" Aug 05 18:04:50.877848 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:50.877818 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-741a0-7dd5d757cf-bthq5"] Aug 05 18:04:50.880704 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:50.880684 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-741a0-7dd5d757cf-bthq5"] Aug 05 18:04:50.917565 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:50.917532 2562 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/eb0a6db1-307f-486e-acd8-ac0ff42fae2f-proxy-tls\") on node \"ip-10-0-137-104.ec2.internal\" DevicePath \"\"" Aug 05 18:04:50.917565 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:50.917566 2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb0a6db1-307f-486e-acd8-ac0ff42fae2f-openshift-service-ca-bundle\") on node \"ip-10-0-137-104.ec2.internal\" DevicePath \"\"" Aug 05 18:04:51.440084 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:51.440054 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb0a6db1-307f-486e-acd8-ac0ff42fae2f" path="/var/lib/kubelet/pods/eb0a6db1-307f-486e-acd8-ac0ff42fae2f/volumes" Aug 05 18:04:51.612630 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:51.612546 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-m67dg_4e046e80-1c3a-4186-9ba4-0c393f1a9d0e/global-pull-secret-syncer/0.log" Aug 05 18:04:51.725696 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:51.725594 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bbhd8_13196e32-1d2a-474f-9055-6dd74b3d5b86/konnectivity-agent/0.log" Aug 05 18:04:51.839405 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:51.839375 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-104.ec2.internal_0acbb7bf884d892b9a77e039f147c1de/haproxy/0.log" Aug 05 18:04:56.114328 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:56.114304 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-xbr7x_12e59498-428e-4bec-9fd3-6e8ba11384f4/cluster-monitoring-operator/0.log" Aug 05 18:04:56.141002 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:56.140966 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-w5256_dc2350ad-789a-4dab-8eef-7bc83a9936bf/kube-state-metrics/0.log" Aug 05 18:04:56.164519 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:56.164498 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-w5256_dc2350ad-789a-4dab-8eef-7bc83a9936bf/kube-rbac-proxy-main/0.log" Aug 05 18:04:56.192375 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:56.192327 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-w5256_dc2350ad-789a-4dab-8eef-7bc83a9936bf/kube-rbac-proxy-self/0.log" Aug 05 18:04:56.226351 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:56.226297 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-78c8b7bd89-qbrsl_494ce1fd-e0dc-4439-bca3-8009374c9b2b/metrics-server/0.log" Aug 05 18:04:56.291505 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:56.291455 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-42kbn_f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477/node-exporter/0.log" Aug 05 18:04:56.317265 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:56.317242 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-42kbn_f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477/kube-rbac-proxy/0.log" Aug 05 18:04:56.338292 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:56.338271 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-42kbn_f9b2fc0c-d2d7-48c3-92fb-64c4d4e29477/init-textfile/0.log" Aug 05 18:04:59.613886 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:59.613854 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bm58p/perf-node-gather-daemonset-t2x94"] Aug 05 18:04:59.614288 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:59.614272 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb0a6db1-307f-486e-acd8-ac0ff42fae2f" containerName="switch-graph-741a0" Aug 05 18:04:59.614355 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:59.614293 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb0a6db1-307f-486e-acd8-ac0ff42fae2f" containerName="switch-graph-741a0" Aug 05 18:04:59.614355 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:59.614319 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b" containerName="splitter-graph-db0ba" Aug 05 18:04:59.614355 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:59.614328 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b" containerName="splitter-graph-db0ba" Aug 05 18:04:59.614466 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:59.614426 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb0a6db1-307f-486e-acd8-ac0ff42fae2f" containerName="switch-graph-741a0" Aug 05 18:04:59.614466 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:59.614442 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9871ba28-54a9-4c9f-8ec8-8fd4d79c3b9b" containerName="splitter-graph-db0ba" Aug 05 18:04:59.619038 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:59.619019 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-t2x94" Aug 05 18:04:59.621742 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:59.621721 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bm58p\"/\"openshift-service-ca.crt\"" Aug 05 18:04:59.622059 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:59.622038 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bm58p\"/\"default-dockercfg-q7pnh\"" Aug 05 18:04:59.622113 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:59.622068 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bm58p\"/\"kube-root-ca.crt\"" Aug 05 18:04:59.625860 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:59.625840 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bm58p/perf-node-gather-daemonset-t2x94"] Aug 05 18:04:59.685063 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:59.685029 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wrhm\" (UniqueName: \"kubernetes.io/projected/9cf4e8ee-5a74-46b8-af1a-b06c994b76dd-kube-api-access-4wrhm\") pod \"perf-node-gather-daemonset-t2x94\" (UID: \"9cf4e8ee-5a74-46b8-af1a-b06c994b76dd\") " pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-t2x94" Aug 05 18:04:59.685234 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:59.685077 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9cf4e8ee-5a74-46b8-af1a-b06c994b76dd-podres\") pod \"perf-node-gather-daemonset-t2x94\" (UID: \"9cf4e8ee-5a74-46b8-af1a-b06c994b76dd\") " pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-t2x94" Aug 05 18:04:59.685234 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:59.685165 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9cf4e8ee-5a74-46b8-af1a-b06c994b76dd-sys\") pod \"perf-node-gather-daemonset-t2x94\" (UID: \"9cf4e8ee-5a74-46b8-af1a-b06c994b76dd\") " pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-t2x94" Aug 05 18:04:59.685234 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:59.685203 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9cf4e8ee-5a74-46b8-af1a-b06c994b76dd-proc\") pod \"perf-node-gather-daemonset-t2x94\" (UID: \"9cf4e8ee-5a74-46b8-af1a-b06c994b76dd\") " pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-t2x94" Aug 05 18:04:59.685234 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:59.685231 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9cf4e8ee-5a74-46b8-af1a-b06c994b76dd-lib-modules\") pod \"perf-node-gather-daemonset-t2x94\" (UID: \"9cf4e8ee-5a74-46b8-af1a-b06c994b76dd\") " pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-t2x94" Aug 05 18:04:59.786500 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:59.786468 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wrhm\" (UniqueName: \"kubernetes.io/projected/9cf4e8ee-5a74-46b8-af1a-b06c994b76dd-kube-api-access-4wrhm\") pod \"perf-node-gather-daemonset-t2x94\" (UID: \"9cf4e8ee-5a74-46b8-af1a-b06c994b76dd\") " pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-t2x94" Aug 05 18:04:59.786691 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:59.786509 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9cf4e8ee-5a74-46b8-af1a-b06c994b76dd-podres\") pod \"perf-node-gather-daemonset-t2x94\" (UID: \"9cf4e8ee-5a74-46b8-af1a-b06c994b76dd\") " pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-t2x94" Aug 05 18:04:59.786691 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:59.786534 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9cf4e8ee-5a74-46b8-af1a-b06c994b76dd-sys\") pod \"perf-node-gather-daemonset-t2x94\" (UID: \"9cf4e8ee-5a74-46b8-af1a-b06c994b76dd\") " pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-t2x94" Aug 05 18:04:59.786691 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:59.786593 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9cf4e8ee-5a74-46b8-af1a-b06c994b76dd-sys\") pod \"perf-node-gather-daemonset-t2x94\" (UID: \"9cf4e8ee-5a74-46b8-af1a-b06c994b76dd\") " pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-t2x94" Aug 05 18:04:59.786691 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:59.786619 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9cf4e8ee-5a74-46b8-af1a-b06c994b76dd-proc\") pod \"perf-node-gather-daemonset-t2x94\" (UID: \"9cf4e8ee-5a74-46b8-af1a-b06c994b76dd\") " pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-t2x94" Aug 05 18:04:59.786691 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:59.786639 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9cf4e8ee-5a74-46b8-af1a-b06c994b76dd-lib-modules\") pod \"perf-node-gather-daemonset-t2x94\" (UID: \"9cf4e8ee-5a74-46b8-af1a-b06c994b76dd\") " pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-t2x94" Aug 05 18:04:59.786691 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:59.786667 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9cf4e8ee-5a74-46b8-af1a-b06c994b76dd-podres\") pod \"perf-node-gather-daemonset-t2x94\" (UID: \"9cf4e8ee-5a74-46b8-af1a-b06c994b76dd\") " pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-t2x94" Aug 05 18:04:59.786944 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:59.786736 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9cf4e8ee-5a74-46b8-af1a-b06c994b76dd-proc\") pod \"perf-node-gather-daemonset-t2x94\" (UID: \"9cf4e8ee-5a74-46b8-af1a-b06c994b76dd\") " pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-t2x94" Aug 05 18:04:59.786944 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:59.786746 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9cf4e8ee-5a74-46b8-af1a-b06c994b76dd-lib-modules\") pod \"perf-node-gather-daemonset-t2x94\" (UID: \"9cf4e8ee-5a74-46b8-af1a-b06c994b76dd\") " pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-t2x94" Aug 05 18:04:59.794501 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:59.794475 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wrhm\" (UniqueName: \"kubernetes.io/projected/9cf4e8ee-5a74-46b8-af1a-b06c994b76dd-kube-api-access-4wrhm\") pod \"perf-node-gather-daemonset-t2x94\" (UID: \"9cf4e8ee-5a74-46b8-af1a-b06c994b76dd\") " pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-t2x94" Aug 05 18:04:59.810564 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:59.810540 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5b8776669-tdhz6_1d3ccb1f-4b5b-47da-a4e4-d60ac0a8b2f4/volume-data-source-validator/0.log" Aug 05 18:04:59.929868 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:04:59.929775 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-t2x94" Aug 05 18:05:00.055881 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:00.055725 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bm58p/perf-node-gather-daemonset-t2x94"] Aug 05 18:05:00.058251 ip-10-0-137-104 kubenswrapper[2562]: W0805 18:05:00.058221 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9cf4e8ee_5a74_46b8_af1a_b06c994b76dd.slice/crio-e64f3189639f180aecb7e0455307c085e4d3903f0eb3e040caa871cd48293ee3 WatchSource:0}: Error finding container e64f3189639f180aecb7e0455307c085e4d3903f0eb3e040caa871cd48293ee3: Status 404 returned error can't find the container with id e64f3189639f180aecb7e0455307c085e4d3903f0eb3e040caa871cd48293ee3 Aug 05 18:05:00.630235 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:00.630207 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-87z42_7eb0a9c9-9673-426a-9db6-52bd7454b2e3/dns/0.log" Aug 05 18:05:00.651790 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:00.651761 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-87z42_7eb0a9c9-9673-426a-9db6-52bd7454b2e3/kube-rbac-proxy/0.log" Aug 05 18:05:00.810490 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:00.810460 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x92vq_71a8ffdb-65f6-4e21-9ebf-a37111978c48/dns-node-resolver/0.log" Aug 05 18:05:00.897828 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:00.897734 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-t2x94" event={"ID":"9cf4e8ee-5a74-46b8-af1a-b06c994b76dd","Type":"ContainerStarted","Data":"680b2fa86ae488f4ed6f6bfa7b0004a17587784651085f3283601e86d7b58f62"} Aug 05 18:05:00.897828 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:00.897789 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-t2x94" event={"ID":"9cf4e8ee-5a74-46b8-af1a-b06c994b76dd","Type":"ContainerStarted","Data":"e64f3189639f180aecb7e0455307c085e4d3903f0eb3e040caa871cd48293ee3"} Aug 05 18:05:00.897828 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:00.897828 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-t2x94" Aug 05 18:05:00.913677 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:00.913630 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-t2x94" podStartSLOduration=1.913615262 podStartE2EDuration="1.913615262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 18:04:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:05:00.912111474 +0000 UTC m=+3152.084635377" watchObservedRunningTime="2026-08-05 18:05:00.913615262 +0000 UTC m=+3152.086139171" Aug 05 18:05:01.248984 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:01.248956 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5b6564796c-6l4mt_7a2ac39e-2891-48a5-8141-69278698a16a/registry/0.log" Aug 05 18:05:01.270095 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:01.270069 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hm4pp_202de948-1d6f-4d03-a580-2e38f89164a1/node-ca/0.log" Aug 05 18:05:02.396310 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:02.396280 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xwr4m_95b2fee7-9604-40e1-8a29-f86363c5991e/serve-healthcheck-canary/0.log" Aug 05 18:05:02.859461 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:02.859428 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r2dtl_96ad42ff-12a1-45b4-9481-2e6daa28ff2d/kube-rbac-proxy/0.log" Aug 05 18:05:02.876935 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:02.876909 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r2dtl_96ad42ff-12a1-45b4-9481-2e6daa28ff2d/exporter/0.log" Aug 05 18:05:02.895010 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:02.894986 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r2dtl_96ad42ff-12a1-45b4-9481-2e6daa28ff2d/extractor/0.log" Aug 05 18:05:05.026826 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:05.026791 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-6f49dcd9ff-cm7s8_7d534ddb-a76f-4f32-b520-7371e8f49765/manager/0.log" Aug 05 18:05:05.052703 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:05.052677 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-654c557856-qx854_154005b8-b3c4-425e-88b0-d79aea504d6b/manager/0.log" Aug 05 18:05:05.069129 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:05.069107 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-7b954ffc95-s88zv_c85c19ca-6225-4b34-9262-1efea0ca1d6a/server/0.log" Aug 05 18:05:06.911988 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:06.911959 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-t2x94" Aug 05 18:05:09.059265 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:09.059229 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-98cmk_c022ed4e-1cbe-4053-aad8-56fd09fe9376/migrator/0.log" Aug 05 18:05:09.080727 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:09.080703 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-98cmk_c022ed4e-1cbe-4053-aad8-56fd09fe9376/graceful-termination/0.log" Aug 05 18:05:10.442600 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:10.442573 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nx4tc_97da412c-62d1-470d-a056-aeac249c73f7/kube-multus-additional-cni-plugins/0.log" Aug 05 18:05:10.462298 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:10.462273 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nx4tc_97da412c-62d1-470d-a056-aeac249c73f7/egress-router-binary-copy/0.log" Aug 05 18:05:10.482055 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:10.482035 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nx4tc_97da412c-62d1-470d-a056-aeac249c73f7/cni-plugins/0.log" Aug 05 18:05:10.502929 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:10.502909 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nx4tc_97da412c-62d1-470d-a056-aeac249c73f7/bond-cni-plugin/0.log" Aug 05 18:05:10.524312 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:10.524288 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nx4tc_97da412c-62d1-470d-a056-aeac249c73f7/routeoverride-cni/0.log" Aug 05 18:05:10.545390 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:10.545311 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nx4tc_97da412c-62d1-470d-a056-aeac249c73f7/whereabouts-cni-bincopy/0.log" Aug 05 18:05:10.566133 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:10.566105 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nx4tc_97da412c-62d1-470d-a056-aeac249c73f7/whereabouts-cni/0.log" Aug 05 18:05:10.767261 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:10.767235 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qzp8m_cca3acc3-94b8-4f10-8804-719ac52f1537/kube-multus/0.log" Aug 05 18:05:10.902597 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:10.902572 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-smhw9_4618f8d9-07bc-4de7-9c7c-b09d7fe9d923/network-metrics-daemon/0.log" Aug 05 18:05:10.925417 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:10.925397 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-smhw9_4618f8d9-07bc-4de7-9c7c-b09d7fe9d923/kube-rbac-proxy/0.log" Aug 05 18:05:11.610591 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:11.610566 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lxfxq_c85c5ba1-cee1-4308-a12c-8ab17a41b118/ovn-controller/0.log" Aug 05 18:05:11.626885 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:11.626861 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lxfxq_c85c5ba1-cee1-4308-a12c-8ab17a41b118/ovn-acl-logging/0.log" Aug 05 18:05:11.659051 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:11.659028 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lxfxq_c85c5ba1-cee1-4308-a12c-8ab17a41b118/kube-rbac-proxy-node/0.log" Aug 05 18:05:11.677491 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:11.677467 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lxfxq_c85c5ba1-cee1-4308-a12c-8ab17a41b118/kube-rbac-proxy-ovn-metrics/0.log" Aug 05 18:05:11.693303 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:11.693279 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lxfxq_c85c5ba1-cee1-4308-a12c-8ab17a41b118/northd/0.log" Aug 05 18:05:11.711368 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:11.711328 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lxfxq_c85c5ba1-cee1-4308-a12c-8ab17a41b118/nbdb/0.log" Aug 05 18:05:11.729219 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:11.729195 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lxfxq_c85c5ba1-cee1-4308-a12c-8ab17a41b118/sbdb/0.log" Aug 05 18:05:11.764958 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:11.764930 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lxfxq_c85c5ba1-cee1-4308-a12c-8ab17a41b118/ovnkube-controller/0.log" Aug 05 18:05:13.028074 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:13.028042 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-65bdbbff45-sj8rd_ab585e0e-4903-475a-9e16-5cec636ebe3b/check-endpoints/0.log" Aug 05 18:05:13.052585 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:13.052552 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-rw5vc_8e25eb68-7896-4157-a857-0c72022fc3ff/network-check-target-container/0.log" Aug 05 18:05:13.940205 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:13.940181 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-64bcn_f4596021-3f10-4dcb-812c-5d9cdcfa8373/iptables-alerter/0.log" Aug 05 18:05:14.566117 ip-10-0-137-104 kubenswrapper[2562]: I0805 18:05:14.566089 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-5hfnl_efe99302-9b6f-4f5b-9fd4-9327d511cd6e/tuned/0.log"