Jul 06 20:32:48.995569 ip-10-0-142-77 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 06 20:32:48.995579 ip-10-0-142-77 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 06 20:32:48.995587 ip-10-0-142-77 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 06 20:32:48.995836 ip-10-0-142-77 systemd[1]: Failed to start Kubernetes Kubelet. Jul 06 20:33:00.217124 ip-10-0-142-77 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 06 20:33:00.217146 ip-10-0-142-77 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot af267e0fa72946c8b275f0be955405ff -- Jul 06 20:34:57.461255 ip-10-0-142-77 systemd[1]: Starting Kubernetes Kubelet... Jul 06 20:34:57.864917 ip-10-0-142-77 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 20:34:57.864917 ip-10-0-142-77 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 20:34:57.864917 ip-10-0-142-77 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 20:34:57.864917 ip-10-0-142-77 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 20:34:57.864917 ip-10-0-142-77 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 20:34:57.865505 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.864936 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 20:34:57.870768 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870740 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:34:57.870768 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870762 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:34:57.870768 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870767 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:34:57.870768 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870770 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:34:57.870768 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870772 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:34:57.870768 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870775 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:34:57.870768 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870779 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:34:57.871032 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870782 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:34:57.871032 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870784 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:34:57.871032 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870786 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:34:57.871032 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870789 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:34:57.871032 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870791 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:34:57.871032 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870800 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:34:57.871032 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870802 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:34:57.871032 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870804 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:34:57.871032 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870807 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:34:57.871032 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870810 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:34:57.871032 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870812 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:34:57.871032 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870815 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:34:57.871032 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870818 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:34:57.871032 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870822 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:34:57.871032 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870826 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:34:57.871032 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870828 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:34:57.871032 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870831 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:34:57.871032 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870835 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:34:57.871032 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870838 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:34:57.871447 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870841 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:34:57.871447 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870843 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:34:57.871447 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870846 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:34:57.871447 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870849 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:34:57.871447 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870852 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:34:57.871447 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870854 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:34:57.871447 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870857 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:34:57.871447 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870859 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:34:57.871447 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870862 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:34:57.871447 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870864 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:34:57.871447 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870866 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:34:57.871447 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870868 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:34:57.871447 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870891 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:34:57.871447 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870895 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:34:57.871447 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870898 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:34:57.871447 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870900 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:34:57.871447 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870903 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:34:57.871447 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870906 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:34:57.871447 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870908 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:34:57.871447 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870911 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:34:57.872010 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870913 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:34:57.872010 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870916 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:34:57.872010 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870918 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:34:57.872010 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870920 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:34:57.872010 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870923 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:34:57.872010 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870925 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:34:57.872010 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870927 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:34:57.872010 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870930 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:34:57.872010 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870932 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:34:57.872010 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870934 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:34:57.872010 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870936 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:34:57.872010 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870939 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:34:57.872010 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870941 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:34:57.872010 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870944 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:34:57.872010 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870946 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:34:57.872010 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870948 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:34:57.872010 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870953 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:34:57.872010 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870956 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:34:57.872010 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870959 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:34:57.872010 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870961 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:34:57.872486 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870963 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:34:57.872486 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870966 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:34:57.872486 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870968 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:34:57.872486 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870970 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:34:57.872486 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870972 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:34:57.872486 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870975 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:34:57.872486 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870978 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:34:57.872486 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870980 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:34:57.872486 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870982 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:34:57.872486 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870985 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:34:57.872486 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870987 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:34:57.872486 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870990 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:34:57.872486 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870992 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:34:57.872486 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870994 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:34:57.872486 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870997 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:34:57.872486 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.870999 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:34:57.872486 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871001 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:34:57.872486 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871005 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:34:57.872486 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871012 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:34:57.872486 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871014 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:34:57.872957 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871017 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:34:57.872957 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871019 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:34:57.872957 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871021 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:34:57.872957 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871024 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:34:57.872957 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871026 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:34:57.872957 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871028 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:34:57.872957 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871031 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:34:57.872957 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871033 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:34:57.872957 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871036 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:34:57.872957 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871038 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:34:57.872957 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871041 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:34:57.872957 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871043 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:34:57.872957 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871045 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:34:57.872957 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871762 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:34:57.872957 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871769 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:34:57.872957 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871772 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:34:57.872957 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871774 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:34:57.872957 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871777 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:34:57.872957 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871781 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:34:57.873372 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871784 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:34:57.873372 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871786 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:34:57.873372 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871790 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:34:57.873372 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871802 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:34:57.873372 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871805 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:34:57.873372 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871807 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:34:57.873372 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871811 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:34:57.873372 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871813 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:34:57.873372 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871816 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:34:57.873372 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871819 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:34:57.873372 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871821 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:34:57.873372 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871824 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:34:57.873372 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871827 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:34:57.873372 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871829 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:34:57.873372 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871832 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:34:57.873372 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871834 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:34:57.873372 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871837 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:34:57.873372 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871839 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:34:57.873372 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871841 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:34:57.873808 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871844 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:34:57.873808 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871846 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:34:57.873808 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871849 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:34:57.873808 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871852 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:34:57.873808 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871854 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:34:57.873808 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871857 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:34:57.873808 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871859 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:34:57.873808 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871862 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:34:57.873808 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871865 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:34:57.873808 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871867 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:34:57.873808 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871874 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:34:57.873808 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871889 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:34:57.873808 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871891 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:34:57.873808 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871894 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:34:57.873808 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871896 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:34:57.873808 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871898 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:34:57.873808 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871901 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:34:57.873808 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871903 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:34:57.873808 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871906 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:34:57.873808 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871908 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:34:57.874282 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871911 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:34:57.874282 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871915 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:34:57.874282 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871918 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:34:57.874282 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871921 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:34:57.874282 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871924 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:34:57.874282 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871926 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:34:57.874282 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871929 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:34:57.874282 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871931 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:34:57.874282 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871934 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:34:57.874282 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871936 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:34:57.874282 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871938 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:34:57.874282 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871941 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:34:57.874282 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871943 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:34:57.874282 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871945 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:34:57.874282 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871948 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:34:57.874282 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871951 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:34:57.874282 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871953 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:34:57.874282 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871956 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:34:57.874282 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871959 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:34:57.874282 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871961 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:34:57.874729 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871965 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:34:57.874729 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871968 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:34:57.874729 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871971 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:34:57.874729 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871973 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:34:57.874729 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871976 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:34:57.874729 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871979 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:34:57.874729 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871981 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:34:57.874729 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871984 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:34:57.874729 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871986 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:34:57.874729 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871988 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:34:57.874729 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871991 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:34:57.874729 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871993 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:34:57.874729 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871995 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:34:57.874729 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.871997 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:34:57.874729 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872000 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:34:57.874729 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872002 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:34:57.874729 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872004 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:34:57.874729 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872006 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:34:57.874729 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872009 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:34:57.875166 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872012 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:34:57.875166 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872015 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:34:57.875166 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872017 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:34:57.875166 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872019 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:34:57.875166 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872022 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:34:57.875166 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872024 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:34:57.875166 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872026 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:34:57.875166 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872029 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:34:57.875166 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872031 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:34:57.875166 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872033 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:34:57.875166 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872036 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:34:57.875166 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872038 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:34:57.875166 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872040 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:34:57.875166 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872042 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:34:57.875166 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872044 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:34:57.875166 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872400 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:34:57.875166 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872405 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:34:57.875166 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872408 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:34:57.875166 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872410 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:34:57.875166 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872413 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:34:57.875610 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872415 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:34:57.875610 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872417 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:34:57.875610 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872420 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:34:57.875610 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872423 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:34:57.875610 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872425 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:34:57.875610 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872428 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:34:57.875610 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872430 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:34:57.875610 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872434 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:34:57.875610 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872437 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:34:57.875610 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872443 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:34:57.875610 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872446 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:34:57.875610 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872449 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:34:57.875610 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872452 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:34:57.875610 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872455 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:34:57.875610 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872457 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:34:57.875610 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872460 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:34:57.875610 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872462 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:34:57.875610 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872464 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:34:57.875610 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872467 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:34:57.875610 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872469 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:34:57.876089 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872472 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:34:57.876089 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872474 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:34:57.876089 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872477 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:34:57.876089 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872479 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:34:57.876089 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872481 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:34:57.876089 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872484 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:34:57.876089 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872486 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:34:57.876089 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872488 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:34:57.876089 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872491 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:34:57.876089 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872493 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:34:57.876089 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872496 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:34:57.876089 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872498 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:34:57.876089 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872500 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:34:57.876089 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872503 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:34:57.876089 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872505 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:34:57.876089 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872507 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:34:57.876089 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872509 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:34:57.876089 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872513 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:34:57.876089 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872516 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:34:57.876508 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872520 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:34:57.876508 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872523 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:34:57.876508 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872527 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:34:57.876508 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872529 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:34:57.876508 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872532 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:34:57.876508 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872535 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:34:57.876508 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872537 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:34:57.876508 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872540 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:34:57.876508 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872543 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:34:57.876508 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872545 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:34:57.876508 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872548 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:34:57.876508 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872551 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:34:57.876508 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872554 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:34:57.876508 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872556 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:34:57.876508 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872559 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:34:57.876508 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872561 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:34:57.876508 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872564 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:34:57.876508 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872566 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:34:57.876508 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872569 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:34:57.876508 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872571 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:34:57.877038 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872573 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:34:57.877038 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872576 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:34:57.877038 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872578 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:34:57.877038 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872581 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:34:57.877038 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872583 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:34:57.877038 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872585 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:34:57.877038 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872588 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:34:57.877038 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872590 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:34:57.877038 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872592 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:34:57.877038 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872594 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:34:57.877038 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872596 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:34:57.877038 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872600 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:34:57.877038 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872602 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:34:57.877038 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872604 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:34:57.877038 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872607 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:34:57.877038 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872609 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:34:57.877038 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872612 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:34:57.877038 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872614 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:34:57.877038 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872617 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:34:57.877038 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872619 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:34:57.877482 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872622 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:34:57.877482 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872624 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:34:57.877482 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872626 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:34:57.877482 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872628 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:34:57.877482 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872633 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:34:57.877482 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872636 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:34:57.877482 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872638 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:34:57.877482 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872641 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:34:57.877482 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872643 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:34:57.877482 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872645 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:34:57.877482 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872647 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:34:57.877482 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872649 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:34:57.877482 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872652 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:34:57.877482 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872654 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:34:57.877482 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.872656 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:34:57.877482 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872760 2562 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 20:34:57.877482 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872770 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 20:34:57.877482 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872779 2562 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 20:34:57.877482 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872783 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 20:34:57.877482 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872787 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 20:34:57.877482 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872790 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 20:34:57.877966 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872794 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 20:34:57.877966 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872799 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 20:34:57.877966 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872802 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 20:34:57.877966 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872804 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 20:34:57.877966 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872807 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 20:34:57.877966 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872811 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 20:34:57.877966 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872814 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 20:34:57.877966 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872817 2562 flags.go:64] FLAG: --cgroup-root="" Jul 06 20:34:57.877966 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872819 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 20:34:57.877966 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872822 2562 flags.go:64] FLAG: --client-ca-file="" Jul 06 20:34:57.877966 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872826 2562 flags.go:64] FLAG: --cloud-provider="external" Jul 06 20:34:57.877966 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872828 2562 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 20:34:57.877966 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872833 2562 flags.go:64] FLAG: --cluster-domain="" Jul 06 20:34:57.877966 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872835 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 20:34:57.877966 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872838 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 20:34:57.877966 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872842 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 20:34:57.877966 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872846 2562 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 20:34:57.877966 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872849 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 20:34:57.877966 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872852 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 20:34:57.877966 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872855 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 20:34:57.877966 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872858 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 20:34:57.877966 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872860 2562 flags.go:64] FLAG: --contention-profiling="false" Jul 06 20:34:57.877966 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872863 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 20:34:57.877966 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872871 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 20:34:57.878518 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872874 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 20:34:57.878518 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872888 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 20:34:57.878518 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872892 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 20:34:57.878518 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872895 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 20:34:57.878518 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872898 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 20:34:57.878518 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872900 2562 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 20:34:57.878518 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872903 2562 flags.go:64] FLAG: --enable-server="true" Jul 06 20:34:57.878518 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872906 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 20:34:57.878518 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872910 2562 flags.go:64] FLAG: --event-burst="100" Jul 06 20:34:57.878518 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872913 2562 flags.go:64] FLAG: --event-qps="50" Jul 06 20:34:57.878518 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872916 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 20:34:57.878518 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872918 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 20:34:57.878518 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872921 2562 flags.go:64] FLAG: --eviction-hard="" Jul 06 20:34:57.878518 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872925 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 20:34:57.878518 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872927 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 20:34:57.878518 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872930 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 20:34:57.878518 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872933 2562 flags.go:64] FLAG: --eviction-soft="" Jul 06 20:34:57.878518 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872936 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 20:34:57.878518 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872938 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 20:34:57.878518 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872942 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 20:34:57.878518 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872945 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 20:34:57.878518 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872948 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 20:34:57.878518 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872950 2562 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 20:34:57.878518 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872954 2562 flags.go:64] FLAG: --feature-gates="" Jul 06 20:34:57.878518 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872958 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 20:34:57.879116 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872961 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 20:34:57.879116 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872964 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 20:34:57.879116 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872967 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 20:34:57.879116 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872970 2562 flags.go:64] FLAG: --healthz-port="10248" Jul 06 20:34:57.879116 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872973 2562 flags.go:64] FLAG: --help="false" Jul 06 20:34:57.879116 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872975 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-142-77.ec2.internal" Jul 06 20:34:57.879116 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872978 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 20:34:57.879116 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872981 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 20:34:57.879116 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872983 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 20:34:57.879116 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872987 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 20:34:57.879116 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872990 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 20:34:57.879116 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872992 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 20:34:57.879116 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872995 2562 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 20:34:57.879116 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.872998 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 20:34:57.879116 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873000 2562 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 20:34:57.879116 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873003 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 20:34:57.879116 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873006 2562 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 20:34:57.879116 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873008 2562 flags.go:64] FLAG: --kube-reserved="" Jul 06 20:34:57.879116 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873011 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 20:34:57.879116 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873013 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 20:34:57.879116 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873018 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 20:34:57.879116 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873020 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 20:34:57.879116 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873023 2562 flags.go:64] FLAG: --lock-file="" Jul 06 20:34:57.879116 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873025 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 20:34:57.879644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873028 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 20:34:57.879644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873031 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 20:34:57.879644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873036 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 20:34:57.879644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873039 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 20:34:57.879644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873055 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 20:34:57.879644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873059 2562 flags.go:64] FLAG: --logging-format="text" Jul 06 20:34:57.879644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873063 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 20:34:57.879644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873067 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 20:34:57.879644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873070 2562 flags.go:64] FLAG: --manifest-url="" Jul 06 20:34:57.879644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873072 2562 flags.go:64] FLAG: --manifest-url-header="" Jul 06 20:34:57.879644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873077 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 20:34:57.879644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873079 2562 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 20:34:57.879644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873083 2562 flags.go:64] FLAG: --max-pods="110" Jul 06 20:34:57.879644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873086 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 20:34:57.879644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873088 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 20:34:57.879644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873091 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 20:34:57.879644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873094 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 20:34:57.879644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873097 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 20:34:57.879644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873099 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 20:34:57.879644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873102 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 20:34:57.879644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873109 2562 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 20:34:57.879644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873112 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 20:34:57.879644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873115 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 20:34:57.879644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873117 2562 flags.go:64] FLAG: --pod-cidr="" Jul 06 20:34:57.880228 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873120 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 20:34:57.880228 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873125 2562 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 20:34:57.880228 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873128 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 20:34:57.880228 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873130 2562 flags.go:64] FLAG: --pods-per-core="0" Jul 06 20:34:57.880228 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873134 2562 flags.go:64] FLAG: --port="10250" Jul 06 20:34:57.880228 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873137 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 20:34:57.880228 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873140 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ef8fec08f99aeded" Jul 06 20:34:57.880228 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873142 2562 flags.go:64] FLAG: --qos-reserved="" Jul 06 20:34:57.880228 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873145 2562 flags.go:64] FLAG: --read-only-port="10255" Jul 06 20:34:57.880228 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873148 2562 flags.go:64] FLAG: --register-node="true" Jul 06 20:34:57.880228 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873150 2562 flags.go:64] FLAG: --register-with-taints="" Jul 06 20:34:57.880228 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873153 2562 flags.go:64] FLAG: --registry-burst="10" Jul 06 20:34:57.880228 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873157 2562 flags.go:64] FLAG: --registry-qps="5" Jul 06 20:34:57.880228 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873159 2562 flags.go:64] FLAG: --reserved-cpus="" Jul 06 20:34:57.880228 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873162 2562 flags.go:64] FLAG: --reserved-memory="" Jul 06 20:34:57.880228 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873167 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 20:34:57.880228 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873169 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 20:34:57.880228 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873172 2562 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 20:34:57.880228 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873175 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 20:34:57.880228 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873178 2562 flags.go:64] FLAG: --runonce="false" Jul 06 20:34:57.880228 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873180 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 20:34:57.880228 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873183 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 20:34:57.880228 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873186 2562 flags.go:64] FLAG: --seccomp-default="false" Jul 06 20:34:57.880228 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873188 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 20:34:57.880228 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873191 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 20:34:57.880801 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873193 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 20:34:57.880801 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873196 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 20:34:57.880801 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873199 2562 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 20:34:57.880801 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873201 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 20:34:57.880801 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873204 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 20:34:57.880801 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873206 2562 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 20:34:57.880801 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873209 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 20:34:57.880801 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873211 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 20:34:57.880801 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873214 2562 flags.go:64] FLAG: --system-cgroups="" Jul 06 20:34:57.880801 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873217 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 20:34:57.880801 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873221 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 20:34:57.880801 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873225 2562 flags.go:64] FLAG: --tls-cert-file="" Jul 06 20:34:57.880801 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873227 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 20:34:57.880801 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873231 2562 flags.go:64] FLAG: --tls-min-version="" Jul 06 20:34:57.880801 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873234 2562 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 20:34:57.880801 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873236 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 20:34:57.880801 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873239 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 20:34:57.880801 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873242 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 20:34:57.880801 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873245 2562 flags.go:64] FLAG: --v="2" Jul 06 20:34:57.880801 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873249 2562 flags.go:64] FLAG: --version="false" Jul 06 20:34:57.880801 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873253 2562 flags.go:64] FLAG: --vmodule="" Jul 06 20:34:57.880801 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873256 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 20:34:57.880801 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873262 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 20:34:57.880801 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873383 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:34:57.881346 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873387 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:34:57.881346 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873389 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:34:57.881346 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873392 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:34:57.881346 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873396 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:34:57.881346 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873398 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:34:57.881346 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873401 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:34:57.881346 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873403 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:34:57.881346 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873406 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:34:57.881346 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873408 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:34:57.881346 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873411 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:34:57.881346 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873413 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:34:57.881346 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873417 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:34:57.881346 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873420 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:34:57.881346 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873423 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:34:57.881346 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873426 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:34:57.881346 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873428 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:34:57.881346 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873431 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:34:57.881346 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873433 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:34:57.881346 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873435 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:34:57.881772 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873439 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:34:57.881772 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873441 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:34:57.881772 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873444 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:34:57.881772 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873446 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:34:57.881772 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873448 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:34:57.881772 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873451 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:34:57.881772 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873453 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:34:57.881772 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873457 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:34:57.881772 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873460 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:34:57.881772 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873463 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:34:57.881772 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873466 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:34:57.881772 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873470 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:34:57.881772 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873472 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:34:57.881772 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873475 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:34:57.881772 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873478 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:34:57.881772 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873480 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:34:57.881772 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873482 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:34:57.881772 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873485 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:34:57.881772 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873487 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:34:57.881772 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873489 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:34:57.882252 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873492 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:34:57.882252 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873494 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:34:57.882252 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873497 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:34:57.882252 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873499 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:34:57.882252 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873501 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:34:57.882252 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873505 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:34:57.882252 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873508 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:34:57.882252 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873511 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:34:57.882252 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873513 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:34:57.882252 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873516 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:34:57.882252 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873518 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:34:57.882252 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873520 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:34:57.882252 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873524 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:34:57.882252 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873526 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:34:57.882252 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873528 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:34:57.882252 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873531 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:34:57.882252 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873533 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:34:57.882252 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873535 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:34:57.882252 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873538 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:34:57.882684 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873540 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:34:57.882684 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873542 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:34:57.882684 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873544 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:34:57.882684 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873547 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:34:57.882684 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873550 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:34:57.882684 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873553 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:34:57.882684 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873555 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:34:57.882684 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873557 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:34:57.882684 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873560 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:34:57.882684 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873562 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:34:57.882684 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873564 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:34:57.882684 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873567 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:34:57.882684 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873569 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:34:57.882684 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873571 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:34:57.882684 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873573 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:34:57.882684 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873576 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:34:57.882684 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873578 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:34:57.882684 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873581 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:34:57.882684 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873583 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:34:57.882684 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873585 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:34:57.883212 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873588 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:34:57.883212 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873590 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:34:57.883212 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873593 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:34:57.883212 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873595 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:34:57.883212 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873597 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:34:57.883212 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873601 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:34:57.883212 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873603 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:34:57.883212 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873606 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:34:57.883212 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873608 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:34:57.883212 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873611 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:34:57.883212 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873613 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:34:57.883212 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873616 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:34:57.883212 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873618 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:34:57.883212 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873620 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:34:57.883212 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873623 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:34:57.883212 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873625 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:34:57.883212 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873628 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:34:57.883212 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873631 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:34:57.883212 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873634 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:34:57.883212 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.873636 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:34:57.883683 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.873641 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 20:34:57.883683 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.879924 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 20:34:57.883683 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.879946 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 20:34:57.883683 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.879960 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 20:34:57.883683 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.879965 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 20:34:57.883683 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880018 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:34:57.883683 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880024 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:34:57.883683 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880026 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:34:57.883683 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880030 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:34:57.883683 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880034 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:34:57.883683 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880037 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:34:57.883683 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880040 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:34:57.883683 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880043 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:34:57.883683 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880045 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:34:57.884090 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880048 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:34:57.884090 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880051 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:34:57.884090 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880054 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:34:57.884090 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880057 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:34:57.884090 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880059 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:34:57.884090 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880062 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:34:57.884090 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880065 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:34:57.884090 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880068 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:34:57.884090 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880070 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:34:57.884090 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880073 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:34:57.884090 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880075 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:34:57.884090 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880078 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:34:57.884090 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880081 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:34:57.884090 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880084 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:34:57.884090 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880086 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:34:57.884090 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880089 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:34:57.884090 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880092 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:34:57.884090 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880094 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:34:57.884090 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880097 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:34:57.884090 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880100 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:34:57.884638 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880104 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:34:57.884638 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880106 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:34:57.884638 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880109 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:34:57.884638 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880112 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:34:57.884638 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880115 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:34:57.884638 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880118 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:34:57.884638 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880121 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:34:57.884638 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880123 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:34:57.884638 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880126 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:34:57.884638 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880128 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:34:57.884638 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880130 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:34:57.884638 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880132 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:34:57.884638 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880134 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:34:57.884638 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880137 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:34:57.884638 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880139 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:34:57.884638 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880142 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:34:57.884638 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880144 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:34:57.884638 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880146 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:34:57.884638 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880149 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:34:57.884638 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880152 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:34:57.885434 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880154 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:34:57.885434 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880157 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:34:57.885434 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880159 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:34:57.885434 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880161 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:34:57.885434 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880163 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:34:57.885434 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880166 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:34:57.885434 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880168 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:34:57.885434 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880170 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:34:57.885434 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880172 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:34:57.885434 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880175 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:34:57.885434 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880177 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:34:57.885434 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880181 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:34:57.885434 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880183 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:34:57.885434 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880186 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:34:57.885434 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880189 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:34:57.885434 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880191 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:34:57.885434 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880194 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:34:57.885434 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880196 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:34:57.885434 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880198 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:34:57.886066 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880200 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:34:57.886066 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880203 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:34:57.886066 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880205 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:34:57.886066 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880207 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:34:57.886066 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880209 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:34:57.886066 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880212 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:34:57.886066 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880214 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:34:57.886066 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880216 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:34:57.886066 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880218 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:34:57.886066 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880221 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:34:57.886066 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880224 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:34:57.886066 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880226 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:34:57.886066 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880229 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:34:57.886066 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880232 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:34:57.886066 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880234 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:34:57.886066 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880236 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:34:57.886066 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880239 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:34:57.886066 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880241 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:34:57.886066 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880244 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:34:57.886066 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880246 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:34:57.886549 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880248 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:34:57.886549 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880251 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:34:57.886549 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880253 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:34:57.886549 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880255 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:34:57.886549 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880258 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:34:57.886549 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880260 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:34:57.886549 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880263 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:34:57.886549 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880266 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:34:57.886549 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880268 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:34:57.886549 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880272 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:34:57.886549 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880275 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:34:57.886549 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.880280 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 20:34:57.886549 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880386 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:34:57.886549 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880390 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:34:57.886900 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880393 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:34:57.886900 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880396 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:34:57.886900 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880398 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:34:57.886900 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880401 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:34:57.886900 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880404 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:34:57.886900 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880406 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:34:57.886900 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880409 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:34:57.886900 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880411 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:34:57.886900 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880414 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:34:57.886900 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880417 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:34:57.886900 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880420 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:34:57.886900 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880423 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:34:57.886900 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880426 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:34:57.886900 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880428 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:34:57.886900 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880430 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:34:57.886900 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880434 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:34:57.886900 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880437 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:34:57.886900 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880439 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:34:57.887533 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880441 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:34:57.887533 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880444 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:34:57.887533 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880447 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:34:57.887533 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880449 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:34:57.887533 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880452 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:34:57.887533 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880454 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:34:57.887533 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880457 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:34:57.887533 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880459 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:34:57.887533 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880462 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:34:57.887533 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880464 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:34:57.887533 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880466 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:34:57.887533 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880469 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:34:57.887533 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880471 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:34:57.887533 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880473 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:34:57.887533 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880475 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:34:57.887533 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880477 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:34:57.887533 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880480 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:34:57.887533 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880482 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:34:57.887533 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880484 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:34:57.887533 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880486 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:34:57.888044 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880488 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:34:57.888044 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880491 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:34:57.888044 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880494 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:34:57.888044 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880496 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:34:57.888044 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880498 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:34:57.888044 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880501 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:34:57.888044 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880503 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:34:57.888044 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880505 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:34:57.888044 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880508 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:34:57.888044 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880511 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:34:57.888044 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880513 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:34:57.888044 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880516 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:34:57.888044 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880518 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:34:57.888044 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880520 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:34:57.888044 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880523 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:34:57.888044 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880525 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:34:57.888044 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880527 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:34:57.888044 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880530 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:34:57.888044 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880532 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:34:57.888044 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880534 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:34:57.888496 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880537 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:34:57.888496 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880539 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:34:57.888496 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880542 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:34:57.888496 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880544 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:34:57.888496 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880546 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:34:57.888496 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880548 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:34:57.888496 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880551 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:34:57.888496 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880553 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:34:57.888496 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880556 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:34:57.888496 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880558 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:34:57.888496 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880560 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:34:57.888496 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880562 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:34:57.888496 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880565 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:34:57.888496 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880567 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:34:57.888496 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880569 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:34:57.888496 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880571 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:34:57.888496 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880574 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:34:57.888496 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880576 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:34:57.888496 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880578 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:34:57.888496 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880581 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:34:57.888963 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880583 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:34:57.888963 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880585 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:34:57.888963 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880587 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:34:57.888963 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880589 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:34:57.888963 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880591 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:34:57.888963 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880594 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:34:57.888963 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880596 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:34:57.888963 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880598 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:34:57.888963 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880600 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:34:57.888963 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880603 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:34:57.888963 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880605 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:34:57.888963 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880607 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:34:57.888963 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880611 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:34:57.888963 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880614 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:34:57.888963 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880617 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:34:57.888963 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880619 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:34:57.888963 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880622 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:34:57.888963 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880624 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:34:57.888963 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:57.880627 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:34:57.889494 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.880631 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 20:34:57.889494 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.880741 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 20:34:57.889494 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.882665 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 20:34:57.889494 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.883907 2562 server.go:1019] "Starting client certificate rotation" Jul 06 20:34:57.889494 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.884010 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 20:34:57.889494 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.884054 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 20:34:57.889494 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.886194 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 20:34:57.893243 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.893223 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 20:34:57.907352 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.907326 2562 log.go:25] "Validated CRI v1 runtime API" Jul 06 20:34:57.909197 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.909173 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 20:34:57.909434 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.909421 2562 log.go:25] "Validated CRI v1 image API" Jul 06 20:34:57.910247 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.910232 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 20:34:57.914620 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.914594 2562 fs.go:135] Filesystem UUIDs: map[2507e115-6b57-4fdd-aa59-13f8e15e19ed:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 fabb6418-28b3-44f4-ae1d-f2ed77b79faa:/dev/nvme0n1p3] Jul 06 20:34:57.914704 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.914620 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 20:34:57.919602 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.919485 2562 manager.go:216] Machine: {Timestamp:2026-07-06 20:34:57.918153029 +0000 UTC m=+0.335402447 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100116 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec272f2d8fea01fdd9d10236cc30e944 SystemUUID:ec272f2d-8fea-01fd-d9d1-0236cc30e944 BootID:af267e0f-a729-46c8-b275-f0be955405ff Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:79:aa:7a:9d:c3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:79:aa:7a:9d:c3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:fc:50:69:77:9b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 20:34:57.919602 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.919589 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 20:34:57.919745 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.919673 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 20:34:57.922598 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.922569 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 20:34:57.922736 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.922600 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-77.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 20:34:57.923294 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.923283 2562 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 20:34:57.923323 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.923296 2562 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 20:34:57.923323 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.923303 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 20:34:57.923918 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.923908 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 20:34:57.929313 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.929297 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 20:34:57.932465 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.932451 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 06 20:34:57.932597 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.932589 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 20:34:57.932624 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.932617 2562 kubelet.go:486] "Attempting to sync node with API server" Jul 06 20:34:57.932659 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.932626 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 20:34:57.932659 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.932641 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 20:34:57.932659 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.932650 2562 kubelet.go:398] "Adding apiserver pod source" Jul 06 20:34:57.932659 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.932658 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 20:34:57.933049 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.933032 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 20:34:57.933128 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.933056 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 20:34:57.933818 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.933793 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7ktmc" Jul 06 20:34:57.935527 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.935509 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 20:34:57.937401 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.937388 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 20:34:57.937455 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.937416 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 20:34:57.938491 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.938475 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 20:34:57.938573 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.938497 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 20:34:57.938573 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.938506 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 20:34:57.938573 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.938513 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 20:34:57.938573 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.938524 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 20:34:57.938573 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.938530 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 20:34:57.938573 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.938542 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 20:34:57.938573 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.938548 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 20:34:57.938573 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.938558 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 20:34:57.938573 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.938563 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 20:34:57.938573 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.938572 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 20:34:57.938573 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.938577 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 20:34:57.939328 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.939317 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 20:34:57.939328 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.939328 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 20:34:57.939425 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.939406 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7ktmc" Jul 06 20:34:57.942856 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.942834 2562 server.go:1268] "Started kubelet" Jul 06 20:34:57.943651 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.943497 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 20:34:57.943737 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.943689 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 20:34:57.943780 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.943756 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 20:34:57.943851 ip-10-0-142-77 systemd[1]: Started Kubernetes Kubelet. Jul 06 20:34:57.944954 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.944935 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 20:34:57.945192 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.945173 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-77.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 20:34:57.945393 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:57.945364 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 20:34:57.945492 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:57.945409 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-77.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 20:34:57.946271 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.946258 2562 server.go:310] "Adding debug handlers to kubelet server" Jul 06 20:34:57.950790 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:57.950763 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 20:34:57.951477 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.951464 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 20:34:57.951545 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.951479 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 20:34:57.951599 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:57.951542 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-77.ec2.internal\" not found" Jul 06 20:34:57.952033 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.952018 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 20:34:57.952115 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.952056 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 20:34:57.952115 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.952019 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 20:34:57.952224 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.952186 2562 reconstruct.go:97] "Volume reconstruction finished" Jul 06 20:34:57.952224 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.952196 2562 reconciler.go:29] "Reconciler: start to sync state" Jul 06 20:34:57.952533 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.952324 2562 factory.go:55] Registering systemd factory Jul 06 20:34:57.952533 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.952337 2562 factory.go:223] Registration of the systemd container factory successfully Jul 06 20:34:57.952731 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.952717 2562 factory.go:153] Registering CRI-O factory Jul 06 20:34:57.952785 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.952735 2562 factory.go:223] Registration of the crio container factory successfully Jul 06 20:34:57.952825 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.952790 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 20:34:57.952825 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.952810 2562 factory.go:103] Registering Raw factory Jul 06 20:34:57.952825 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.952823 2562 manager.go:1196] Started watching for new ooms in manager Jul 06 20:34:57.953269 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.953252 2562 manager.go:349] Starting recovery of all containers Jul 06 20:34:57.954005 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.953986 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:34:57.958894 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:57.958857 2562 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-77.ec2.internal\" not found" node="ip-10-0-142-77.ec2.internal" Jul 06 20:34:57.959267 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.959229 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 20:34:57.962715 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.962270 2562 manager.go:354] Recovery completed Jul 06 20:34:57.963646 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:57.963625 2562 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 06 20:34:57.966988 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.966974 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:34:57.969137 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.969117 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-77.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:34:57.969203 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.969155 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-77.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:34:57.969203 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.969167 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-77.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:34:57.969647 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.969633 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 20:34:57.969647 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.969642 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:34:57.969647 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.969646 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 20:34:57.969807 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.969663 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 06 20:34:57.970361 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.970348 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-77.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:34:57.970410 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.970382 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-77.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:34:57.970410 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.970393 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-77.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:34:57.970865 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.970856 2562 policy_none.go:49] "None policy: Start" Jul 06 20:34:57.970921 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.970886 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 20:34:57.970921 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.970897 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 20:34:57.971800 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:57.971786 2562 policy_none.go:47] "Start" Jul 06 20:34:58.017488 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.017468 2562 manager.go:337] "Starting Device Plugin manager" Jul 06 20:34:58.017624 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:58.017512 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 20:34:58.017624 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.017525 2562 server.go:87] "Starting device plugin registration server" Jul 06 20:34:58.017830 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.017818 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 20:34:58.017908 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.017831 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 20:34:58.017952 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.017915 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 20:34:58.018010 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.017998 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 20:34:58.018051 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.018010 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 20:34:58.018569 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:58.018550 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 20:34:58.018631 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:58.018595 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-77.ec2.internal\" not found" Jul 06 20:34:58.092320 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.092290 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 20:34:58.094285 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.092335 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 20:34:58.094285 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.092360 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 20:34:58.094285 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:58.092441 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 20:34:58.094786 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.094770 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:34:58.118791 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.118714 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:34:58.119653 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.119639 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-77.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:34:58.119699 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.119667 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-77.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:34:58.119699 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.119679 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-77.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:34:58.119761 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.119702 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-77.ec2.internal" Jul 06 20:34:58.134097 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.134076 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-77.ec2.internal" Jul 06 20:34:58.134162 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:58.134104 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-77.ec2.internal\": node \"ip-10-0-142-77.ec2.internal\" not found" Jul 06 20:34:58.158040 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:58.158014 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-77.ec2.internal\" not found" Jul 06 20:34:58.193083 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.193045 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-77.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-77.ec2.internal"] Jul 06 20:34:58.193163 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.193157 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:34:58.194445 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.194430 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-77.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:34:58.194529 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.194456 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-77.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:34:58.194529 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.194466 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-77.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:34:58.196498 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.196487 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:34:58.196598 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.196586 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-77.ec2.internal" Jul 06 20:34:58.196635 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.196627 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:34:58.197468 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.197449 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-77.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:34:58.197577 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.197478 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-77.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:34:58.197577 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.197486 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-77.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:34:58.197577 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.197496 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-77.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:34:58.197577 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.197506 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-77.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:34:58.197577 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.197516 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-77.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:34:58.199479 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.199465 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-77.ec2.internal" Jul 06 20:34:58.199541 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.199494 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:34:58.200339 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.200326 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-77.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:34:58.200403 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.200352 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-77.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:34:58.200403 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.200360 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-77.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:34:58.217535 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:58.217512 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-77.ec2.internal\" not found" node="ip-10-0-142-77.ec2.internal" Jul 06 20:34:58.220729 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:58.220712 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-77.ec2.internal\" not found" node="ip-10-0-142-77.ec2.internal" Jul 06 20:34:58.254974 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.254947 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/915ab3f22472460b3ca3a702c37324c2-config\") pod \"kube-apiserver-proxy-ip-10-0-142-77.ec2.internal\" (UID: \"915ab3f22472460b3ca3a702c37324c2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-77.ec2.internal" Jul 06 20:34:58.255118 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.254974 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f1d61fd9465d9eb2bf62db9797fd9225-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-77.ec2.internal\" (UID: \"f1d61fd9465d9eb2bf62db9797fd9225\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-77.ec2.internal" Jul 06 20:34:58.255118 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.255007 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1d61fd9465d9eb2bf62db9797fd9225-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-77.ec2.internal\" (UID: \"f1d61fd9465d9eb2bf62db9797fd9225\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-77.ec2.internal" Jul 06 20:34:58.259044 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:58.259018 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-77.ec2.internal\" not found" Jul 06 20:34:58.355235 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.355205 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1d61fd9465d9eb2bf62db9797fd9225-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-77.ec2.internal\" (UID: \"f1d61fd9465d9eb2bf62db9797fd9225\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-77.ec2.internal" Jul 06 20:34:58.355235 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.355238 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/915ab3f22472460b3ca3a702c37324c2-config\") pod \"kube-apiserver-proxy-ip-10-0-142-77.ec2.internal\" (UID: \"915ab3f22472460b3ca3a702c37324c2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-77.ec2.internal" Jul 06 20:34:58.355397 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.355259 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f1d61fd9465d9eb2bf62db9797fd9225-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-77.ec2.internal\" (UID: \"f1d61fd9465d9eb2bf62db9797fd9225\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-77.ec2.internal" Jul 06 20:34:58.355397 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.355302 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1d61fd9465d9eb2bf62db9797fd9225-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-77.ec2.internal\" (UID: \"f1d61fd9465d9eb2bf62db9797fd9225\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-77.ec2.internal" Jul 06 20:34:58.355397 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.355323 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/915ab3f22472460b3ca3a702c37324c2-config\") pod \"kube-apiserver-proxy-ip-10-0-142-77.ec2.internal\" (UID: \"915ab3f22472460b3ca3a702c37324c2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-77.ec2.internal" Jul 06 20:34:58.355397 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.355302 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f1d61fd9465d9eb2bf62db9797fd9225-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-77.ec2.internal\" (UID: \"f1d61fd9465d9eb2bf62db9797fd9225\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-77.ec2.internal" Jul 06 20:34:58.359288 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:58.359268 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-77.ec2.internal\" not found" Jul 06 20:34:58.459992 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:58.459924 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-77.ec2.internal\" not found" Jul 06 20:34:58.521105 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.521078 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-77.ec2.internal" Jul 06 20:34:58.524148 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.524130 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-77.ec2.internal" Jul 06 20:34:58.560920 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:58.560869 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-77.ec2.internal\" not found" Jul 06 20:34:58.661371 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:58.661332 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-77.ec2.internal\" not found" Jul 06 20:34:58.761775 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:58.761704 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-77.ec2.internal\" not found" Jul 06 20:34:58.862109 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:58.862070 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-77.ec2.internal\" not found" Jul 06 20:34:58.884241 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.884208 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 20:34:58.884993 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.884351 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 20:34:58.884993 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.884389 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 20:34:58.915631 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.915482 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:34:58.933399 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.933377 2562 apiserver.go:52] "Watching apiserver" Jul 06 20:34:58.942946 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.942919 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 20:34:58.943286 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.943264 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-n6892","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2t2g","openshift-dns/node-resolver-228pr","openshift-multus/multus-additional-cni-plugins-sppzx","openshift-network-diagnostics/network-check-target-gvkfp","openshift-network-operator/iptables-alerter-z62br","kube-system/global-pull-secret-syncer-4r7cf","openshift-cluster-node-tuning-operator/tuned-5x5qd","openshift-image-registry/node-ca-9627c","openshift-multus/multus-n5z72","openshift-multus/network-metrics-daemon-mjfls","openshift-ovn-kubernetes/ovnkube-node-82n9w"] Jul 06 20:34:58.944265 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.944224 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 20:29:57 +0000 UTC" deadline="2027-12-12 19:25:50.459513285 +0000 UTC" Jul 06 20:34:58.944265 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.944265 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12574h50m51.515253171s" Jul 06 20:34:58.945707 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.945677 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2t2g" Jul 06 20:34:58.947699 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.947677 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-228pr" Jul 06 20:34:58.948920 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.948903 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 20:34:58.948998 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.948903 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 20:34:58.949303 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.949289 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 20:34:58.949712 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.949687 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rxvf9\"" Jul 06 20:34:58.949963 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.949943 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sppzx" Jul 06 20:34:58.950680 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.950189 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 20:34:58.951072 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.950782 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bgbdp\"" Jul 06 20:34:58.952116 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.951841 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 20:34:58.952116 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.952057 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-77.ec2.internal" Jul 06 20:34:58.952989 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.952971 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkfp" Jul 06 20:34:58.953091 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:58.953053 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkfp" podUID="3e34520c-432d-4ad4-a08a-3bcf6b082abc" Jul 06 20:34:58.955464 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.955444 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z62br" Jul 06 20:34:58.957461 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.957439 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:58.958741 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.958721 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/114fe0eb-e34e-4ae2-800c-abcb04f50f4a-system-cni-dir\") pod \"multus-additional-cni-plugins-sppzx\" (UID: \"114fe0eb-e34e-4ae2-800c-abcb04f50f4a\") " pod="openshift-multus/multus-additional-cni-plugins-sppzx" Jul 06 20:34:58.958823 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.958754 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/114fe0eb-e34e-4ae2-800c-abcb04f50f4a-cni-binary-copy\") pod \"multus-additional-cni-plugins-sppzx\" (UID: \"114fe0eb-e34e-4ae2-800c-abcb04f50f4a\") " pod="openshift-multus/multus-additional-cni-plugins-sppzx" Jul 06 20:34:58.958823 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.958779 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/114fe0eb-e34e-4ae2-800c-abcb04f50f4a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sppzx\" (UID: \"114fe0eb-e34e-4ae2-800c-abcb04f50f4a\") " pod="openshift-multus/multus-additional-cni-plugins-sppzx" Jul 06 20:34:58.958823 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.958807 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5a34e310-83ec-46bd-ad39-3378c8387322-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q2t2g\" (UID: \"5a34e310-83ec-46bd-ad39-3378c8387322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2t2g" Jul 06 20:34:58.958979 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.958848 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5a34e310-83ec-46bd-ad39-3378c8387322-device-dir\") pod \"aws-ebs-csi-driver-node-q2t2g\" (UID: \"5a34e310-83ec-46bd-ad39-3378c8387322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2t2g" Jul 06 20:34:58.958979 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.958867 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jcq6\" (UniqueName: \"kubernetes.io/projected/37d7b196-af22-4df9-bb34-5b739bc05578-kube-api-access-6jcq6\") pod \"node-resolver-228pr\" (UID: \"37d7b196-af22-4df9-bb34-5b739bc05578\") " pod="openshift-dns/node-resolver-228pr" Jul 06 20:34:58.958979 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.958919 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt8xk\" (UniqueName: \"kubernetes.io/projected/114fe0eb-e34e-4ae2-800c-abcb04f50f4a-kube-api-access-gt8xk\") pod \"multus-additional-cni-plugins-sppzx\" (UID: \"114fe0eb-e34e-4ae2-800c-abcb04f50f4a\") " pod="openshift-multus/multus-additional-cni-plugins-sppzx" Jul 06 20:34:58.958979 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.958947 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng2r9\" (UniqueName: \"kubernetes.io/projected/3e34520c-432d-4ad4-a08a-3bcf6b082abc-kube-api-access-ng2r9\") pod \"network-check-target-gvkfp\" (UID: \"3e34520c-432d-4ad4-a08a-3bcf6b082abc\") " pod="openshift-network-diagnostics/network-check-target-gvkfp" Jul 06 20:34:58.958979 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.958973 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4s98\" (UniqueName: \"kubernetes.io/projected/5a34e310-83ec-46bd-ad39-3378c8387322-kube-api-access-k4s98\") pod \"aws-ebs-csi-driver-node-q2t2g\" (UID: \"5a34e310-83ec-46bd-ad39-3378c8387322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2t2g" Jul 06 20:34:58.959109 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.958991 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/37d7b196-af22-4df9-bb34-5b739bc05578-hosts-file\") pod \"node-resolver-228pr\" (UID: \"37d7b196-af22-4df9-bb34-5b739bc05578\") " pod="openshift-dns/node-resolver-228pr" Jul 06 20:34:58.959109 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.959010 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/114fe0eb-e34e-4ae2-800c-abcb04f50f4a-os-release\") pod \"multus-additional-cni-plugins-sppzx\" (UID: \"114fe0eb-e34e-4ae2-800c-abcb04f50f4a\") " pod="openshift-multus/multus-additional-cni-plugins-sppzx" Jul 06 20:34:58.959109 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.959034 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/114fe0eb-e34e-4ae2-800c-abcb04f50f4a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sppzx\" (UID: \"114fe0eb-e34e-4ae2-800c-abcb04f50f4a\") " pod="openshift-multus/multus-additional-cni-plugins-sppzx" Jul 06 20:34:58.959109 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.959052 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/114fe0eb-e34e-4ae2-800c-abcb04f50f4a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sppzx\" (UID: \"114fe0eb-e34e-4ae2-800c-abcb04f50f4a\") " pod="openshift-multus/multus-additional-cni-plugins-sppzx" Jul 06 20:34:58.959109 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.959095 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5a34e310-83ec-46bd-ad39-3378c8387322-registration-dir\") pod \"aws-ebs-csi-driver-node-q2t2g\" (UID: \"5a34e310-83ec-46bd-ad39-3378c8387322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2t2g" Jul 06 20:34:58.959237 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.959115 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5a34e310-83ec-46bd-ad39-3378c8387322-sys-fs\") pod \"aws-ebs-csi-driver-node-q2t2g\" (UID: \"5a34e310-83ec-46bd-ad39-3378c8387322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2t2g" Jul 06 20:34:58.959237 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.959135 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/114fe0eb-e34e-4ae2-800c-abcb04f50f4a-cnibin\") pod \"multus-additional-cni-plugins-sppzx\" (UID: \"114fe0eb-e34e-4ae2-800c-abcb04f50f4a\") " pod="openshift-multus/multus-additional-cni-plugins-sppzx" Jul 06 20:34:58.959237 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.959161 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5a34e310-83ec-46bd-ad39-3378c8387322-socket-dir\") pod \"aws-ebs-csi-driver-node-q2t2g\" (UID: \"5a34e310-83ec-46bd-ad39-3378c8387322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2t2g" Jul 06 20:34:58.959237 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.959177 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5a34e310-83ec-46bd-ad39-3378c8387322-etc-selinux\") pod \"aws-ebs-csi-driver-node-q2t2g\" (UID: \"5a34e310-83ec-46bd-ad39-3378c8387322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2t2g" Jul 06 20:34:58.959237 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.959196 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37d7b196-af22-4df9-bb34-5b739bc05578-tmp-dir\") pod \"node-resolver-228pr\" (UID: \"37d7b196-af22-4df9-bb34-5b739bc05578\") " pod="openshift-dns/node-resolver-228pr" Jul 06 20:34:58.959463 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.959405 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 20:34:58.959568 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.959552 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n5z72" Jul 06 20:34:58.959913 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.959896 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:34:58.960038 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.960026 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 20:34:58.960092 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.960040 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 20:34:58.961042 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.961023 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-47pwf\"" Jul 06 20:34:58.961128 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.961045 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 20:34:58.961250 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.961236 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dphrb\"" Jul 06 20:34:58.961638 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.961622 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:34:58.962306 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.962211 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 20:34:58.962838 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.962821 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mx9gf\"" Jul 06 20:34:58.963056 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.963036 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 20:34:58.963179 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.963153 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:58.964862 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.964841 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-n6892" Jul 06 20:34:58.967048 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.967031 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r7cf" Jul 06 20:34:58.967116 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:58.967095 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r7cf" podUID="872de884-2edf-4de9-8ad6-2bc963363808" Jul 06 20:34:58.969062 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.969049 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9627c" Jul 06 20:34:58.971112 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.971090 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjfls" Jul 06 20:34:58.971197 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:58.971147 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mjfls" podUID="b5620d06-ce9a-457c-8636-a60ad8234202" Jul 06 20:34:58.980431 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.980382 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 20:34:58.980635 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.980605 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-77.ec2.internal"] Jul 06 20:34:58.980931 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.980895 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 20:34:58.981070 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.980945 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 20:34:58.981070 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.980976 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 20:34:58.981070 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.981010 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-77.ec2.internal" Jul 06 20:34:58.981196 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.981110 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 20:34:58.987574 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.987557 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 20:34:58.987574 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.987569 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7l8k6\"" Jul 06 20:34:58.987720 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.987601 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 20:34:58.987720 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.987574 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-66qlw\"" Jul 06 20:34:58.987720 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.987584 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 20:34:58.987971 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.987945 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 20:34:58.988287 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.988269 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 20:34:58.988378 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.988301 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 20:34:58.988378 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.988331 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-h9vkc\"" Jul 06 20:34:58.988378 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.988366 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 20:34:58.988475 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.988461 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 20:34:58.988509 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.988490 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 20:34:58.988834 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.988819 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-588jl\"" Jul 06 20:34:58.997821 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.997795 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 20:34:58.998051 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:58.998027 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 20:34:59.002471 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.002456 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 20:34:59.003283 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.003270 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 20:34:59.003355 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.003342 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-77.ec2.internal"] Jul 06 20:34:59.016708 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.016689 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-g7rbs" Jul 06 20:34:59.027666 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.027643 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-g7rbs" Jul 06 20:34:59.053073 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.053053 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 20:34:59.056028 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:59.055987 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod915ab3f22472460b3ca3a702c37324c2.slice/crio-625cc5eea4c824fe247e1f94193e8198b98724bf1df1be90a924557c59189c58 WatchSource:0}: Error finding container 625cc5eea4c824fe247e1f94193e8198b98724bf1df1be90a924557c59189c58: Status 404 returned error can't find the container with id 625cc5eea4c824fe247e1f94193e8198b98724bf1df1be90a924557c59189c58 Jul 06 20:34:59.056579 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:59.056554 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1d61fd9465d9eb2bf62db9797fd9225.slice/crio-60b6389daf0b125587db8c9a83614c089348142bcce816421279074732cc97ff WatchSource:0}: Error finding container 60b6389daf0b125587db8c9a83614c089348142bcce816421279074732cc97ff: Status 404 returned error can't find the container with id 60b6389daf0b125587db8c9a83614c089348142bcce816421279074732cc97ff Jul 06 20:34:59.059396 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.059372 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5a34e310-83ec-46bd-ad39-3378c8387322-registration-dir\") pod \"aws-ebs-csi-driver-node-q2t2g\" (UID: \"5a34e310-83ec-46bd-ad39-3378c8387322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2t2g" Jul 06 20:34:59.059491 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.059408 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5a34e310-83ec-46bd-ad39-3378c8387322-sys-fs\") pod \"aws-ebs-csi-driver-node-q2t2g\" (UID: \"5a34e310-83ec-46bd-ad39-3378c8387322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2t2g" Jul 06 20:34:59.059491 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.059436 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-log-socket\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.059491 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.059458 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-etc-kubernetes\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.059617 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.059490 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5a34e310-83ec-46bd-ad39-3378c8387322-registration-dir\") pod \"aws-ebs-csi-driver-node-q2t2g\" (UID: \"5a34e310-83ec-46bd-ad39-3378c8387322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2t2g" Jul 06 20:34:59.059617 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.059505 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-etc-sysctl-d\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.059617 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.059512 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5a34e310-83ec-46bd-ad39-3378c8387322-sys-fs\") pod \"aws-ebs-csi-driver-node-q2t2g\" (UID: \"5a34e310-83ec-46bd-ad39-3378c8387322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2t2g" Jul 06 20:34:59.059617 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.059546 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-run\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.059617 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.059572 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/114fe0eb-e34e-4ae2-800c-abcb04f50f4a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sppzx\" (UID: \"114fe0eb-e34e-4ae2-800c-abcb04f50f4a\") " pod="openshift-multus/multus-additional-cni-plugins-sppzx" Jul 06 20:34:59.059617 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.059596 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jcq6\" (UniqueName: \"kubernetes.io/projected/37d7b196-af22-4df9-bb34-5b739bc05578-kube-api-access-6jcq6\") pod \"node-resolver-228pr\" (UID: \"37d7b196-af22-4df9-bb34-5b739bc05578\") " pod="openshift-dns/node-resolver-228pr" Jul 06 20:34:59.059947 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.059619 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-system-cni-dir\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.059947 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.059638 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-multus-cni-dir\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.059947 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.059659 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-host-run-ovn-kubernetes\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.059947 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.059682 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txq9d\" (UniqueName: \"kubernetes.io/projected/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-kube-api-access-txq9d\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.059947 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.059701 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-os-release\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.059947 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.059757 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4vxj\" (UniqueName: \"kubernetes.io/projected/8a5908e1-fa67-40c3-929a-e9e667d92ee8-kube-api-access-l4vxj\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.059947 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.059798 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/872de884-2edf-4de9-8ad6-2bc963363808-original-pull-secret\") pod \"global-pull-secret-syncer-4r7cf\" (UID: \"872de884-2edf-4de9-8ad6-2bc963363808\") " pod="kube-system/global-pull-secret-syncer-4r7cf" Jul 06 20:34:59.059947 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.059824 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/482c8ffc-6942-4433-988b-71ab836d0c4a-serviceca\") pod \"node-ca-9627c\" (UID: \"482c8ffc-6942-4433-988b-71ab836d0c4a\") " pod="openshift-image-registry/node-ca-9627c" Jul 06 20:34:59.059947 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.059847 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-host-cni-bin\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.059947 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.059890 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/691b55fa-75bc-4b9a-9e24-2df1c444470f-agent-certs\") pod \"konnectivity-agent-n6892\" (UID: \"691b55fa-75bc-4b9a-9e24-2df1c444470f\") " pod="kube-system/konnectivity-agent-n6892" Jul 06 20:34:59.059947 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.059911 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/482c8ffc-6942-4433-988b-71ab836d0c4a-host\") pod \"node-ca-9627c\" (UID: \"482c8ffc-6942-4433-988b-71ab836d0c4a\") " pod="openshift-image-registry/node-ca-9627c" Jul 06 20:34:59.059947 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.059937 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/114fe0eb-e34e-4ae2-800c-abcb04f50f4a-system-cni-dir\") pod \"multus-additional-cni-plugins-sppzx\" (UID: \"114fe0eb-e34e-4ae2-800c-abcb04f50f4a\") " pod="openshift-multus/multus-additional-cni-plugins-sppzx" Jul 06 20:34:59.060644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.059957 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-multus-conf-dir\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.060644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.059992 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/114fe0eb-e34e-4ae2-800c-abcb04f50f4a-system-cni-dir\") pod \"multus-additional-cni-plugins-sppzx\" (UID: \"114fe0eb-e34e-4ae2-800c-abcb04f50f4a\") " pod="openshift-multus/multus-additional-cni-plugins-sppzx" Jul 06 20:34:59.060644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060025 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e0965b1c-953a-4b3d-8ede-9bd21cdba301-host-slash\") pod \"iptables-alerter-z62br\" (UID: \"e0965b1c-953a-4b3d-8ede-9bd21cdba301\") " pod="openshift-network-operator/iptables-alerter-z62br" Jul 06 20:34:59.060644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060044 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-run-ovn\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.060644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060066 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5a34e310-83ec-46bd-ad39-3378c8387322-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q2t2g\" (UID: \"5a34e310-83ec-46bd-ad39-3378c8387322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2t2g" Jul 06 20:34:59.060644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060081 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5a34e310-83ec-46bd-ad39-3378c8387322-device-dir\") pod \"aws-ebs-csi-driver-node-q2t2g\" (UID: \"5a34e310-83ec-46bd-ad39-3378c8387322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2t2g" Jul 06 20:34:59.060644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060098 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng2r9\" (UniqueName: \"kubernetes.io/projected/3e34520c-432d-4ad4-a08a-3bcf6b082abc-kube-api-access-ng2r9\") pod \"network-check-target-gvkfp\" (UID: \"3e34520c-432d-4ad4-a08a-3bcf6b082abc\") " pod="openshift-network-diagnostics/network-check-target-gvkfp" Jul 06 20:34:59.060644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060121 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-host-var-lib-cni-bin\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.060644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060156 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-host-slash\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.060644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060162 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5a34e310-83ec-46bd-ad39-3378c8387322-device-dir\") pod \"aws-ebs-csi-driver-node-q2t2g\" (UID: \"5a34e310-83ec-46bd-ad39-3378c8387322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2t2g" Jul 06 20:34:59.060644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060177 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1dedccb7-cae9-4846-9304-7abe0812a0a2-ovn-node-metrics-cert\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.060644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060201 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-tmp\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.060644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060214 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5a34e310-83ec-46bd-ad39-3378c8387322-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q2t2g\" (UID: \"5a34e310-83ec-46bd-ad39-3378c8387322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2t2g" Jul 06 20:34:59.060644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060224 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/114fe0eb-e34e-4ae2-800c-abcb04f50f4a-os-release\") pod \"multus-additional-cni-plugins-sppzx\" (UID: \"114fe0eb-e34e-4ae2-800c-abcb04f50f4a\") " pod="openshift-multus/multus-additional-cni-plugins-sppzx" Jul 06 20:34:59.060644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060240 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/114fe0eb-e34e-4ae2-800c-abcb04f50f4a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sppzx\" (UID: \"114fe0eb-e34e-4ae2-800c-abcb04f50f4a\") " pod="openshift-multus/multus-additional-cni-plugins-sppzx" Jul 06 20:34:59.060644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060255 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-systemd-units\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.060644 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060315 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/114fe0eb-e34e-4ae2-800c-abcb04f50f4a-os-release\") pod \"multus-additional-cni-plugins-sppzx\" (UID: \"114fe0eb-e34e-4ae2-800c-abcb04f50f4a\") " pod="openshift-multus/multus-additional-cni-plugins-sppzx" Jul 06 20:34:59.061377 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060353 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4vpt\" (UniqueName: \"kubernetes.io/projected/b5620d06-ce9a-457c-8636-a60ad8234202-kube-api-access-z4vpt\") pod \"network-metrics-daemon-mjfls\" (UID: \"b5620d06-ce9a-457c-8636-a60ad8234202\") " pod="openshift-multus/network-metrics-daemon-mjfls" Jul 06 20:34:59.061377 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060379 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-etc-systemd\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.061377 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060404 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/114fe0eb-e34e-4ae2-800c-abcb04f50f4a-cnibin\") pod \"multus-additional-cni-plugins-sppzx\" (UID: \"114fe0eb-e34e-4ae2-800c-abcb04f50f4a\") " pod="openshift-multus/multus-additional-cni-plugins-sppzx" Jul 06 20:34:59.061377 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060416 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 20:34:59.061377 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060432 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-multus-socket-dir-parent\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.061377 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060455 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-host-run-netns\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.061377 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060476 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-etc-kubernetes\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.061377 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060477 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/114fe0eb-e34e-4ae2-800c-abcb04f50f4a-cnibin\") pod \"multus-additional-cni-plugins-sppzx\" (UID: \"114fe0eb-e34e-4ae2-800c-abcb04f50f4a\") " pod="openshift-multus/multus-additional-cni-plugins-sppzx" Jul 06 20:34:59.061377 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060502 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-host-run-netns\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.061377 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060533 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-node-log\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.061377 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060566 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37d7b196-af22-4df9-bb34-5b739bc05578-tmp-dir\") pod \"node-resolver-228pr\" (UID: \"37d7b196-af22-4df9-bb34-5b739bc05578\") " pod="openshift-dns/node-resolver-228pr" Jul 06 20:34:59.061377 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060613 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/114fe0eb-e34e-4ae2-800c-abcb04f50f4a-cni-binary-copy\") pod \"multus-additional-cni-plugins-sppzx\" (UID: \"114fe0eb-e34e-4ae2-800c-abcb04f50f4a\") " pod="openshift-multus/multus-additional-cni-plugins-sppzx" Jul 06 20:34:59.061377 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060631 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/114fe0eb-e34e-4ae2-800c-abcb04f50f4a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sppzx\" (UID: \"114fe0eb-e34e-4ae2-800c-abcb04f50f4a\") " pod="openshift-multus/multus-additional-cni-plugins-sppzx" Jul 06 20:34:59.061377 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060638 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/872de884-2edf-4de9-8ad6-2bc963363808-dbus\") pod \"global-pull-secret-syncer-4r7cf\" (UID: \"872de884-2edf-4de9-8ad6-2bc963363808\") " pod="kube-system/global-pull-secret-syncer-4r7cf" Jul 06 20:34:59.061377 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060719 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1dedccb7-cae9-4846-9304-7abe0812a0a2-env-overrides\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.061377 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060742 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-etc-tuned\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.061377 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060762 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-host-run-k8s-cni-cncf-io\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.062107 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060784 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8a5908e1-fa67-40c3-929a-e9e667d92ee8-multus-daemon-config\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.062107 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060806 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmg9l\" (UniqueName: \"kubernetes.io/projected/482c8ffc-6942-4433-988b-71ab836d0c4a-kube-api-access-jmg9l\") pod \"node-ca-9627c\" (UID: \"482c8ffc-6942-4433-988b-71ab836d0c4a\") " pod="openshift-image-registry/node-ca-9627c" Jul 06 20:34:59.062107 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060839 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e0965b1c-953a-4b3d-8ede-9bd21cdba301-iptables-alerter-script\") pod \"iptables-alerter-z62br\" (UID: \"e0965b1c-953a-4b3d-8ede-9bd21cdba301\") " pod="openshift-network-operator/iptables-alerter-z62br" Jul 06 20:34:59.062107 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060858 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37d7b196-af22-4df9-bb34-5b739bc05578-tmp-dir\") pod \"node-resolver-228pr\" (UID: \"37d7b196-af22-4df9-bb34-5b739bc05578\") " pod="openshift-dns/node-resolver-228pr" Jul 06 20:34:59.062107 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.060963 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/114fe0eb-e34e-4ae2-800c-abcb04f50f4a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sppzx\" (UID: \"114fe0eb-e34e-4ae2-800c-abcb04f50f4a\") " pod="openshift-multus/multus-additional-cni-plugins-sppzx" Jul 06 20:34:59.062107 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061002 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-host-kubelet\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.062107 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061091 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-run-systemd\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.062107 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061113 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/114fe0eb-e34e-4ae2-800c-abcb04f50f4a-cni-binary-copy\") pod \"multus-additional-cni-plugins-sppzx\" (UID: \"114fe0eb-e34e-4ae2-800c-abcb04f50f4a\") " pod="openshift-multus/multus-additional-cni-plugins-sppzx" Jul 06 20:34:59.062107 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061118 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-etc-sysconfig\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.062107 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061141 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-sys\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.062107 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061168 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4s98\" (UniqueName: \"kubernetes.io/projected/5a34e310-83ec-46bd-ad39-3378c8387322-kube-api-access-k4s98\") pod \"aws-ebs-csi-driver-node-q2t2g\" (UID: \"5a34e310-83ec-46bd-ad39-3378c8387322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2t2g" Jul 06 20:34:59.062107 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061190 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/37d7b196-af22-4df9-bb34-5b739bc05578-hosts-file\") pod \"node-resolver-228pr\" (UID: \"37d7b196-af22-4df9-bb34-5b739bc05578\") " pod="openshift-dns/node-resolver-228pr" Jul 06 20:34:59.062107 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061211 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-cnibin\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.062107 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061232 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-hostroot\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.062107 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061253 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/872de884-2edf-4de9-8ad6-2bc963363808-kubelet-config\") pod \"global-pull-secret-syncer-4r7cf\" (UID: \"872de884-2edf-4de9-8ad6-2bc963363808\") " pod="kube-system/global-pull-secret-syncer-4r7cf" Jul 06 20:34:59.062107 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061270 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/37d7b196-af22-4df9-bb34-5b739bc05578-hosts-file\") pod \"node-resolver-228pr\" (UID: \"37d7b196-af22-4df9-bb34-5b739bc05578\") " pod="openshift-dns/node-resolver-228pr" Jul 06 20:34:59.062107 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061284 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jddhj\" (UniqueName: \"kubernetes.io/projected/e0965b1c-953a-4b3d-8ede-9bd21cdba301-kube-api-access-jddhj\") pod \"iptables-alerter-z62br\" (UID: \"e0965b1c-953a-4b3d-8ede-9bd21cdba301\") " pod="openshift-network-operator/iptables-alerter-z62br" Jul 06 20:34:59.062968 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061309 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-run-openvswitch\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.062968 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061330 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1dedccb7-cae9-4846-9304-7abe0812a0a2-ovnkube-config\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.062968 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061356 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a5908e1-fa67-40c3-929a-e9e667d92ee8-cni-binary-copy\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.062968 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061377 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-host-var-lib-cni-multus\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.062968 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061413 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-host-run-multus-certs\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.062968 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061436 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1dedccb7-cae9-4846-9304-7abe0812a0a2-ovnkube-script-lib\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.062968 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061458 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-host\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.062968 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061502 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5a34e310-83ec-46bd-ad39-3378c8387322-socket-dir\") pod \"aws-ebs-csi-driver-node-q2t2g\" (UID: \"5a34e310-83ec-46bd-ad39-3378c8387322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2t2g" Jul 06 20:34:59.062968 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061525 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5a34e310-83ec-46bd-ad39-3378c8387322-etc-selinux\") pod \"aws-ebs-csi-driver-node-q2t2g\" (UID: \"5a34e310-83ec-46bd-ad39-3378c8387322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2t2g" Jul 06 20:34:59.062968 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061549 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt8xk\" (UniqueName: \"kubernetes.io/projected/114fe0eb-e34e-4ae2-800c-abcb04f50f4a-kube-api-access-gt8xk\") pod \"multus-additional-cni-plugins-sppzx\" (UID: \"114fe0eb-e34e-4ae2-800c-abcb04f50f4a\") " pod="openshift-multus/multus-additional-cni-plugins-sppzx" Jul 06 20:34:59.062968 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061569 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-host-var-lib-kubelet\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.062968 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061597 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-var-lib-openvswitch\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.062968 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061604 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5a34e310-83ec-46bd-ad39-3378c8387322-etc-selinux\") pod \"aws-ebs-csi-driver-node-q2t2g\" (UID: \"5a34e310-83ec-46bd-ad39-3378c8387322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2t2g" Jul 06 20:34:59.062968 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061611 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5a34e310-83ec-46bd-ad39-3378c8387322-socket-dir\") pod \"aws-ebs-csi-driver-node-q2t2g\" (UID: \"5a34e310-83ec-46bd-ad39-3378c8387322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2t2g" Jul 06 20:34:59.062968 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061696 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-etc-openvswitch\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.062968 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061712 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-host-cni-netd\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.063486 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061725 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-etc-modprobe-d\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.063486 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061742 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-etc-sysctl-conf\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.063486 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061763 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-lib-modules\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.063486 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061787 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/114fe0eb-e34e-4ae2-800c-abcb04f50f4a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sppzx\" (UID: \"114fe0eb-e34e-4ae2-800c-abcb04f50f4a\") " pod="openshift-multus/multus-additional-cni-plugins-sppzx" Jul 06 20:34:59.063486 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061831 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.063486 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061859 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft6sp\" (UniqueName: \"kubernetes.io/projected/1dedccb7-cae9-4846-9304-7abe0812a0a2-kube-api-access-ft6sp\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.063486 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061901 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/691b55fa-75bc-4b9a-9e24-2df1c444470f-konnectivity-ca\") pod \"konnectivity-agent-n6892\" (UID: \"691b55fa-75bc-4b9a-9e24-2df1c444470f\") " pod="kube-system/konnectivity-agent-n6892" Jul 06 20:34:59.063486 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061945 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5620d06-ce9a-457c-8636-a60ad8234202-metrics-certs\") pod \"network-metrics-daemon-mjfls\" (UID: \"b5620d06-ce9a-457c-8636-a60ad8234202\") " pod="openshift-multus/network-metrics-daemon-mjfls" Jul 06 20:34:59.063486 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.061968 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-var-lib-kubelet\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.063486 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.062011 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/114fe0eb-e34e-4ae2-800c-abcb04f50f4a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sppzx\" (UID: \"114fe0eb-e34e-4ae2-800c-abcb04f50f4a\") " pod="openshift-multus/multus-additional-cni-plugins-sppzx" Jul 06 20:34:59.076415 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:59.076393 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:34:59.076415 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:59.076417 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:34:59.076551 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:59.076429 2562 projected.go:196] Error preparing data for projected volume kube-api-access-ng2r9 for pod openshift-network-diagnostics/network-check-target-gvkfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:34:59.076551 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:59.076504 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e34520c-432d-4ad4-a08a-3bcf6b082abc-kube-api-access-ng2r9 podName:3e34520c-432d-4ad4-a08a-3bcf6b082abc nodeName:}" failed. No retries permitted until 2026-07-06 20:34:59.576484228 +0000 UTC m=+1.993733632 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ng2r9" (UniqueName: "kubernetes.io/projected/3e34520c-432d-4ad4-a08a-3bcf6b082abc-kube-api-access-ng2r9") pod "network-check-target-gvkfp" (UID: "3e34520c-432d-4ad4-a08a-3bcf6b082abc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:34:59.076636 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.076623 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 20:34:59.079444 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.079421 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jcq6\" (UniqueName: \"kubernetes.io/projected/37d7b196-af22-4df9-bb34-5b739bc05578-kube-api-access-6jcq6\") pod \"node-resolver-228pr\" (UID: \"37d7b196-af22-4df9-bb34-5b739bc05578\") " pod="openshift-dns/node-resolver-228pr" Jul 06 20:34:59.081704 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.081686 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4s98\" (UniqueName: \"kubernetes.io/projected/5a34e310-83ec-46bd-ad39-3378c8387322-kube-api-access-k4s98\") pod \"aws-ebs-csi-driver-node-q2t2g\" (UID: \"5a34e310-83ec-46bd-ad39-3378c8387322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2t2g" Jul 06 20:34:59.082988 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.082972 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt8xk\" (UniqueName: \"kubernetes.io/projected/114fe0eb-e34e-4ae2-800c-abcb04f50f4a-kube-api-access-gt8xk\") pod \"multus-additional-cni-plugins-sppzx\" (UID: \"114fe0eb-e34e-4ae2-800c-abcb04f50f4a\") " pod="openshift-multus/multus-additional-cni-plugins-sppzx" Jul 06 20:34:59.095522 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.095471 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-77.ec2.internal" event={"ID":"915ab3f22472460b3ca3a702c37324c2","Type":"ContainerStarted","Data":"625cc5eea4c824fe247e1f94193e8198b98724bf1df1be90a924557c59189c58"} Jul 06 20:34:59.096534 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.096507 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-77.ec2.internal" event={"ID":"f1d61fd9465d9eb2bf62db9797fd9225","Type":"ContainerStarted","Data":"60b6389daf0b125587db8c9a83614c089348142bcce816421279074732cc97ff"} Jul 06 20:34:59.162917 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.162850 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-lib-modules\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.162917 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.162915 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.163151 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.162944 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft6sp\" (UniqueName: \"kubernetes.io/projected/1dedccb7-cae9-4846-9304-7abe0812a0a2-kube-api-access-ft6sp\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.163151 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.162968 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/691b55fa-75bc-4b9a-9e24-2df1c444470f-konnectivity-ca\") pod \"konnectivity-agent-n6892\" (UID: \"691b55fa-75bc-4b9a-9e24-2df1c444470f\") " pod="kube-system/konnectivity-agent-n6892" Jul 06 20:34:59.163151 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.162981 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5620d06-ce9a-457c-8636-a60ad8234202-metrics-certs\") pod \"network-metrics-daemon-mjfls\" (UID: \"b5620d06-ce9a-457c-8636-a60ad8234202\") " pod="openshift-multus/network-metrics-daemon-mjfls" Jul 06 20:34:59.163151 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.162997 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-var-lib-kubelet\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.163151 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163010 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-log-socket\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.163151 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163042 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-etc-kubernetes\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.163151 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163015 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-lib-modules\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.163151 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163059 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-log-socket\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.163151 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163072 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-var-lib-kubelet\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.163151 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163014 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.163151 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163137 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-etc-kubernetes\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.163151 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:59.163142 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:34:59.163596 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163200 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-etc-sysctl-d\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.163596 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163238 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-run\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.163596 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:59.163273 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5620d06-ce9a-457c-8636-a60ad8234202-metrics-certs podName:b5620d06-ce9a-457c-8636-a60ad8234202 nodeName:}" failed. No retries permitted until 2026-07-06 20:34:59.663239362 +0000 UTC m=+2.080488771 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5620d06-ce9a-457c-8636-a60ad8234202-metrics-certs") pod "network-metrics-daemon-mjfls" (UID: "b5620d06-ce9a-457c-8636-a60ad8234202") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:34:59.163596 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163292 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-run\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.163596 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163308 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-system-cni-dir\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.163596 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163326 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-multus-cni-dir\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.163596 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163333 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-etc-sysctl-d\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.163596 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163350 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-host-run-ovn-kubernetes\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.163596 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163365 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-system-cni-dir\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.163596 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163379 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txq9d\" (UniqueName: \"kubernetes.io/projected/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-kube-api-access-txq9d\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.163596 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163397 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-multus-cni-dir\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.163596 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163407 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-host-run-ovn-kubernetes\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.163596 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163412 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-os-release\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.163596 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163447 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4vxj\" (UniqueName: \"kubernetes.io/projected/8a5908e1-fa67-40c3-929a-e9e667d92ee8-kube-api-access-l4vxj\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.163596 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163467 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-os-release\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.163596 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163472 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/872de884-2edf-4de9-8ad6-2bc963363808-original-pull-secret\") pod \"global-pull-secret-syncer-4r7cf\" (UID: \"872de884-2edf-4de9-8ad6-2bc963363808\") " pod="kube-system/global-pull-secret-syncer-4r7cf" Jul 06 20:34:59.163596 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163493 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/482c8ffc-6942-4433-988b-71ab836d0c4a-serviceca\") pod \"node-ca-9627c\" (UID: \"482c8ffc-6942-4433-988b-71ab836d0c4a\") " pod="openshift-image-registry/node-ca-9627c" Jul 06 20:34:59.164309 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163506 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/691b55fa-75bc-4b9a-9e24-2df1c444470f-konnectivity-ca\") pod \"konnectivity-agent-n6892\" (UID: \"691b55fa-75bc-4b9a-9e24-2df1c444470f\") " pod="kube-system/konnectivity-agent-n6892" Jul 06 20:34:59.164309 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163512 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-host-cni-bin\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.164309 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163553 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/691b55fa-75bc-4b9a-9e24-2df1c444470f-agent-certs\") pod \"konnectivity-agent-n6892\" (UID: \"691b55fa-75bc-4b9a-9e24-2df1c444470f\") " pod="kube-system/konnectivity-agent-n6892" Jul 06 20:34:59.164309 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163587 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/482c8ffc-6942-4433-988b-71ab836d0c4a-host\") pod \"node-ca-9627c\" (UID: \"482c8ffc-6942-4433-988b-71ab836d0c4a\") " pod="openshift-image-registry/node-ca-9627c" Jul 06 20:34:59.164309 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:59.163590 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:34:59.164309 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163628 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/482c8ffc-6942-4433-988b-71ab836d0c4a-host\") pod \"node-ca-9627c\" (UID: \"482c8ffc-6942-4433-988b-71ab836d0c4a\") " pod="openshift-image-registry/node-ca-9627c" Jul 06 20:34:59.164309 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:59.163640 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872de884-2edf-4de9-8ad6-2bc963363808-original-pull-secret podName:872de884-2edf-4de9-8ad6-2bc963363808 nodeName:}" failed. No retries permitted until 2026-07-06 20:34:59.66362723 +0000 UTC m=+2.080876640 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/872de884-2edf-4de9-8ad6-2bc963363808-original-pull-secret") pod "global-pull-secret-syncer-4r7cf" (UID: "872de884-2edf-4de9-8ad6-2bc963363808") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:34:59.164309 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163650 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-host-cni-bin\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.164309 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163668 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-multus-conf-dir\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.164309 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163692 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e0965b1c-953a-4b3d-8ede-9bd21cdba301-host-slash\") pod \"iptables-alerter-z62br\" (UID: \"e0965b1c-953a-4b3d-8ede-9bd21cdba301\") " pod="openshift-network-operator/iptables-alerter-z62br" Jul 06 20:34:59.164309 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163714 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-run-ovn\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.164309 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163741 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-multus-conf-dir\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.164309 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163750 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e0965b1c-953a-4b3d-8ede-9bd21cdba301-host-slash\") pod \"iptables-alerter-z62br\" (UID: \"e0965b1c-953a-4b3d-8ede-9bd21cdba301\") " pod="openshift-network-operator/iptables-alerter-z62br" Jul 06 20:34:59.164309 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163754 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-host-var-lib-cni-bin\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.164309 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163778 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-host-slash\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.164309 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163780 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-run-ovn\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.164309 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163812 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-host-var-lib-cni-bin\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.164309 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163818 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-host-slash\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.165138 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163835 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1dedccb7-cae9-4846-9304-7abe0812a0a2-ovn-node-metrics-cert\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.165138 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163856 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-tmp\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.165138 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163898 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-systemd-units\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.165138 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163916 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4vpt\" (UniqueName: \"kubernetes.io/projected/b5620d06-ce9a-457c-8636-a60ad8234202-kube-api-access-z4vpt\") pod \"network-metrics-daemon-mjfls\" (UID: \"b5620d06-ce9a-457c-8636-a60ad8234202\") " pod="openshift-multus/network-metrics-daemon-mjfls" Jul 06 20:34:59.165138 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163935 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-etc-systemd\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.165138 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163959 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-multus-socket-dir-parent\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.165138 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163979 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/482c8ffc-6942-4433-988b-71ab836d0c4a-serviceca\") pod \"node-ca-9627c\" (UID: \"482c8ffc-6942-4433-988b-71ab836d0c4a\") " pod="openshift-image-registry/node-ca-9627c" Jul 06 20:34:59.165138 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163954 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-systemd-units\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.165138 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.163983 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-host-run-netns\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.165138 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.164033 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-host-run-netns\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.165138 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.164054 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-etc-kubernetes\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.165138 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.164077 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-host-run-netns\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.165138 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.164097 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-node-log\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.165138 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.164160 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/872de884-2edf-4de9-8ad6-2bc963363808-dbus\") pod \"global-pull-secret-syncer-4r7cf\" (UID: \"872de884-2edf-4de9-8ad6-2bc963363808\") " pod="kube-system/global-pull-secret-syncer-4r7cf" Jul 06 20:34:59.165138 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.164179 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-multus-socket-dir-parent\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.165138 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.164191 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-host-run-netns\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.165138 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.164205 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1dedccb7-cae9-4846-9304-7abe0812a0a2-env-overrides\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.165138 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.164078 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-etc-systemd\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.165935 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.164227 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-node-log\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.165935 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.164230 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-etc-tuned\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.165935 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.164230 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-etc-kubernetes\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.165935 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.164270 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-host-run-k8s-cni-cncf-io\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.165935 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.164310 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/872de884-2edf-4de9-8ad6-2bc963363808-dbus\") pod \"global-pull-secret-syncer-4r7cf\" (UID: \"872de884-2edf-4de9-8ad6-2bc963363808\") " pod="kube-system/global-pull-secret-syncer-4r7cf" Jul 06 20:34:59.165935 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.164345 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-host-run-k8s-cni-cncf-io\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.165935 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.164367 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8a5908e1-fa67-40c3-929a-e9e667d92ee8-multus-daemon-config\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.165935 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.164406 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmg9l\" (UniqueName: \"kubernetes.io/projected/482c8ffc-6942-4433-988b-71ab836d0c4a-kube-api-access-jmg9l\") pod \"node-ca-9627c\" (UID: \"482c8ffc-6942-4433-988b-71ab836d0c4a\") " pod="openshift-image-registry/node-ca-9627c" Jul 06 20:34:59.165935 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.164430 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e0965b1c-953a-4b3d-8ede-9bd21cdba301-iptables-alerter-script\") pod \"iptables-alerter-z62br\" (UID: \"e0965b1c-953a-4b3d-8ede-9bd21cdba301\") " pod="openshift-network-operator/iptables-alerter-z62br" Jul 06 20:34:59.165935 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.164706 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1dedccb7-cae9-4846-9304-7abe0812a0a2-env-overrides\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.165935 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.164959 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e0965b1c-953a-4b3d-8ede-9bd21cdba301-iptables-alerter-script\") pod \"iptables-alerter-z62br\" (UID: \"e0965b1c-953a-4b3d-8ede-9bd21cdba301\") " pod="openshift-network-operator/iptables-alerter-z62br" Jul 06 20:34:59.165935 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.164992 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8a5908e1-fa67-40c3-929a-e9e667d92ee8-multus-daemon-config\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.165935 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165047 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-host-kubelet\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.165935 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165073 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-run-systemd\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.165935 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165095 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-etc-sysconfig\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.165935 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165101 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-host-kubelet\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.165935 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165117 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-sys\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.165935 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165143 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-cnibin\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.166684 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165149 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-run-systemd\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.166684 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165185 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-etc-sysconfig\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.166684 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165201 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-cnibin\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.166684 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165185 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-hostroot\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.166684 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165220 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-hostroot\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.166684 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165242 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-sys\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.166684 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165241 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/872de884-2edf-4de9-8ad6-2bc963363808-kubelet-config\") pod \"global-pull-secret-syncer-4r7cf\" (UID: \"872de884-2edf-4de9-8ad6-2bc963363808\") " pod="kube-system/global-pull-secret-syncer-4r7cf" Jul 06 20:34:59.166684 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165301 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/872de884-2edf-4de9-8ad6-2bc963363808-kubelet-config\") pod \"global-pull-secret-syncer-4r7cf\" (UID: \"872de884-2edf-4de9-8ad6-2bc963363808\") " pod="kube-system/global-pull-secret-syncer-4r7cf" Jul 06 20:34:59.166684 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165292 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jddhj\" (UniqueName: \"kubernetes.io/projected/e0965b1c-953a-4b3d-8ede-9bd21cdba301-kube-api-access-jddhj\") pod \"iptables-alerter-z62br\" (UID: \"e0965b1c-953a-4b3d-8ede-9bd21cdba301\") " pod="openshift-network-operator/iptables-alerter-z62br" Jul 06 20:34:59.166684 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165340 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-run-openvswitch\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.166684 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165364 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1dedccb7-cae9-4846-9304-7abe0812a0a2-ovnkube-config\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.166684 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165386 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-run-openvswitch\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.166684 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165387 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a5908e1-fa67-40c3-929a-e9e667d92ee8-cni-binary-copy\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.166684 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165427 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-host-var-lib-cni-multus\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.166684 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165459 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-host-run-multus-certs\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.166684 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165482 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1dedccb7-cae9-4846-9304-7abe0812a0a2-ovnkube-script-lib\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.166684 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165514 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-host\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.166684 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165543 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-host-var-lib-kubelet\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.167399 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165566 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-var-lib-openvswitch\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.167399 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165595 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-etc-openvswitch\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.167399 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165621 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-host-cni-netd\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.167399 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165649 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-etc-modprobe-d\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.167399 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165675 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-etc-sysctl-conf\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.167399 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165810 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a5908e1-fa67-40c3-929a-e9e667d92ee8-cni-binary-copy\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.167399 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165824 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-etc-sysctl-conf\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.167399 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165866 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-host-var-lib-kubelet\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.167399 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165892 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-host-var-lib-cni-multus\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.167399 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165916 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-var-lib-openvswitch\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.167399 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165930 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8a5908e1-fa67-40c3-929a-e9e667d92ee8-host-run-multus-certs\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.167399 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165949 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-etc-openvswitch\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.167399 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.165984 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1dedccb7-cae9-4846-9304-7abe0812a0a2-host-cni-netd\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.167399 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.166021 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1dedccb7-cae9-4846-9304-7abe0812a0a2-ovnkube-config\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.167399 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.166066 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-etc-modprobe-d\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.167399 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.166095 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-host\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.167399 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.166299 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-tmp\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.167399 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.166323 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1dedccb7-cae9-4846-9304-7abe0812a0a2-ovn-node-metrics-cert\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.168216 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.166374 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1dedccb7-cae9-4846-9304-7abe0812a0a2-ovnkube-script-lib\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.168216 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.166423 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-etc-tuned\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.168216 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.166451 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/691b55fa-75bc-4b9a-9e24-2df1c444470f-agent-certs\") pod \"konnectivity-agent-n6892\" (UID: \"691b55fa-75bc-4b9a-9e24-2df1c444470f\") " pod="kube-system/konnectivity-agent-n6892" Jul 06 20:34:59.175554 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.175526 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txq9d\" (UniqueName: \"kubernetes.io/projected/8e4a7b53-b9a6-484a-bac7-75da0d8e69c9-kube-api-access-txq9d\") pod \"tuned-5x5qd\" (UID: \"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9\") " pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.175760 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.175738 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4vpt\" (UniqueName: \"kubernetes.io/projected/b5620d06-ce9a-457c-8636-a60ad8234202-kube-api-access-z4vpt\") pod \"network-metrics-daemon-mjfls\" (UID: \"b5620d06-ce9a-457c-8636-a60ad8234202\") " pod="openshift-multus/network-metrics-daemon-mjfls" Jul 06 20:34:59.176434 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.176412 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft6sp\" (UniqueName: \"kubernetes.io/projected/1dedccb7-cae9-4846-9304-7abe0812a0a2-kube-api-access-ft6sp\") pod \"ovnkube-node-82n9w\" (UID: \"1dedccb7-cae9-4846-9304-7abe0812a0a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.177049 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.177032 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4vxj\" (UniqueName: \"kubernetes.io/projected/8a5908e1-fa67-40c3-929a-e9e667d92ee8-kube-api-access-l4vxj\") pod \"multus-n5z72\" (UID: \"8a5908e1-fa67-40c3-929a-e9e667d92ee8\") " pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.177092 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.177074 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmg9l\" (UniqueName: \"kubernetes.io/projected/482c8ffc-6942-4433-988b-71ab836d0c4a-kube-api-access-jmg9l\") pod \"node-ca-9627c\" (UID: \"482c8ffc-6942-4433-988b-71ab836d0c4a\") " pod="openshift-image-registry/node-ca-9627c" Jul 06 20:34:59.177357 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.177342 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jddhj\" (UniqueName: \"kubernetes.io/projected/e0965b1c-953a-4b3d-8ede-9bd21cdba301-kube-api-access-jddhj\") pod \"iptables-alerter-z62br\" (UID: \"e0965b1c-953a-4b3d-8ede-9bd21cdba301\") " pod="openshift-network-operator/iptables-alerter-z62br" Jul 06 20:34:59.274890 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.274796 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2t2g" Jul 06 20:34:59.279868 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.279851 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-228pr" Jul 06 20:34:59.284351 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:59.284325 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a34e310_83ec_46bd_ad39_3378c8387322.slice/crio-53b1ff5b3f53b408a368092be72b6817a18d95efb7bb1b3986b91d3c07051842 WatchSource:0}: Error finding container 53b1ff5b3f53b408a368092be72b6817a18d95efb7bb1b3986b91d3c07051842: Status 404 returned error can't find the container with id 53b1ff5b3f53b408a368092be72b6817a18d95efb7bb1b3986b91d3c07051842 Jul 06 20:34:59.289187 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:59.289166 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37d7b196_af22_4df9_bb34_5b739bc05578.slice/crio-3c5d6e5096d66b3b322adb9cbe62f5b14e19b277039114544a118963bb3887d9 WatchSource:0}: Error finding container 3c5d6e5096d66b3b322adb9cbe62f5b14e19b277039114544a118963bb3887d9: Status 404 returned error can't find the container with id 3c5d6e5096d66b3b322adb9cbe62f5b14e19b277039114544a118963bb3887d9 Jul 06 20:34:59.313453 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.313425 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sppzx" Jul 06 20:34:59.322338 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:59.322302 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod114fe0eb_e34e_4ae2_800c_abcb04f50f4a.slice/crio-394d147f0a6914cf80de1d0a7469fb53ca6108c5bac390b51581861737262d23 WatchSource:0}: Error finding container 394d147f0a6914cf80de1d0a7469fb53ca6108c5bac390b51581861737262d23: Status 404 returned error can't find the container with id 394d147f0a6914cf80de1d0a7469fb53ca6108c5bac390b51581861737262d23 Jul 06 20:34:59.326119 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.326101 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z62br" Jul 06 20:34:59.329295 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.328906 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:34:59.335171 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:59.335142 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0965b1c_953a_4b3d_8ede_9bd21cdba301.slice/crio-559de4b8e45ac3f9e000a6e38b571060245a2df6dcd1167bbe1b7f768bfbe3c8 WatchSource:0}: Error finding container 559de4b8e45ac3f9e000a6e38b571060245a2df6dcd1167bbe1b7f768bfbe3c8: Status 404 returned error can't find the container with id 559de4b8e45ac3f9e000a6e38b571060245a2df6dcd1167bbe1b7f768bfbe3c8 Jul 06 20:34:59.346779 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.346755 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" Jul 06 20:34:59.354441 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:59.354419 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e4a7b53_b9a6_484a_bac7_75da0d8e69c9.slice/crio-672df6b126a783ae67799cd4695ae5fee48937e4fa2f7f97a8833251c189533b WatchSource:0}: Error finding container 672df6b126a783ae67799cd4695ae5fee48937e4fa2f7f97a8833251c189533b: Status 404 returned error can't find the container with id 672df6b126a783ae67799cd4695ae5fee48937e4fa2f7f97a8833251c189533b Jul 06 20:34:59.359418 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.359400 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n5z72" Jul 06 20:34:59.365043 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.365023 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:34:59.367010 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:59.366989 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a5908e1_fa67_40c3_929a_e9e667d92ee8.slice/crio-d239b2da4ddf0184fe4d5324360f8180738f077e6158a3cec95eeae7d5ec3fec WatchSource:0}: Error finding container d239b2da4ddf0184fe4d5324360f8180738f077e6158a3cec95eeae7d5ec3fec: Status 404 returned error can't find the container with id d239b2da4ddf0184fe4d5324360f8180738f077e6158a3cec95eeae7d5ec3fec Jul 06 20:34:59.369946 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.369925 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-n6892" Jul 06 20:34:59.372958 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:59.372927 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dedccb7_cae9_4846_9304_7abe0812a0a2.slice/crio-515b9c50e93bda640ca757c5d96dbde4584541f8a0236bb615c5836d890eb152 WatchSource:0}: Error finding container 515b9c50e93bda640ca757c5d96dbde4584541f8a0236bb615c5836d890eb152: Status 404 returned error can't find the container with id 515b9c50e93bda640ca757c5d96dbde4584541f8a0236bb615c5836d890eb152 Jul 06 20:34:59.374160 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.373871 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9627c" Jul 06 20:34:59.382185 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:59.382159 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod691b55fa_75bc_4b9a_9e24_2df1c444470f.slice/crio-44aeff305cc97adfe9de9a7950b247b5512f6467ebfcc981bb2700ed9189d5dd WatchSource:0}: Error finding container 44aeff305cc97adfe9de9a7950b247b5512f6467ebfcc981bb2700ed9189d5dd: Status 404 returned error can't find the container with id 44aeff305cc97adfe9de9a7950b247b5512f6467ebfcc981bb2700ed9189d5dd Jul 06 20:34:59.382478 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:34:59.382420 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod482c8ffc_6942_4433_988b_71ab836d0c4a.slice/crio-e45bf4fdb86f24a2f674381c07be4c3051082a4d7e440949e242916165fe408a WatchSource:0}: Error finding container e45bf4fdb86f24a2f674381c07be4c3051082a4d7e440949e242916165fe408a: Status 404 returned error can't find the container with id e45bf4fdb86f24a2f674381c07be4c3051082a4d7e440949e242916165fe408a Jul 06 20:34:59.669738 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.669653 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5620d06-ce9a-457c-8636-a60ad8234202-metrics-certs\") pod \"network-metrics-daemon-mjfls\" (UID: \"b5620d06-ce9a-457c-8636-a60ad8234202\") " pod="openshift-multus/network-metrics-daemon-mjfls" Jul 06 20:34:59.669738 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.669713 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/872de884-2edf-4de9-8ad6-2bc963363808-original-pull-secret\") pod \"global-pull-secret-syncer-4r7cf\" (UID: \"872de884-2edf-4de9-8ad6-2bc963363808\") " pod="kube-system/global-pull-secret-syncer-4r7cf" Jul 06 20:34:59.669977 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.669746 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng2r9\" (UniqueName: \"kubernetes.io/projected/3e34520c-432d-4ad4-a08a-3bcf6b082abc-kube-api-access-ng2r9\") pod \"network-check-target-gvkfp\" (UID: \"3e34520c-432d-4ad4-a08a-3bcf6b082abc\") " pod="openshift-network-diagnostics/network-check-target-gvkfp" Jul 06 20:34:59.669977 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:59.669918 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:34:59.669977 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:59.669937 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:34:59.669977 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:59.669948 2562 projected.go:196] Error preparing data for projected volume kube-api-access-ng2r9 for pod openshift-network-diagnostics/network-check-target-gvkfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:34:59.670155 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:59.670004 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e34520c-432d-4ad4-a08a-3bcf6b082abc-kube-api-access-ng2r9 podName:3e34520c-432d-4ad4-a08a-3bcf6b082abc nodeName:}" failed. No retries permitted until 2026-07-06 20:35:00.66998647 +0000 UTC m=+3.087235879 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ng2r9" (UniqueName: "kubernetes.io/projected/3e34520c-432d-4ad4-a08a-3bcf6b082abc-kube-api-access-ng2r9") pod "network-check-target-gvkfp" (UID: "3e34520c-432d-4ad4-a08a-3bcf6b082abc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:34:59.670594 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:59.670415 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:34:59.670594 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:59.670479 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872de884-2edf-4de9-8ad6-2bc963363808-original-pull-secret podName:872de884-2edf-4de9-8ad6-2bc963363808 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:00.670462801 +0000 UTC m=+3.087712212 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/872de884-2edf-4de9-8ad6-2bc963363808-original-pull-secret") pod "global-pull-secret-syncer-4r7cf" (UID: "872de884-2edf-4de9-8ad6-2bc963363808") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:34:59.670594 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:59.670424 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:34:59.670594 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:34:59.670534 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5620d06-ce9a-457c-8636-a60ad8234202-metrics-certs podName:b5620d06-ce9a-457c-8636-a60ad8234202 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:00.670522355 +0000 UTC m=+3.087771761 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5620d06-ce9a-457c-8636-a60ad8234202-metrics-certs") pod "network-metrics-daemon-mjfls" (UID: "b5620d06-ce9a-457c-8636-a60ad8234202") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:34:59.903093 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.902787 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:34:59.944701 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:34:59.944330 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:35:00.031282 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:00.031138 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 20:29:58 +0000 UTC" deadline="2028-03-01 00:01:35.430277618 +0000 UTC" Jul 06 20:35:00.031282 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:00.031196 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14475h26m35.399085619s" Jul 06 20:35:00.094184 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:00.094155 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkfp" Jul 06 20:35:00.094362 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:00.094269 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkfp" podUID="3e34520c-432d-4ad4-a08a-3bcf6b082abc" Jul 06 20:35:00.130245 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:00.130160 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9627c" event={"ID":"482c8ffc-6942-4433-988b-71ab836d0c4a","Type":"ContainerStarted","Data":"e45bf4fdb86f24a2f674381c07be4c3051082a4d7e440949e242916165fe408a"} Jul 06 20:35:00.142466 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:00.142419 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" event={"ID":"1dedccb7-cae9-4846-9304-7abe0812a0a2","Type":"ContainerStarted","Data":"515b9c50e93bda640ca757c5d96dbde4584541f8a0236bb615c5836d890eb152"} Jul 06 20:35:00.164318 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:00.164282 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" event={"ID":"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9","Type":"ContainerStarted","Data":"672df6b126a783ae67799cd4695ae5fee48937e4fa2f7f97a8833251c189533b"} Jul 06 20:35:00.186501 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:00.186462 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2t2g" event={"ID":"5a34e310-83ec-46bd-ad39-3378c8387322","Type":"ContainerStarted","Data":"53b1ff5b3f53b408a368092be72b6817a18d95efb7bb1b3986b91d3c07051842"} Jul 06 20:35:00.196940 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:00.196847 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-n6892" event={"ID":"691b55fa-75bc-4b9a-9e24-2df1c444470f","Type":"ContainerStarted","Data":"44aeff305cc97adfe9de9a7950b247b5512f6467ebfcc981bb2700ed9189d5dd"} Jul 06 20:35:00.201083 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:00.201048 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n5z72" event={"ID":"8a5908e1-fa67-40c3-929a-e9e667d92ee8","Type":"ContainerStarted","Data":"d239b2da4ddf0184fe4d5324360f8180738f077e6158a3cec95eeae7d5ec3fec"} Jul 06 20:35:00.205473 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:00.205404 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z62br" event={"ID":"e0965b1c-953a-4b3d-8ede-9bd21cdba301","Type":"ContainerStarted","Data":"559de4b8e45ac3f9e000a6e38b571060245a2df6dcd1167bbe1b7f768bfbe3c8"} Jul 06 20:35:00.215168 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:00.215088 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sppzx" event={"ID":"114fe0eb-e34e-4ae2-800c-abcb04f50f4a","Type":"ContainerStarted","Data":"394d147f0a6914cf80de1d0a7469fb53ca6108c5bac390b51581861737262d23"} Jul 06 20:35:00.217405 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:00.217325 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-228pr" event={"ID":"37d7b196-af22-4df9-bb34-5b739bc05578","Type":"ContainerStarted","Data":"3c5d6e5096d66b3b322adb9cbe62f5b14e19b277039114544a118963bb3887d9"} Jul 06 20:35:00.678740 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:00.678646 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5620d06-ce9a-457c-8636-a60ad8234202-metrics-certs\") pod \"network-metrics-daemon-mjfls\" (UID: \"b5620d06-ce9a-457c-8636-a60ad8234202\") " pod="openshift-multus/network-metrics-daemon-mjfls" Jul 06 20:35:00.678740 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:00.678705 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/872de884-2edf-4de9-8ad6-2bc963363808-original-pull-secret\") pod \"global-pull-secret-syncer-4r7cf\" (UID: \"872de884-2edf-4de9-8ad6-2bc963363808\") " pod="kube-system/global-pull-secret-syncer-4r7cf" Jul 06 20:35:00.679033 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:00.678748 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng2r9\" (UniqueName: \"kubernetes.io/projected/3e34520c-432d-4ad4-a08a-3bcf6b082abc-kube-api-access-ng2r9\") pod \"network-check-target-gvkfp\" (UID: \"3e34520c-432d-4ad4-a08a-3bcf6b082abc\") " pod="openshift-network-diagnostics/network-check-target-gvkfp" Jul 06 20:35:00.679033 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:00.678899 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:35:00.679033 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:00.678971 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5620d06-ce9a-457c-8636-a60ad8234202-metrics-certs podName:b5620d06-ce9a-457c-8636-a60ad8234202 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:02.678950437 +0000 UTC m=+5.096199850 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5620d06-ce9a-457c-8636-a60ad8234202-metrics-certs") pod "network-metrics-daemon-mjfls" (UID: "b5620d06-ce9a-457c-8636-a60ad8234202") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:35:00.679033 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:00.679008 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:35:00.679033 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:00.679027 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:35:00.679270 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:00.679040 2562 projected.go:196] Error preparing data for projected volume kube-api-access-ng2r9 for pod openshift-network-diagnostics/network-check-target-gvkfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:35:00.679270 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:00.679085 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e34520c-432d-4ad4-a08a-3bcf6b082abc-kube-api-access-ng2r9 podName:3e34520c-432d-4ad4-a08a-3bcf6b082abc nodeName:}" failed. No retries permitted until 2026-07-06 20:35:02.67906994 +0000 UTC m=+5.096319350 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ng2r9" (UniqueName: "kubernetes.io/projected/3e34520c-432d-4ad4-a08a-3bcf6b082abc-kube-api-access-ng2r9") pod "network-check-target-gvkfp" (UID: "3e34520c-432d-4ad4-a08a-3bcf6b082abc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:35:00.679270 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:00.679135 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:35:00.679270 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:00.679176 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872de884-2edf-4de9-8ad6-2bc963363808-original-pull-secret podName:872de884-2edf-4de9-8ad6-2bc963363808 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:02.679164841 +0000 UTC m=+5.096414252 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/872de884-2edf-4de9-8ad6-2bc963363808-original-pull-secret") pod "global-pull-secret-syncer-4r7cf" (UID: "872de884-2edf-4de9-8ad6-2bc963363808") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:35:01.031668 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:01.031523 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 20:29:58 +0000 UTC" deadline="2028-02-20 22:26:36.511533119 +0000 UTC" Jul 06 20:35:01.031668 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:01.031584 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14257h51m35.479953803s" Jul 06 20:35:01.093133 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:01.093056 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r7cf" Jul 06 20:35:01.093133 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:01.093085 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjfls" Jul 06 20:35:01.093375 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:01.093199 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r7cf" podUID="872de884-2edf-4de9-8ad6-2bc963363808" Jul 06 20:35:01.093624 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:01.093567 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mjfls" podUID="b5620d06-ce9a-457c-8636-a60ad8234202" Jul 06 20:35:02.097253 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:02.097220 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkfp" Jul 06 20:35:02.097705 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:02.097352 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkfp" podUID="3e34520c-432d-4ad4-a08a-3bcf6b082abc" Jul 06 20:35:02.694453 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:02.694412 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5620d06-ce9a-457c-8636-a60ad8234202-metrics-certs\") pod \"network-metrics-daemon-mjfls\" (UID: \"b5620d06-ce9a-457c-8636-a60ad8234202\") " pod="openshift-multus/network-metrics-daemon-mjfls" Jul 06 20:35:02.694646 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:02.694477 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/872de884-2edf-4de9-8ad6-2bc963363808-original-pull-secret\") pod \"global-pull-secret-syncer-4r7cf\" (UID: \"872de884-2edf-4de9-8ad6-2bc963363808\") " pod="kube-system/global-pull-secret-syncer-4r7cf" Jul 06 20:35:02.694646 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:02.694513 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng2r9\" (UniqueName: \"kubernetes.io/projected/3e34520c-432d-4ad4-a08a-3bcf6b082abc-kube-api-access-ng2r9\") pod \"network-check-target-gvkfp\" (UID: \"3e34520c-432d-4ad4-a08a-3bcf6b082abc\") " pod="openshift-network-diagnostics/network-check-target-gvkfp" Jul 06 20:35:02.694775 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:02.694662 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:35:02.694775 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:02.694678 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:35:02.694775 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:02.694742 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:35:02.694775 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:02.694756 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5620d06-ce9a-457c-8636-a60ad8234202-metrics-certs podName:b5620d06-ce9a-457c-8636-a60ad8234202 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:06.694735503 +0000 UTC m=+9.111984912 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5620d06-ce9a-457c-8636-a60ad8234202-metrics-certs") pod "network-metrics-daemon-mjfls" (UID: "b5620d06-ce9a-457c-8636-a60ad8234202") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:35:02.694995 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:02.694791 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872de884-2edf-4de9-8ad6-2bc963363808-original-pull-secret podName:872de884-2edf-4de9-8ad6-2bc963363808 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:06.694774473 +0000 UTC m=+9.112023886 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/872de884-2edf-4de9-8ad6-2bc963363808-original-pull-secret") pod "global-pull-secret-syncer-4r7cf" (UID: "872de884-2edf-4de9-8ad6-2bc963363808") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:35:02.694995 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:02.694688 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:35:02.694995 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:02.694814 2562 projected.go:196] Error preparing data for projected volume kube-api-access-ng2r9 for pod openshift-network-diagnostics/network-check-target-gvkfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:35:02.694995 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:02.694848 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e34520c-432d-4ad4-a08a-3bcf6b082abc-kube-api-access-ng2r9 podName:3e34520c-432d-4ad4-a08a-3bcf6b082abc nodeName:}" failed. No retries permitted until 2026-07-06 20:35:06.694838765 +0000 UTC m=+9.112088173 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ng2r9" (UniqueName: "kubernetes.io/projected/3e34520c-432d-4ad4-a08a-3bcf6b082abc-kube-api-access-ng2r9") pod "network-check-target-gvkfp" (UID: "3e34520c-432d-4ad4-a08a-3bcf6b082abc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:35:03.093214 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:03.093123 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjfls" Jul 06 20:35:03.093367 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:03.093123 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r7cf" Jul 06 20:35:03.093367 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:03.093281 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mjfls" podUID="b5620d06-ce9a-457c-8636-a60ad8234202" Jul 06 20:35:03.093489 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:03.093373 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r7cf" podUID="872de884-2edf-4de9-8ad6-2bc963363808" Jul 06 20:35:04.093957 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:04.093371 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkfp" Jul 06 20:35:04.093957 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:04.093574 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkfp" podUID="3e34520c-432d-4ad4-a08a-3bcf6b082abc" Jul 06 20:35:05.092966 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:05.092930 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r7cf" Jul 06 20:35:05.093138 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:05.093092 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r7cf" podUID="872de884-2edf-4de9-8ad6-2bc963363808" Jul 06 20:35:05.093214 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:05.093172 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjfls" Jul 06 20:35:05.093339 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:05.093299 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mjfls" podUID="b5620d06-ce9a-457c-8636-a60ad8234202" Jul 06 20:35:06.093324 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:06.093222 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkfp" Jul 06 20:35:06.093760 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:06.093357 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkfp" podUID="3e34520c-432d-4ad4-a08a-3bcf6b082abc" Jul 06 20:35:06.730789 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:06.730567 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng2r9\" (UniqueName: \"kubernetes.io/projected/3e34520c-432d-4ad4-a08a-3bcf6b082abc-kube-api-access-ng2r9\") pod \"network-check-target-gvkfp\" (UID: \"3e34520c-432d-4ad4-a08a-3bcf6b082abc\") " pod="openshift-network-diagnostics/network-check-target-gvkfp" Jul 06 20:35:06.730789 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:06.730655 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5620d06-ce9a-457c-8636-a60ad8234202-metrics-certs\") pod \"network-metrics-daemon-mjfls\" (UID: \"b5620d06-ce9a-457c-8636-a60ad8234202\") " pod="openshift-multus/network-metrics-daemon-mjfls" Jul 06 20:35:06.730789 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:06.730692 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/872de884-2edf-4de9-8ad6-2bc963363808-original-pull-secret\") pod \"global-pull-secret-syncer-4r7cf\" (UID: \"872de884-2edf-4de9-8ad6-2bc963363808\") " pod="kube-system/global-pull-secret-syncer-4r7cf" Jul 06 20:35:06.730789 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:06.730766 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:35:06.730789 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:06.730792 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:35:06.730789 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:06.730806 2562 projected.go:196] Error preparing data for projected volume kube-api-access-ng2r9 for pod openshift-network-diagnostics/network-check-target-gvkfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:35:06.731241 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:06.730836 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:35:06.731241 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:06.730864 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e34520c-432d-4ad4-a08a-3bcf6b082abc-kube-api-access-ng2r9 podName:3e34520c-432d-4ad4-a08a-3bcf6b082abc nodeName:}" failed. No retries permitted until 2026-07-06 20:35:14.730846225 +0000 UTC m=+17.148095632 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ng2r9" (UniqueName: "kubernetes.io/projected/3e34520c-432d-4ad4-a08a-3bcf6b082abc-kube-api-access-ng2r9") pod "network-check-target-gvkfp" (UID: "3e34520c-432d-4ad4-a08a-3bcf6b082abc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:35:06.731241 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:06.730926 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5620d06-ce9a-457c-8636-a60ad8234202-metrics-certs podName:b5620d06-ce9a-457c-8636-a60ad8234202 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:14.730901686 +0000 UTC m=+17.148151097 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5620d06-ce9a-457c-8636-a60ad8234202-metrics-certs") pod "network-metrics-daemon-mjfls" (UID: "b5620d06-ce9a-457c-8636-a60ad8234202") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:35:06.731241 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:06.730770 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:35:06.731241 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:06.730965 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872de884-2edf-4de9-8ad6-2bc963363808-original-pull-secret podName:872de884-2edf-4de9-8ad6-2bc963363808 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:14.730954735 +0000 UTC m=+17.148204144 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/872de884-2edf-4de9-8ad6-2bc963363808-original-pull-secret") pod "global-pull-secret-syncer-4r7cf" (UID: "872de884-2edf-4de9-8ad6-2bc963363808") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:35:07.093314 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:07.093227 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjfls" Jul 06 20:35:07.093314 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:07.093270 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r7cf" Jul 06 20:35:07.093853 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:07.093378 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mjfls" podUID="b5620d06-ce9a-457c-8636-a60ad8234202" Jul 06 20:35:07.093853 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:07.093793 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r7cf" podUID="872de884-2edf-4de9-8ad6-2bc963363808" Jul 06 20:35:08.094232 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:08.094195 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkfp" Jul 06 20:35:08.094679 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:08.094321 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkfp" podUID="3e34520c-432d-4ad4-a08a-3bcf6b082abc" Jul 06 20:35:09.092988 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:09.092956 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r7cf" Jul 06 20:35:09.093168 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:09.092956 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjfls" Jul 06 20:35:09.093168 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:09.093109 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r7cf" podUID="872de884-2edf-4de9-8ad6-2bc963363808" Jul 06 20:35:09.093168 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:09.093154 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mjfls" podUID="b5620d06-ce9a-457c-8636-a60ad8234202" Jul 06 20:35:10.093342 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:10.093304 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkfp" Jul 06 20:35:10.093787 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:10.093451 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkfp" podUID="3e34520c-432d-4ad4-a08a-3bcf6b082abc" Jul 06 20:35:11.093650 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:11.093608 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r7cf" Jul 06 20:35:11.094161 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:11.093632 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjfls" Jul 06 20:35:11.094161 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:11.093779 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r7cf" podUID="872de884-2edf-4de9-8ad6-2bc963363808" Jul 06 20:35:11.094161 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:11.093862 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mjfls" podUID="b5620d06-ce9a-457c-8636-a60ad8234202" Jul 06 20:35:12.093513 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:12.093459 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkfp" Jul 06 20:35:12.093668 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:12.093602 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkfp" podUID="3e34520c-432d-4ad4-a08a-3bcf6b082abc" Jul 06 20:35:13.093572 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:13.093533 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjfls" Jul 06 20:35:13.093741 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:13.093533 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r7cf" Jul 06 20:35:13.093741 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:13.093665 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mjfls" podUID="b5620d06-ce9a-457c-8636-a60ad8234202" Jul 06 20:35:13.094113 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:13.093774 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r7cf" podUID="872de884-2edf-4de9-8ad6-2bc963363808" Jul 06 20:35:14.093249 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:14.093206 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkfp" Jul 06 20:35:14.093442 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:14.093355 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkfp" podUID="3e34520c-432d-4ad4-a08a-3bcf6b082abc" Jul 06 20:35:14.791020 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:14.790978 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng2r9\" (UniqueName: \"kubernetes.io/projected/3e34520c-432d-4ad4-a08a-3bcf6b082abc-kube-api-access-ng2r9\") pod \"network-check-target-gvkfp\" (UID: \"3e34520c-432d-4ad4-a08a-3bcf6b082abc\") " pod="openshift-network-diagnostics/network-check-target-gvkfp" Jul 06 20:35:14.791522 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:14.791060 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5620d06-ce9a-457c-8636-a60ad8234202-metrics-certs\") pod \"network-metrics-daemon-mjfls\" (UID: \"b5620d06-ce9a-457c-8636-a60ad8234202\") " pod="openshift-multus/network-metrics-daemon-mjfls" Jul 06 20:35:14.791522 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:14.791095 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/872de884-2edf-4de9-8ad6-2bc963363808-original-pull-secret\") pod \"global-pull-secret-syncer-4r7cf\" (UID: \"872de884-2edf-4de9-8ad6-2bc963363808\") " pod="kube-system/global-pull-secret-syncer-4r7cf" Jul 06 20:35:14.791522 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:14.791151 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:35:14.791522 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:14.791172 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:35:14.791522 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:14.791224 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872de884-2edf-4de9-8ad6-2bc963363808-original-pull-secret podName:872de884-2edf-4de9-8ad6-2bc963363808 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:30.791208848 +0000 UTC m=+33.208458256 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/872de884-2edf-4de9-8ad6-2bc963363808-original-pull-secret") pod "global-pull-secret-syncer-4r7cf" (UID: "872de884-2edf-4de9-8ad6-2bc963363808") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:35:14.791522 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:14.791222 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:35:14.791522 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:14.791174 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:35:14.791522 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:14.791268 2562 projected.go:196] Error preparing data for projected volume kube-api-access-ng2r9 for pod openshift-network-diagnostics/network-check-target-gvkfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:35:14.791522 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:14.791281 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5620d06-ce9a-457c-8636-a60ad8234202-metrics-certs podName:b5620d06-ce9a-457c-8636-a60ad8234202 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:30.791261886 +0000 UTC m=+33.208511293 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5620d06-ce9a-457c-8636-a60ad8234202-metrics-certs") pod "network-metrics-daemon-mjfls" (UID: "b5620d06-ce9a-457c-8636-a60ad8234202") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:35:14.791522 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:14.791309 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e34520c-432d-4ad4-a08a-3bcf6b082abc-kube-api-access-ng2r9 podName:3e34520c-432d-4ad4-a08a-3bcf6b082abc nodeName:}" failed. No retries permitted until 2026-07-06 20:35:30.791296812 +0000 UTC m=+33.208546234 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ng2r9" (UniqueName: "kubernetes.io/projected/3e34520c-432d-4ad4-a08a-3bcf6b082abc-kube-api-access-ng2r9") pod "network-check-target-gvkfp" (UID: "3e34520c-432d-4ad4-a08a-3bcf6b082abc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:35:15.093191 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:15.093113 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r7cf" Jul 06 20:35:15.093410 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:15.093112 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjfls" Jul 06 20:35:15.093410 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:15.093243 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r7cf" podUID="872de884-2edf-4de9-8ad6-2bc963363808" Jul 06 20:35:15.093410 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:15.093321 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mjfls" podUID="b5620d06-ce9a-457c-8636-a60ad8234202" Jul 06 20:35:16.093113 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:16.093071 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkfp" Jul 06 20:35:16.093601 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:16.093204 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkfp" podUID="3e34520c-432d-4ad4-a08a-3bcf6b082abc" Jul 06 20:35:17.093413 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:17.093374 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r7cf" Jul 06 20:35:17.093922 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:17.093511 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r7cf" podUID="872de884-2edf-4de9-8ad6-2bc963363808" Jul 06 20:35:17.093922 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:17.093560 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjfls" Jul 06 20:35:17.093922 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:17.093665 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mjfls" podUID="b5620d06-ce9a-457c-8636-a60ad8234202" Jul 06 20:35:18.096202 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:18.096172 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkfp" Jul 06 20:35:18.096618 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:18.096285 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkfp" podUID="3e34520c-432d-4ad4-a08a-3bcf6b082abc" Jul 06 20:35:19.092832 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:19.092683 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjfls" Jul 06 20:35:19.092971 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:19.092723 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r7cf" Jul 06 20:35:19.092971 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:19.092934 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mjfls" podUID="b5620d06-ce9a-457c-8636-a60ad8234202" Jul 06 20:35:19.095560 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:19.093300 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r7cf" podUID="872de884-2edf-4de9-8ad6-2bc963363808" Jul 06 20:35:19.271368 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:19.271337 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" event={"ID":"1dedccb7-cae9-4846-9304-7abe0812a0a2","Type":"ContainerStarted","Data":"1b4ee695f1cd6a1960d5b977783db51b12f8e3af3496b9c653ccfbcaf2047a86"} Jul 06 20:35:19.272910 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:19.272866 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" event={"ID":"8e4a7b53-b9a6-484a-bac7-75da0d8e69c9","Type":"ContainerStarted","Data":"902da753a374ee75774de0d8965d1b68f7cd273e8036cd109dafa9fd1d0ac2be"} Jul 06 20:35:19.275199 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:19.275165 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n5z72" event={"ID":"8a5908e1-fa67-40c3-929a-e9e667d92ee8","Type":"ContainerStarted","Data":"44a315cebe6fb9fbcd73e9dde35d119f9a50242283926de275080b3fd3417153"} Jul 06 20:35:19.277059 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:19.277032 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-77.ec2.internal" event={"ID":"915ab3f22472460b3ca3a702c37324c2","Type":"ContainerStarted","Data":"187a591b97b4bc542ffafc64b1bdfe1cb328aea4f91d170782057b508119467a"} Jul 06 20:35:19.297320 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:19.297260 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5x5qd" podStartSLOduration=2.723924825 podStartE2EDuration="22.297229629s" totalImagesPullingTime="19.573304804s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:19.296721865 +0000 UTC m=+21.713971291" watchObservedRunningTime="2026-07-06 20:35:19.297229629 +0000 UTC m=+21.714479058" Jul 06 20:35:19.321992 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:19.321905 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-77.ec2.internal" podStartSLOduration=21.321874311 podStartE2EDuration="21.321874311s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:34:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:19.321066409 +0000 UTC m=+21.738315838" watchObservedRunningTime="2026-07-06 20:35:19.321874311 +0000 UTC m=+21.739123740" Jul 06 20:35:19.344101 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:19.344052 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-n5z72" podStartSLOduration=2.720377478 podStartE2EDuration="22.344039289s" totalImagesPullingTime="19.623661811s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:19.342914712 +0000 UTC m=+21.760164141" watchObservedRunningTime="2026-07-06 20:35:19.344039289 +0000 UTC m=+21.761288717" Jul 06 20:35:20.093473 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:20.093078 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkfp" Jul 06 20:35:20.093622 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:20.093586 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkfp" podUID="3e34520c-432d-4ad4-a08a-3bcf6b082abc" Jul 06 20:35:20.282247 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:20.282170 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 20:35:20.282629 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:20.282476 2562 generic.go:356] "Generic (PLEG): container finished" podID="1dedccb7-cae9-4846-9304-7abe0812a0a2" containerID="7d617a988a2e87df9aa0b8b07cd7d95ffc9d815b74d9581922343703396b524c" exitCode=1 Jul 06 20:35:20.282629 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:20.282547 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" event={"ID":"1dedccb7-cae9-4846-9304-7abe0812a0a2","Type":"ContainerStarted","Data":"25894c7ae05cf1f7dc6171dbf850156dcd63f2555b857b4826c06d25d9765635"} Jul 06 20:35:20.282629 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:20.282627 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" event={"ID":"1dedccb7-cae9-4846-9304-7abe0812a0a2","Type":"ContainerStarted","Data":"438a5e03a952adda46a2634f9036564ec6217e79e99a4ddd12c0944c729162b2"} Jul 06 20:35:20.282761 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:20.282672 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" event={"ID":"1dedccb7-cae9-4846-9304-7abe0812a0a2","Type":"ContainerStarted","Data":"d68e142fae1c4b4b5e28cabfdf08979fda044b58f3e24cd742908059c4651630"} Jul 06 20:35:20.282761 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:20.282708 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" event={"ID":"1dedccb7-cae9-4846-9304-7abe0812a0a2","Type":"ContainerStarted","Data":"a0e4572345e0f4a7d56bf6d920948dc6597899d0e74f47808fb407729de6460a"} Jul 06 20:35:20.282761 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:20.282753 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" event={"ID":"1dedccb7-cae9-4846-9304-7abe0812a0a2","Type":"ContainerDied","Data":"7d617a988a2e87df9aa0b8b07cd7d95ffc9d815b74d9581922343703396b524c"} Jul 06 20:35:20.283971 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:20.283943 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2t2g" event={"ID":"5a34e310-83ec-46bd-ad39-3378c8387322","Type":"ContainerStarted","Data":"74b7ef10539697c9cb5e2940c848a63d4ac1df4555bfa9b7f6bfa6e995873340"} Jul 06 20:35:20.285144 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:20.285111 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-n6892" event={"ID":"691b55fa-75bc-4b9a-9e24-2df1c444470f","Type":"ContainerStarted","Data":"83721f3cc62bb8bbc1dbbaa9334412277774053869affe4a8583ad08ea526e08"} Jul 06 20:35:20.286504 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:20.286482 2562 generic.go:356] "Generic (PLEG): container finished" podID="114fe0eb-e34e-4ae2-800c-abcb04f50f4a" containerID="df17a1783e6ff72da77935c0c03b28a8f367641a4fdacc9a1c8f3157b019e9c3" exitCode=0 Jul 06 20:35:20.286603 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:20.286546 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sppzx" event={"ID":"114fe0eb-e34e-4ae2-800c-abcb04f50f4a","Type":"ContainerDied","Data":"df17a1783e6ff72da77935c0c03b28a8f367641a4fdacc9a1c8f3157b019e9c3"} Jul 06 20:35:20.288128 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:20.288015 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-228pr" event={"ID":"37d7b196-af22-4df9-bb34-5b739bc05578","Type":"ContainerStarted","Data":"3802c9dfb4c4a46ab663396c4066c82283c0739e7b387b554600d2d749532a0f"} Jul 06 20:35:20.289610 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:20.289591 2562 generic.go:356] "Generic (PLEG): container finished" podID="f1d61fd9465d9eb2bf62db9797fd9225" containerID="293223c93b44276f6967c5119b6335b1c6037dd3b97163215f645f8f6581d030" exitCode=0 Jul 06 20:35:20.289709 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:20.289672 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-77.ec2.internal" event={"ID":"f1d61fd9465d9eb2bf62db9797fd9225","Type":"ContainerDied","Data":"293223c93b44276f6967c5119b6335b1c6037dd3b97163215f645f8f6581d030"} Jul 06 20:35:20.291218 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:20.291191 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9627c" event={"ID":"482c8ffc-6942-4433-988b-71ab836d0c4a","Type":"ContainerStarted","Data":"3db390fda6c86228d9b134ac7d82ddd68e12684e6160b65416c800abd83d2d89"} Jul 06 20:35:20.303396 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:20.303351 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-n6892" podStartSLOduration=2.759549733 podStartE2EDuration="22.303336415s" totalImagesPullingTime="19.543786682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:34:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:20.302869822 +0000 UTC m=+22.720119255" watchObservedRunningTime="2026-07-06 20:35:20.303336415 +0000 UTC m=+22.720585843" Jul 06 20:35:20.320115 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:20.320065 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9627c" podStartSLOduration=2.776723953 podStartE2EDuration="22.320050021s" totalImagesPullingTime="19.543326068s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:34:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:20.319822792 +0000 UTC m=+22.737072222" watchObservedRunningTime="2026-07-06 20:35:20.320050021 +0000 UTC m=+22.737299449" Jul 06 20:35:20.360100 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:20.360048 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-228pr" podStartSLOduration=3.723576471 podStartE2EDuration="23.360030257s" totalImagesPullingTime="19.636453786s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:20.359991854 +0000 UTC m=+22.777241295" watchObservedRunningTime="2026-07-06 20:35:20.360030257 +0000 UTC m=+22.777279688" Jul 06 20:35:21.093203 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:21.093171 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r7cf" Jul 06 20:35:21.093390 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:21.093171 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjfls" Jul 06 20:35:21.093390 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:21.093277 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r7cf" podUID="872de884-2edf-4de9-8ad6-2bc963363808" Jul 06 20:35:21.093390 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:21.093352 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mjfls" podUID="b5620d06-ce9a-457c-8636-a60ad8234202" Jul 06 20:35:21.246898 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:21.246847 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 20:35:21.295295 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:21.295259 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-77.ec2.internal" event={"ID":"f1d61fd9465d9eb2bf62db9797fd9225","Type":"ContainerStarted","Data":"15f5b79269dee68e36e0523e625b9c19153913543f8c7eabe3a552dbc661bbb0"} Jul 06 20:35:21.297170 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:21.297146 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2t2g" event={"ID":"5a34e310-83ec-46bd-ad39-3378c8387322","Type":"ContainerStarted","Data":"4dcb64d005569bdfebc537d86eff96342bdc3fcc5637c82e642478eb76598ef5"} Jul 06 20:35:21.298368 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:21.298343 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z62br" event={"ID":"e0965b1c-953a-4b3d-8ede-9bd21cdba301","Type":"ContainerStarted","Data":"1157d0e7d5c9d5d782a177888610ee1847a092ec10dd09ad537c98c901df3e34"} Jul 06 20:35:21.313623 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:21.313573 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-77.ec2.internal" podStartSLOduration=23.313556981 podStartE2EDuration="23.313556981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:34:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:21.313278894 +0000 UTC m=+23.730528323" watchObservedRunningTime="2026-07-06 20:35:21.313556981 +0000 UTC m=+23.730806411" Jul 06 20:35:21.330152 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:21.330096 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-z62br" podStartSLOduration=4.739320565 podStartE2EDuration="24.33007925s" totalImagesPullingTime="19.590758685s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:21.329423773 +0000 UTC m=+23.746673201" watchObservedRunningTime="2026-07-06 20:35:21.33007925 +0000 UTC m=+23.747328679" Jul 06 20:35:22.031651 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:22.031509 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T20:35:21.246874302Z","UUID":"7ead1ceb-a0e7-4204-b801-ebb931ef0934","Handler":null,"Name":"","Endpoint":""} Jul 06 20:35:22.033111 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:22.033085 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 20:35:22.033235 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:22.033132 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 20:35:22.093030 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:22.092956 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkfp" Jul 06 20:35:22.093175 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:22.093071 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkfp" podUID="3e34520c-432d-4ad4-a08a-3bcf6b082abc" Jul 06 20:35:22.303000 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:22.302974 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 20:35:22.303413 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:22.303377 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" event={"ID":"1dedccb7-cae9-4846-9304-7abe0812a0a2","Type":"ContainerStarted","Data":"ae44a02cc1152a5ab0c5370b3627f7eb9daefff7e6dd0ce71a37a31cc06e6349"} Jul 06 20:35:23.089083 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:23.089047 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-n6892" Jul 06 20:35:23.089700 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:23.089677 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-n6892" Jul 06 20:35:23.092853 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:23.092831 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r7cf" Jul 06 20:35:23.092976 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:23.092948 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r7cf" podUID="872de884-2edf-4de9-8ad6-2bc963363808" Jul 06 20:35:23.093063 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:23.093045 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjfls" Jul 06 20:35:23.093177 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:23.093158 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mjfls" podUID="b5620d06-ce9a-457c-8636-a60ad8234202" Jul 06 20:35:23.307440 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:23.307254 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2t2g" event={"ID":"5a34e310-83ec-46bd-ad39-3378c8387322","Type":"ContainerStarted","Data":"c4a6639113804f61b300311e1e7186b1f6baf462dcc725b228d339c6f9032c37"} Jul 06 20:35:23.326681 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:23.326621 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2t2g" podStartSLOduration=4.25590476 podStartE2EDuration="26.32660429s" totalImagesPullingTime="22.07069953s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:34:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:23.32623374 +0000 UTC m=+25.743483169" watchObservedRunningTime="2026-07-06 20:35:23.32660429 +0000 UTC m=+25.743853719" Jul 06 20:35:24.093531 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:24.093492 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkfp" Jul 06 20:35:24.093726 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:24.093630 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkfp" podUID="3e34520c-432d-4ad4-a08a-3bcf6b082abc" Jul 06 20:35:25.092963 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:25.092922 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r7cf" Jul 06 20:35:25.092963 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:25.092960 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjfls" Jul 06 20:35:25.093490 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:25.093061 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r7cf" podUID="872de884-2edf-4de9-8ad6-2bc963363808" Jul 06 20:35:25.093490 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:25.093170 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mjfls" podUID="b5620d06-ce9a-457c-8636-a60ad8234202" Jul 06 20:35:26.093834 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:26.093553 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkfp" Jul 06 20:35:26.094234 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:26.093907 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkfp" podUID="3e34520c-432d-4ad4-a08a-3bcf6b082abc" Jul 06 20:35:26.318694 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:26.318668 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 20:35:26.319054 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:26.319029 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" event={"ID":"1dedccb7-cae9-4846-9304-7abe0812a0a2","Type":"ContainerStarted","Data":"c84778794a1e3b9195ff57567c7d4743d970b1519c44079565fb5da7ce952793"} Jul 06 20:35:26.319287 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:26.319269 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:35:26.319502 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:26.319467 2562 scope.go:117] "RemoveContainer" containerID="7d617a988a2e87df9aa0b8b07cd7d95ffc9d815b74d9581922343703396b524c" Jul 06 20:35:26.320992 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:26.320966 2562 generic.go:356] "Generic (PLEG): container finished" podID="114fe0eb-e34e-4ae2-800c-abcb04f50f4a" containerID="19fdff2306fd28e7938375d6b775faf5353f1e227dca7a13ef0d6bd6e29719b8" exitCode=0 Jul 06 20:35:26.321091 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:26.321007 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sppzx" event={"ID":"114fe0eb-e34e-4ae2-800c-abcb04f50f4a","Type":"ContainerDied","Data":"19fdff2306fd28e7938375d6b775faf5353f1e227dca7a13ef0d6bd6e29719b8"} Jul 06 20:35:26.336309 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:26.336283 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:35:27.058086 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:27.058046 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-n6892" Jul 06 20:35:27.058264 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:27.058225 2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 06 20:35:27.058749 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:27.058705 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-n6892" Jul 06 20:35:27.092829 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:27.092796 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r7cf" Jul 06 20:35:27.092999 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:27.092907 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r7cf" podUID="872de884-2edf-4de9-8ad6-2bc963363808" Jul 06 20:35:27.092999 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:27.092927 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjfls" Jul 06 20:35:27.093076 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:27.093033 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mjfls" podUID="b5620d06-ce9a-457c-8636-a60ad8234202" Jul 06 20:35:27.326850 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:27.326772 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 20:35:27.327571 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:27.327251 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" event={"ID":"1dedccb7-cae9-4846-9304-7abe0812a0a2","Type":"ContainerStarted","Data":"1a4643c5f7178abd3b1a20713ec351814b0af29a1fb5eb96ae9f76fa79e4a982"} Jul 06 20:35:27.327571 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:27.327280 2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 06 20:35:27.327571 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:27.327449 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:35:27.343049 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:27.343021 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:35:27.373842 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:27.373790 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" podStartSLOduration=10.768393246 podStartE2EDuration="30.373773718s" totalImagesPullingTime="19.605380472s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:27.37356594 +0000 UTC m=+29.790815381" watchObservedRunningTime="2026-07-06 20:35:27.373773718 +0000 UTC m=+29.791023147" Jul 06 20:35:28.097154 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:28.097060 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkfp" Jul 06 20:35:28.097292 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:28.097193 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkfp" podUID="3e34520c-432d-4ad4-a08a-3bcf6b082abc" Jul 06 20:35:28.331004 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:28.330974 2562 generic.go:356] "Generic (PLEG): container finished" podID="114fe0eb-e34e-4ae2-800c-abcb04f50f4a" containerID="40b14565b5d04ff84ffbaf1a5467ae5d1bdf031db93e9bb11161a5dce2b5f5c5" exitCode=0 Jul 06 20:35:28.331650 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:28.331057 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sppzx" event={"ID":"114fe0eb-e34e-4ae2-800c-abcb04f50f4a","Type":"ContainerDied","Data":"40b14565b5d04ff84ffbaf1a5467ae5d1bdf031db93e9bb11161a5dce2b5f5c5"} Jul 06 20:35:28.331650 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:28.331124 2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 06 20:35:28.364237 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:28.364157 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4r7cf"] Jul 06 20:35:28.364367 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:28.364274 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r7cf" Jul 06 20:35:28.364400 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:28.364381 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r7cf" podUID="872de884-2edf-4de9-8ad6-2bc963363808" Jul 06 20:35:28.370730 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:28.370545 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gvkfp"] Jul 06 20:35:28.370906 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:28.370855 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkfp" Jul 06 20:35:28.371118 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:28.371021 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkfp" podUID="3e34520c-432d-4ad4-a08a-3bcf6b082abc" Jul 06 20:35:28.371280 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:28.371256 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mjfls"] Jul 06 20:35:28.371397 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:28.371382 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjfls" Jul 06 20:35:28.371563 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:28.371536 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mjfls" podUID="b5620d06-ce9a-457c-8636-a60ad8234202" Jul 06 20:35:28.515536 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:28.515352 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:35:29.335237 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:29.335203 2562 generic.go:356] "Generic (PLEG): container finished" podID="114fe0eb-e34e-4ae2-800c-abcb04f50f4a" containerID="01a34837ebb79291f2c18846dfd4e12b64fdf83ec7e5f51fcec1913a50b087ba" exitCode=0 Jul 06 20:35:29.335615 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:29.335284 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sppzx" event={"ID":"114fe0eb-e34e-4ae2-800c-abcb04f50f4a","Type":"ContainerDied","Data":"01a34837ebb79291f2c18846dfd4e12b64fdf83ec7e5f51fcec1913a50b087ba"} Jul 06 20:35:30.093108 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:30.093024 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjfls" Jul 06 20:35:30.093263 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:30.093024 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r7cf" Jul 06 20:35:30.093263 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:30.093165 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mjfls" podUID="b5620d06-ce9a-457c-8636-a60ad8234202" Jul 06 20:35:30.093263 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:30.093024 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkfp" Jul 06 20:35:30.093263 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:30.093234 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r7cf" podUID="872de884-2edf-4de9-8ad6-2bc963363808" Jul 06 20:35:30.093433 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:30.093321 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkfp" podUID="3e34520c-432d-4ad4-a08a-3bcf6b082abc" Jul 06 20:35:30.354192 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:30.354096 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" podUID="1dedccb7-cae9-4846-9304-7abe0812a0a2" containerName="ovnkube-controller" probeResult="failure" output="" Jul 06 20:35:30.813577 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:30.813274 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng2r9\" (UniqueName: \"kubernetes.io/projected/3e34520c-432d-4ad4-a08a-3bcf6b082abc-kube-api-access-ng2r9\") pod \"network-check-target-gvkfp\" (UID: \"3e34520c-432d-4ad4-a08a-3bcf6b082abc\") " pod="openshift-network-diagnostics/network-check-target-gvkfp" Jul 06 20:35:30.813577 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:30.813341 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5620d06-ce9a-457c-8636-a60ad8234202-metrics-certs\") pod \"network-metrics-daemon-mjfls\" (UID: \"b5620d06-ce9a-457c-8636-a60ad8234202\") " pod="openshift-multus/network-metrics-daemon-mjfls" Jul 06 20:35:30.813577 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:30.813381 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/872de884-2edf-4de9-8ad6-2bc963363808-original-pull-secret\") pod \"global-pull-secret-syncer-4r7cf\" (UID: \"872de884-2edf-4de9-8ad6-2bc963363808\") " pod="kube-system/global-pull-secret-syncer-4r7cf" Jul 06 20:35:30.813577 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:30.813449 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:35:30.813577 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:30.813471 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:35:30.813577 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:30.813483 2562 projected.go:196] Error preparing data for projected volume kube-api-access-ng2r9 for pod openshift-network-diagnostics/network-check-target-gvkfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:35:30.813577 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:30.813489 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:35:30.813577 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:30.813541 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e34520c-432d-4ad4-a08a-3bcf6b082abc-kube-api-access-ng2r9 podName:3e34520c-432d-4ad4-a08a-3bcf6b082abc nodeName:}" failed. No retries permitted until 2026-07-06 20:36:02.813522115 +0000 UTC m=+65.230771542 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ng2r9" (UniqueName: "kubernetes.io/projected/3e34520c-432d-4ad4-a08a-3bcf6b082abc-kube-api-access-ng2r9") pod "network-check-target-gvkfp" (UID: "3e34520c-432d-4ad4-a08a-3bcf6b082abc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:35:30.813577 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:30.813563 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872de884-2edf-4de9-8ad6-2bc963363808-original-pull-secret podName:872de884-2edf-4de9-8ad6-2bc963363808 nodeName:}" failed. No retries permitted until 2026-07-06 20:36:02.813552883 +0000 UTC m=+65.230802296 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/872de884-2edf-4de9-8ad6-2bc963363808-original-pull-secret") pod "global-pull-secret-syncer-4r7cf" (UID: "872de884-2edf-4de9-8ad6-2bc963363808") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:35:30.813577 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:30.813585 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:35:30.814231 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:30.813620 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5620d06-ce9a-457c-8636-a60ad8234202-metrics-certs podName:b5620d06-ce9a-457c-8636-a60ad8234202 nodeName:}" failed. No retries permitted until 2026-07-06 20:36:02.813607459 +0000 UTC m=+65.230856869 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5620d06-ce9a-457c-8636-a60ad8234202-metrics-certs") pod "network-metrics-daemon-mjfls" (UID: "b5620d06-ce9a-457c-8636-a60ad8234202") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:35:32.092941 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:32.092904 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkfp" Jul 06 20:35:32.093413 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:32.092954 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjfls" Jul 06 20:35:32.093413 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:32.092904 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r7cf" Jul 06 20:35:32.093413 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:32.093036 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvkfp" podUID="3e34520c-432d-4ad4-a08a-3bcf6b082abc" Jul 06 20:35:32.093413 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:32.093116 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r7cf" podUID="872de884-2edf-4de9-8ad6-2bc963363808" Jul 06 20:35:32.093413 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:32.093217 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mjfls" podUID="b5620d06-ce9a-457c-8636-a60ad8234202" Jul 06 20:35:32.389224 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:32.389196 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-77.ec2.internal" event="NodeReady" Jul 06 20:35:32.389490 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:32.389361 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 20:35:32.455011 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:32.454974 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2p2vp"] Jul 06 20:35:32.472787 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:32.472751 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lk74h"] Jul 06 20:35:32.473004 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:32.472912 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2p2vp" Jul 06 20:35:32.475691 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:32.475487 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 20:35:32.475691 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:32.475539 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dqcct\"" Jul 06 20:35:32.475908 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:32.475758 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 20:35:32.489029 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:32.489000 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lk74h"] Jul 06 20:35:32.489203 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:32.489112 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lk74h" Jul 06 20:35:32.489203 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:32.489151 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2p2vp"] Jul 06 20:35:32.492451 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:32.492389 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 20:35:32.492952 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:32.492934 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 20:35:32.493094 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:32.492942 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-r4sgm\"" Jul 06 20:35:32.493199 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:32.493184 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 20:35:32.626804 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:32.626765 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hspjp\" (UniqueName: \"kubernetes.io/projected/778034a9-e32b-4305-bdc7-885c6393fcba-kube-api-access-hspjp\") pod \"dns-default-2p2vp\" (UID: \"778034a9-e32b-4305-bdc7-885c6393fcba\") " pod="openshift-dns/dns-default-2p2vp" Jul 06 20:35:32.626804 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:32.626813 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84p6r\" (UniqueName: \"kubernetes.io/projected/737b46c8-48bb-4732-858d-bec540223122-kube-api-access-84p6r\") pod \"ingress-canary-lk74h\" (UID: \"737b46c8-48bb-4732-858d-bec540223122\") " pod="openshift-ingress-canary/ingress-canary-lk74h" Jul 06 20:35:32.627161 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:32.626873 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/778034a9-e32b-4305-bdc7-885c6393fcba-config-volume\") pod \"dns-default-2p2vp\" (UID: \"778034a9-e32b-4305-bdc7-885c6393fcba\") " pod="openshift-dns/dns-default-2p2vp" Jul 06 20:35:32.627161 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:32.626949 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/737b46c8-48bb-4732-858d-bec540223122-cert\") pod \"ingress-canary-lk74h\" (UID: \"737b46c8-48bb-4732-858d-bec540223122\") " pod="openshift-ingress-canary/ingress-canary-lk74h" Jul 06 20:35:32.627161 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:32.626977 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/778034a9-e32b-4305-bdc7-885c6393fcba-metrics-tls\") pod \"dns-default-2p2vp\" (UID: \"778034a9-e32b-4305-bdc7-885c6393fcba\") " pod="openshift-dns/dns-default-2p2vp" Jul 06 20:35:32.627161 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:32.627040 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/778034a9-e32b-4305-bdc7-885c6393fcba-tmp-dir\") pod \"dns-default-2p2vp\" (UID: \"778034a9-e32b-4305-bdc7-885c6393fcba\") " pod="openshift-dns/dns-default-2p2vp" Jul 06 20:35:32.728150 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:32.728071 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/778034a9-e32b-4305-bdc7-885c6393fcba-tmp-dir\") pod \"dns-default-2p2vp\" (UID: \"778034a9-e32b-4305-bdc7-885c6393fcba\") " pod="openshift-dns/dns-default-2p2vp" Jul 06 20:35:32.728150 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:32.728118 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hspjp\" (UniqueName: \"kubernetes.io/projected/778034a9-e32b-4305-bdc7-885c6393fcba-kube-api-access-hspjp\") pod \"dns-default-2p2vp\" (UID: \"778034a9-e32b-4305-bdc7-885c6393fcba\") " pod="openshift-dns/dns-default-2p2vp" Jul 06 20:35:32.728150 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:32.728143 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84p6r\" (UniqueName: \"kubernetes.io/projected/737b46c8-48bb-4732-858d-bec540223122-kube-api-access-84p6r\") pod \"ingress-canary-lk74h\" (UID: \"737b46c8-48bb-4732-858d-bec540223122\") " pod="openshift-ingress-canary/ingress-canary-lk74h" Jul 06 20:35:32.728536 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:32.728191 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/778034a9-e32b-4305-bdc7-885c6393fcba-config-volume\") pod \"dns-default-2p2vp\" (UID: \"778034a9-e32b-4305-bdc7-885c6393fcba\") " pod="openshift-dns/dns-default-2p2vp" Jul 06 20:35:32.728536 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:32.728228 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/737b46c8-48bb-4732-858d-bec540223122-cert\") pod \"ingress-canary-lk74h\" (UID: \"737b46c8-48bb-4732-858d-bec540223122\") " pod="openshift-ingress-canary/ingress-canary-lk74h" Jul 06 20:35:32.728536 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:32.728254 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/778034a9-e32b-4305-bdc7-885c6393fcba-metrics-tls\") pod \"dns-default-2p2vp\" (UID: \"778034a9-e32b-4305-bdc7-885c6393fcba\") " pod="openshift-dns/dns-default-2p2vp" Jul 06 20:35:32.728536 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:32.728362 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:35:32.728536 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:32.728431 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/778034a9-e32b-4305-bdc7-885c6393fcba-metrics-tls podName:778034a9-e32b-4305-bdc7-885c6393fcba nodeName:}" failed. No retries permitted until 2026-07-06 20:35:33.22841324 +0000 UTC m=+35.645662647 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/778034a9-e32b-4305-bdc7-885c6393fcba-metrics-tls") pod "dns-default-2p2vp" (UID: "778034a9-e32b-4305-bdc7-885c6393fcba") : secret "dns-default-metrics-tls" not found Jul 06 20:35:32.728751 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:32.728538 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/778034a9-e32b-4305-bdc7-885c6393fcba-tmp-dir\") pod \"dns-default-2p2vp\" (UID: \"778034a9-e32b-4305-bdc7-885c6393fcba\") " pod="openshift-dns/dns-default-2p2vp" Jul 06 20:35:32.728794 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:32.728779 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/778034a9-e32b-4305-bdc7-885c6393fcba-config-volume\") pod \"dns-default-2p2vp\" (UID: \"778034a9-e32b-4305-bdc7-885c6393fcba\") " pod="openshift-dns/dns-default-2p2vp" Jul 06 20:35:32.733248 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:32.733227 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/737b46c8-48bb-4732-858d-bec540223122-cert\") pod \"ingress-canary-lk74h\" (UID: \"737b46c8-48bb-4732-858d-bec540223122\") " pod="openshift-ingress-canary/ingress-canary-lk74h" Jul 06 20:35:32.738661 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:32.738629 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84p6r\" (UniqueName: \"kubernetes.io/projected/737b46c8-48bb-4732-858d-bec540223122-kube-api-access-84p6r\") pod \"ingress-canary-lk74h\" (UID: \"737b46c8-48bb-4732-858d-bec540223122\") " pod="openshift-ingress-canary/ingress-canary-lk74h" Jul 06 20:35:32.738817 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:32.738766 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hspjp\" (UniqueName: \"kubernetes.io/projected/778034a9-e32b-4305-bdc7-885c6393fcba-kube-api-access-hspjp\") pod \"dns-default-2p2vp\" (UID: \"778034a9-e32b-4305-bdc7-885c6393fcba\") " pod="openshift-dns/dns-default-2p2vp" Jul 06 20:35:32.797950 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:32.797910 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lk74h" Jul 06 20:35:33.232347 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:33.232306 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/778034a9-e32b-4305-bdc7-885c6393fcba-metrics-tls\") pod \"dns-default-2p2vp\" (UID: \"778034a9-e32b-4305-bdc7-885c6393fcba\") " pod="openshift-dns/dns-default-2p2vp" Jul 06 20:35:33.232764 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:33.232463 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:35:33.232764 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:33.232541 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/778034a9-e32b-4305-bdc7-885c6393fcba-metrics-tls podName:778034a9-e32b-4305-bdc7-885c6393fcba nodeName:}" failed. No retries permitted until 2026-07-06 20:35:34.232517004 +0000 UTC m=+36.649766433 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/778034a9-e32b-4305-bdc7-885c6393fcba-metrics-tls") pod "dns-default-2p2vp" (UID: "778034a9-e32b-4305-bdc7-885c6393fcba") : secret "dns-default-metrics-tls" not found Jul 06 20:35:33.675892 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:33.675697 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lk74h"] Jul 06 20:35:33.704333 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:35:33.704300 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod737b46c8_48bb_4732_858d_bec540223122.slice/crio-266aa54b1331a4ed1af898f0fdd8e1289b5e79725b80b745cfbd4a5bef88bcc9 WatchSource:0}: Error finding container 266aa54b1331a4ed1af898f0fdd8e1289b5e79725b80b745cfbd4a5bef88bcc9: Status 404 returned error can't find the container with id 266aa54b1331a4ed1af898f0fdd8e1289b5e79725b80b745cfbd4a5bef88bcc9 Jul 06 20:35:34.092738 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:34.092653 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkfp" Jul 06 20:35:34.092904 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:34.092653 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjfls" Jul 06 20:35:34.092904 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:34.092803 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r7cf" Jul 06 20:35:34.096725 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:34.096692 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 20:35:34.096725 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:34.096712 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6bf8b\"" Jul 06 20:35:34.096937 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:34.096737 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 20:35:34.096937 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:34.096693 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 20:35:34.096937 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:34.096712 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dl572\"" Jul 06 20:35:34.096937 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:34.096693 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 20:35:34.238918 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:34.238870 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/778034a9-e32b-4305-bdc7-885c6393fcba-metrics-tls\") pod \"dns-default-2p2vp\" (UID: \"778034a9-e32b-4305-bdc7-885c6393fcba\") " pod="openshift-dns/dns-default-2p2vp" Jul 06 20:35:34.239375 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:34.239030 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:35:34.239375 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:34.239099 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/778034a9-e32b-4305-bdc7-885c6393fcba-metrics-tls podName:778034a9-e32b-4305-bdc7-885c6393fcba nodeName:}" failed. No retries permitted until 2026-07-06 20:35:36.239079661 +0000 UTC m=+38.656329082 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/778034a9-e32b-4305-bdc7-885c6393fcba-metrics-tls") pod "dns-default-2p2vp" (UID: "778034a9-e32b-4305-bdc7-885c6393fcba") : secret "dns-default-metrics-tls" not found Jul 06 20:35:34.350626 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:34.350542 2562 generic.go:356] "Generic (PLEG): container finished" podID="114fe0eb-e34e-4ae2-800c-abcb04f50f4a" containerID="7794e0511cc609706d2892d15c26a94dbbf7161d7be73240f792074a66a4a55d" exitCode=0 Jul 06 20:35:34.350783 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:34.350619 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sppzx" event={"ID":"114fe0eb-e34e-4ae2-800c-abcb04f50f4a","Type":"ContainerDied","Data":"7794e0511cc609706d2892d15c26a94dbbf7161d7be73240f792074a66a4a55d"} Jul 06 20:35:34.351802 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:34.351775 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lk74h" event={"ID":"737b46c8-48bb-4732-858d-bec540223122","Type":"ContainerStarted","Data":"266aa54b1331a4ed1af898f0fdd8e1289b5e79725b80b745cfbd4a5bef88bcc9"} Jul 06 20:35:35.357872 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:35.357840 2562 generic.go:356] "Generic (PLEG): container finished" podID="114fe0eb-e34e-4ae2-800c-abcb04f50f4a" containerID="3e0cedcd5e556339406be60537285ae27464e9b3f526675a6868d411a4b6aa30" exitCode=0 Jul 06 20:35:35.358404 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:35.357924 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sppzx" event={"ID":"114fe0eb-e34e-4ae2-800c-abcb04f50f4a","Type":"ContainerDied","Data":"3e0cedcd5e556339406be60537285ae27464e9b3f526675a6868d411a4b6aa30"} Jul 06 20:35:36.257131 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:36.257081 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/778034a9-e32b-4305-bdc7-885c6393fcba-metrics-tls\") pod \"dns-default-2p2vp\" (UID: \"778034a9-e32b-4305-bdc7-885c6393fcba\") " pod="openshift-dns/dns-default-2p2vp" Jul 06 20:35:36.257305 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:36.257225 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:35:36.257305 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:36.257284 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/778034a9-e32b-4305-bdc7-885c6393fcba-metrics-tls podName:778034a9-e32b-4305-bdc7-885c6393fcba nodeName:}" failed. No retries permitted until 2026-07-06 20:35:40.25726778 +0000 UTC m=+42.674517203 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/778034a9-e32b-4305-bdc7-885c6393fcba-metrics-tls") pod "dns-default-2p2vp" (UID: "778034a9-e32b-4305-bdc7-885c6393fcba") : secret "dns-default-metrics-tls" not found Jul 06 20:35:36.363170 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:36.363136 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sppzx" event={"ID":"114fe0eb-e34e-4ae2-800c-abcb04f50f4a","Type":"ContainerStarted","Data":"fad27ac8c9abb6cd9a732c0ed4aeb6e244b63d53516053804e3285640f9af939"} Jul 06 20:35:36.387783 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:36.387728 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sppzx" podStartSLOduration=7.9330419370000005 podStartE2EDuration="39.387713751s" totalImagesPullingTime="31.454671814s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:34:57 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:36.387344599 +0000 UTC m=+38.804594028" watchObservedRunningTime="2026-07-06 20:35:36.387713751 +0000 UTC m=+38.804963179" Jul 06 20:35:37.366976 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:37.366939 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lk74h" event={"ID":"737b46c8-48bb-4732-858d-bec540223122","Type":"ContainerStarted","Data":"7b5f9cbd79b71e2d0a2124e62c10af7324a284c79da67e0822153b54e59fd184"} Jul 06 20:35:37.386374 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:37.386314 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lk74h" podStartSLOduration=2.588428441 podStartE2EDuration="5.386296736s" totalImagesPullingTime="2.797868295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:35:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:37.385854186 +0000 UTC m=+39.803103614" watchObservedRunningTime="2026-07-06 20:35:37.386296736 +0000 UTC m=+39.803546164" Jul 06 20:35:40.287872 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:40.287835 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/778034a9-e32b-4305-bdc7-885c6393fcba-metrics-tls\") pod \"dns-default-2p2vp\" (UID: \"778034a9-e32b-4305-bdc7-885c6393fcba\") " pod="openshift-dns/dns-default-2p2vp" Jul 06 20:35:40.288286 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:40.287985 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:35:40.288286 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:40.288047 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/778034a9-e32b-4305-bdc7-885c6393fcba-metrics-tls podName:778034a9-e32b-4305-bdc7-885c6393fcba nodeName:}" failed. No retries permitted until 2026-07-06 20:35:48.288030983 +0000 UTC m=+50.705280395 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/778034a9-e32b-4305-bdc7-885c6393fcba-metrics-tls") pod "dns-default-2p2vp" (UID: "778034a9-e32b-4305-bdc7-885c6393fcba") : secret "dns-default-metrics-tls" not found Jul 06 20:35:48.344067 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:48.344013 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/778034a9-e32b-4305-bdc7-885c6393fcba-metrics-tls\") pod \"dns-default-2p2vp\" (UID: \"778034a9-e32b-4305-bdc7-885c6393fcba\") " pod="openshift-dns/dns-default-2p2vp" Jul 06 20:35:48.344525 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:48.344168 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:35:48.344525 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:48.344231 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/778034a9-e32b-4305-bdc7-885c6393fcba-metrics-tls podName:778034a9-e32b-4305-bdc7-885c6393fcba nodeName:}" failed. No retries permitted until 2026-07-06 20:36:04.344215435 +0000 UTC m=+66.761464842 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/778034a9-e32b-4305-bdc7-885c6393fcba-metrics-tls") pod "dns-default-2p2vp" (UID: "778034a9-e32b-4305-bdc7-885c6393fcba") : secret "dns-default-metrics-tls" not found Jul 06 20:35:54.933587 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.933543 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85sm8"] Jul 06 20:35:54.936500 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.936477 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-kjjpn"] Jul 06 20:35:54.936645 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.936603 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85sm8" Jul 06 20:35:54.940147 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.940113 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5vr6p\"" Jul 06 20:35:54.940289 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.940146 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 06 20:35:54.940341 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.940303 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 20:35:54.940571 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.940492 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 20:35:54.941090 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.941068 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tmvn6"] Jul 06 20:35:54.941237 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.941216 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-kjjpn" Jul 06 20:35:54.941907 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.941870 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 06 20:35:54.942941 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.942922 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tmvn6" Jul 06 20:35:54.947420 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.947399 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 06 20:35:54.947575 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.947403 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 20:35:54.947700 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.947424 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 06 20:35:54.947700 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.947648 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 20:35:54.947827 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.947810 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-gptpg\"" Jul 06 20:35:54.947897 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.947454 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 06 20:35:54.947897 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.947437 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:35:54.947897 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.947720 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 06 20:35:54.948330 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.947721 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 06 20:35:54.948330 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.947523 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-br69b\"" Jul 06 20:35:54.951771 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.951750 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 06 20:35:54.957491 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.956999 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-kjjpn"] Jul 06 20:35:54.958145 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.958122 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85sm8"] Jul 06 20:35:54.958732 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.958715 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tmvn6"] Jul 06 20:35:54.989502 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.989468 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0f6cd921-5c67-4016-90a5-98c2ad891aa8-snapshots\") pod \"insights-operator-5c847dcfc4-kjjpn\" (UID: \"0f6cd921-5c67-4016-90a5-98c2ad891aa8\") " pod="openshift-insights/insights-operator-5c847dcfc4-kjjpn" Jul 06 20:35:54.989681 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.989513 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f6cd921-5c67-4016-90a5-98c2ad891aa8-tmp\") pod \"insights-operator-5c847dcfc4-kjjpn\" (UID: \"0f6cd921-5c67-4016-90a5-98c2ad891aa8\") " pod="openshift-insights/insights-operator-5c847dcfc4-kjjpn" Jul 06 20:35:54.989681 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.989530 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/50196b0e-a0bc-4f0b-a51d-8e789a9a890d-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-85sm8\" (UID: \"50196b0e-a0bc-4f0b-a51d-8e789a9a890d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85sm8" Jul 06 20:35:54.989681 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.989547 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhnx6\" (UniqueName: \"kubernetes.io/projected/e9ef32e7-80be-4b87-8f9b-e1394c0022f8-kube-api-access-qhnx6\") pod \"kube-storage-version-migrator-operator-846bf668f7-tmvn6\" (UID: \"e9ef32e7-80be-4b87-8f9b-e1394c0022f8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tmvn6" Jul 06 20:35:54.989681 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.989598 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e9ef32e7-80be-4b87-8f9b-e1394c0022f8-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-tmvn6\" (UID: \"e9ef32e7-80be-4b87-8f9b-e1394c0022f8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tmvn6" Jul 06 20:35:54.989681 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.989626 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpgtn\" (UniqueName: \"kubernetes.io/projected/50196b0e-a0bc-4f0b-a51d-8e789a9a890d-kube-api-access-fpgtn\") pod \"cluster-monitoring-operator-64786d9cbb-85sm8\" (UID: \"50196b0e-a0bc-4f0b-a51d-8e789a9a890d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85sm8" Jul 06 20:35:54.989681 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.989653 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f6cd921-5c67-4016-90a5-98c2ad891aa8-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-kjjpn\" (UID: \"0f6cd921-5c67-4016-90a5-98c2ad891aa8\") " pod="openshift-insights/insights-operator-5c847dcfc4-kjjpn" Jul 06 20:35:54.989681 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.989675 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0f6cd921-5c67-4016-90a5-98c2ad891aa8-serving-cert\") pod \"insights-operator-5c847dcfc4-kjjpn\" (UID: \"0f6cd921-5c67-4016-90a5-98c2ad891aa8\") " pod="openshift-insights/insights-operator-5c847dcfc4-kjjpn" Jul 06 20:35:54.990020 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.989690 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghfn9\" (UniqueName: \"kubernetes.io/projected/0f6cd921-5c67-4016-90a5-98c2ad891aa8-kube-api-access-ghfn9\") pod \"insights-operator-5c847dcfc4-kjjpn\" (UID: \"0f6cd921-5c67-4016-90a5-98c2ad891aa8\") " pod="openshift-insights/insights-operator-5c847dcfc4-kjjpn" Jul 06 20:35:54.990020 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.989723 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/50196b0e-a0bc-4f0b-a51d-8e789a9a890d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-85sm8\" (UID: \"50196b0e-a0bc-4f0b-a51d-8e789a9a890d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85sm8" Jul 06 20:35:54.990020 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.989840 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e9ef32e7-80be-4b87-8f9b-e1394c0022f8-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-tmvn6\" (UID: \"e9ef32e7-80be-4b87-8f9b-e1394c0022f8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tmvn6" Jul 06 20:35:54.990020 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:54.989900 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f6cd921-5c67-4016-90a5-98c2ad891aa8-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-kjjpn\" (UID: \"0f6cd921-5c67-4016-90a5-98c2ad891aa8\") " pod="openshift-insights/insights-operator-5c847dcfc4-kjjpn" Jul 06 20:35:55.036610 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.036571 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5bd995454f-v4b97"] Jul 06 20:35:55.038558 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.038542 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bd995454f-v4b97" Jul 06 20:35:55.041975 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.041956 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 20:35:55.042245 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.042230 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nc576\"" Jul 06 20:35:55.042372 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.042357 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 20:35:55.042710 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.042694 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 20:35:55.047494 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.047464 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 20:35:55.065661 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.065605 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bd995454f-v4b97"] Jul 06 20:35:55.090680 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.090640 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/50196b0e-a0bc-4f0b-a51d-8e789a9a890d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-85sm8\" (UID: \"50196b0e-a0bc-4f0b-a51d-8e789a9a890d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85sm8" Jul 06 20:35:55.090680 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.090680 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8da873c1-d92e-4dec-b980-e470b5263d61-installation-pull-secrets\") pod \"image-registry-5bd995454f-v4b97\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " pod="openshift-image-registry/image-registry-5bd995454f-v4b97" Jul 06 20:35:55.090924 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.090705 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8da873c1-d92e-4dec-b980-e470b5263d61-image-registry-private-configuration\") pod \"image-registry-5bd995454f-v4b97\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " pod="openshift-image-registry/image-registry-5bd995454f-v4b97" Jul 06 20:35:55.090924 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:55.090825 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 20:35:55.090924 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:55.090907 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50196b0e-a0bc-4f0b-a51d-8e789a9a890d-cluster-monitoring-operator-tls podName:50196b0e-a0bc-4f0b-a51d-8e789a9a890d nodeName:}" failed. No retries permitted until 2026-07-06 20:35:55.590869749 +0000 UTC m=+58.008119159 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/50196b0e-a0bc-4f0b-a51d-8e789a9a890d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-85sm8" (UID: "50196b0e-a0bc-4f0b-a51d-8e789a9a890d") : secret "cluster-monitoring-operator-tls" not found Jul 06 20:35:55.091053 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.090936 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e9ef32e7-80be-4b87-8f9b-e1394c0022f8-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-tmvn6\" (UID: \"e9ef32e7-80be-4b87-8f9b-e1394c0022f8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tmvn6" Jul 06 20:35:55.091053 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.090964 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f6cd921-5c67-4016-90a5-98c2ad891aa8-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-kjjpn\" (UID: \"0f6cd921-5c67-4016-90a5-98c2ad891aa8\") " pod="openshift-insights/insights-operator-5c847dcfc4-kjjpn" Jul 06 20:35:55.091053 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.090985 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0f6cd921-5c67-4016-90a5-98c2ad891aa8-snapshots\") pod \"insights-operator-5c847dcfc4-kjjpn\" (UID: \"0f6cd921-5c67-4016-90a5-98c2ad891aa8\") " pod="openshift-insights/insights-operator-5c847dcfc4-kjjpn" Jul 06 20:35:55.091053 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.091012 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f6cd921-5c67-4016-90a5-98c2ad891aa8-tmp\") pod \"insights-operator-5c847dcfc4-kjjpn\" (UID: \"0f6cd921-5c67-4016-90a5-98c2ad891aa8\") " pod="openshift-insights/insights-operator-5c847dcfc4-kjjpn" Jul 06 20:35:55.091053 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.091036 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/50196b0e-a0bc-4f0b-a51d-8e789a9a890d-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-85sm8\" (UID: \"50196b0e-a0bc-4f0b-a51d-8e789a9a890d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85sm8" Jul 06 20:35:55.091275 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.091061 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhnx6\" (UniqueName: \"kubernetes.io/projected/e9ef32e7-80be-4b87-8f9b-e1394c0022f8-kube-api-access-qhnx6\") pod \"kube-storage-version-migrator-operator-846bf668f7-tmvn6\" (UID: \"e9ef32e7-80be-4b87-8f9b-e1394c0022f8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tmvn6" Jul 06 20:35:55.091275 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.091087 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8da873c1-d92e-4dec-b980-e470b5263d61-trusted-ca\") pod \"image-registry-5bd995454f-v4b97\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " pod="openshift-image-registry/image-registry-5bd995454f-v4b97" Jul 06 20:35:55.091275 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.091113 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8da873c1-d92e-4dec-b980-e470b5263d61-bound-sa-token\") pod \"image-registry-5bd995454f-v4b97\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " pod="openshift-image-registry/image-registry-5bd995454f-v4b97" Jul 06 20:35:55.091275 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.091138 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jv6p\" (UniqueName: \"kubernetes.io/projected/8da873c1-d92e-4dec-b980-e470b5263d61-kube-api-access-8jv6p\") pod \"image-registry-5bd995454f-v4b97\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " pod="openshift-image-registry/image-registry-5bd995454f-v4b97" Jul 06 20:35:55.091275 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.091182 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e9ef32e7-80be-4b87-8f9b-e1394c0022f8-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-tmvn6\" (UID: \"e9ef32e7-80be-4b87-8f9b-e1394c0022f8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tmvn6" Jul 06 20:35:55.091520 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.091403 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8da873c1-d92e-4dec-b980-e470b5263d61-ca-trust-extracted\") pod \"image-registry-5bd995454f-v4b97\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " pod="openshift-image-registry/image-registry-5bd995454f-v4b97" Jul 06 20:35:55.091520 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.091451 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpgtn\" (UniqueName: \"kubernetes.io/projected/50196b0e-a0bc-4f0b-a51d-8e789a9a890d-kube-api-access-fpgtn\") pod \"cluster-monitoring-operator-64786d9cbb-85sm8\" (UID: \"50196b0e-a0bc-4f0b-a51d-8e789a9a890d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85sm8" Jul 06 20:35:55.091520 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.091465 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f6cd921-5c67-4016-90a5-98c2ad891aa8-tmp\") pod \"insights-operator-5c847dcfc4-kjjpn\" (UID: \"0f6cd921-5c67-4016-90a5-98c2ad891aa8\") " pod="openshift-insights/insights-operator-5c847dcfc4-kjjpn" Jul 06 20:35:55.091520 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.091498 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f6cd921-5c67-4016-90a5-98c2ad891aa8-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-kjjpn\" (UID: \"0f6cd921-5c67-4016-90a5-98c2ad891aa8\") " pod="openshift-insights/insights-operator-5c847dcfc4-kjjpn" Jul 06 20:35:55.091663 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.091530 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0f6cd921-5c67-4016-90a5-98c2ad891aa8-serving-cert\") pod \"insights-operator-5c847dcfc4-kjjpn\" (UID: \"0f6cd921-5c67-4016-90a5-98c2ad891aa8\") " pod="openshift-insights/insights-operator-5c847dcfc4-kjjpn" Jul 06 20:35:55.091663 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.091558 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghfn9\" (UniqueName: \"kubernetes.io/projected/0f6cd921-5c67-4016-90a5-98c2ad891aa8-kube-api-access-ghfn9\") pod \"insights-operator-5c847dcfc4-kjjpn\" (UID: \"0f6cd921-5c67-4016-90a5-98c2ad891aa8\") " pod="openshift-insights/insights-operator-5c847dcfc4-kjjpn" Jul 06 20:35:55.091663 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.091591 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8da873c1-d92e-4dec-b980-e470b5263d61-registry-certificates\") pod \"image-registry-5bd995454f-v4b97\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " pod="openshift-image-registry/image-registry-5bd995454f-v4b97" Jul 06 20:35:55.091663 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.091619 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8da873c1-d92e-4dec-b980-e470b5263d61-registry-tls\") pod \"image-registry-5bd995454f-v4b97\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " pod="openshift-image-registry/image-registry-5bd995454f-v4b97" Jul 06 20:35:55.092300 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.092273 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0f6cd921-5c67-4016-90a5-98c2ad891aa8-snapshots\") pod \"insights-operator-5c847dcfc4-kjjpn\" (UID: \"0f6cd921-5c67-4016-90a5-98c2ad891aa8\") " pod="openshift-insights/insights-operator-5c847dcfc4-kjjpn" Jul 06 20:35:55.092453 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.092431 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e9ef32e7-80be-4b87-8f9b-e1394c0022f8-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-tmvn6\" (UID: \"e9ef32e7-80be-4b87-8f9b-e1394c0022f8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tmvn6" Jul 06 20:35:55.092562 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.092430 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/50196b0e-a0bc-4f0b-a51d-8e789a9a890d-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-85sm8\" (UID: \"50196b0e-a0bc-4f0b-a51d-8e789a9a890d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85sm8" Jul 06 20:35:55.096235 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.092467 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f6cd921-5c67-4016-90a5-98c2ad891aa8-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-kjjpn\" (UID: \"0f6cd921-5c67-4016-90a5-98c2ad891aa8\") " pod="openshift-insights/insights-operator-5c847dcfc4-kjjpn" Jul 06 20:35:55.096235 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.094636 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f6cd921-5c67-4016-90a5-98c2ad891aa8-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-kjjpn\" (UID: \"0f6cd921-5c67-4016-90a5-98c2ad891aa8\") " pod="openshift-insights/insights-operator-5c847dcfc4-kjjpn" Jul 06 20:35:55.096612 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.096589 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e9ef32e7-80be-4b87-8f9b-e1394c0022f8-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-tmvn6\" (UID: \"e9ef32e7-80be-4b87-8f9b-e1394c0022f8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tmvn6" Jul 06 20:35:55.096724 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.096671 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0f6cd921-5c67-4016-90a5-98c2ad891aa8-serving-cert\") pod \"insights-operator-5c847dcfc4-kjjpn\" (UID: \"0f6cd921-5c67-4016-90a5-98c2ad891aa8\") " pod="openshift-insights/insights-operator-5c847dcfc4-kjjpn" Jul 06 20:35:55.102082 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.102054 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhnx6\" (UniqueName: \"kubernetes.io/projected/e9ef32e7-80be-4b87-8f9b-e1394c0022f8-kube-api-access-qhnx6\") pod \"kube-storage-version-migrator-operator-846bf668f7-tmvn6\" (UID: \"e9ef32e7-80be-4b87-8f9b-e1394c0022f8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tmvn6" Jul 06 20:35:55.102943 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.102922 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpgtn\" (UniqueName: \"kubernetes.io/projected/50196b0e-a0bc-4f0b-a51d-8e789a9a890d-kube-api-access-fpgtn\") pod \"cluster-monitoring-operator-64786d9cbb-85sm8\" (UID: \"50196b0e-a0bc-4f0b-a51d-8e789a9a890d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85sm8" Jul 06 20:35:55.102943 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.102930 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghfn9\" (UniqueName: \"kubernetes.io/projected/0f6cd921-5c67-4016-90a5-98c2ad891aa8-kube-api-access-ghfn9\") pod \"insights-operator-5c847dcfc4-kjjpn\" (UID: \"0f6cd921-5c67-4016-90a5-98c2ad891aa8\") " pod="openshift-insights/insights-operator-5c847dcfc4-kjjpn" Jul 06 20:35:55.193367 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.193271 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8da873c1-d92e-4dec-b980-e470b5263d61-trusted-ca\") pod \"image-registry-5bd995454f-v4b97\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " pod="openshift-image-registry/image-registry-5bd995454f-v4b97" Jul 06 20:35:55.193367 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.193312 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8da873c1-d92e-4dec-b980-e470b5263d61-bound-sa-token\") pod \"image-registry-5bd995454f-v4b97\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " pod="openshift-image-registry/image-registry-5bd995454f-v4b97" Jul 06 20:35:55.193367 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.193337 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jv6p\" (UniqueName: \"kubernetes.io/projected/8da873c1-d92e-4dec-b980-e470b5263d61-kube-api-access-8jv6p\") pod \"image-registry-5bd995454f-v4b97\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " pod="openshift-image-registry/image-registry-5bd995454f-v4b97" Jul 06 20:35:55.193845 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.193378 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8da873c1-d92e-4dec-b980-e470b5263d61-ca-trust-extracted\") pod \"image-registry-5bd995454f-v4b97\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " pod="openshift-image-registry/image-registry-5bd995454f-v4b97" Jul 06 20:35:55.193845 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.193425 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8da873c1-d92e-4dec-b980-e470b5263d61-registry-certificates\") pod \"image-registry-5bd995454f-v4b97\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " pod="openshift-image-registry/image-registry-5bd995454f-v4b97" Jul 06 20:35:55.193845 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.193450 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8da873c1-d92e-4dec-b980-e470b5263d61-registry-tls\") pod \"image-registry-5bd995454f-v4b97\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " pod="openshift-image-registry/image-registry-5bd995454f-v4b97" Jul 06 20:35:55.193845 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:55.193548 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:35:55.193845 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:55.193562 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bd995454f-v4b97: secret "image-registry-tls" not found Jul 06 20:35:55.193845 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.193608 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8da873c1-d92e-4dec-b980-e470b5263d61-installation-pull-secrets\") pod \"image-registry-5bd995454f-v4b97\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " pod="openshift-image-registry/image-registry-5bd995454f-v4b97" Jul 06 20:35:55.193845 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:55.193630 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8da873c1-d92e-4dec-b980-e470b5263d61-registry-tls podName:8da873c1-d92e-4dec-b980-e470b5263d61 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:55.693612209 +0000 UTC m=+58.110861631 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8da873c1-d92e-4dec-b980-e470b5263d61-registry-tls") pod "image-registry-5bd995454f-v4b97" (UID: "8da873c1-d92e-4dec-b980-e470b5263d61") : secret "image-registry-tls" not found Jul 06 20:35:55.193845 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.193674 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8da873c1-d92e-4dec-b980-e470b5263d61-image-registry-private-configuration\") pod \"image-registry-5bd995454f-v4b97\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " pod="openshift-image-registry/image-registry-5bd995454f-v4b97" Jul 06 20:35:55.194229 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.193855 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8da873c1-d92e-4dec-b980-e470b5263d61-ca-trust-extracted\") pod \"image-registry-5bd995454f-v4b97\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " pod="openshift-image-registry/image-registry-5bd995454f-v4b97" Jul 06 20:35:55.194229 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.194128 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8da873c1-d92e-4dec-b980-e470b5263d61-registry-certificates\") pod \"image-registry-5bd995454f-v4b97\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " pod="openshift-image-registry/image-registry-5bd995454f-v4b97" Jul 06 20:35:55.194437 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.194418 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8da873c1-d92e-4dec-b980-e470b5263d61-trusted-ca\") pod \"image-registry-5bd995454f-v4b97\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " pod="openshift-image-registry/image-registry-5bd995454f-v4b97" Jul 06 20:35:55.195895 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.195863 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8da873c1-d92e-4dec-b980-e470b5263d61-installation-pull-secrets\") pod \"image-registry-5bd995454f-v4b97\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " pod="openshift-image-registry/image-registry-5bd995454f-v4b97" Jul 06 20:35:55.196078 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.196058 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8da873c1-d92e-4dec-b980-e470b5263d61-image-registry-private-configuration\") pod \"image-registry-5bd995454f-v4b97\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " pod="openshift-image-registry/image-registry-5bd995454f-v4b97" Jul 06 20:35:55.204043 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.204014 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jv6p\" (UniqueName: \"kubernetes.io/projected/8da873c1-d92e-4dec-b980-e470b5263d61-kube-api-access-8jv6p\") pod \"image-registry-5bd995454f-v4b97\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " pod="openshift-image-registry/image-registry-5bd995454f-v4b97" Jul 06 20:35:55.204665 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.204641 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8da873c1-d92e-4dec-b980-e470b5263d61-bound-sa-token\") pod \"image-registry-5bd995454f-v4b97\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " pod="openshift-image-registry/image-registry-5bd995454f-v4b97" Jul 06 20:35:55.258772 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.258732 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-kjjpn" Jul 06 20:35:55.264537 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.264516 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tmvn6" Jul 06 20:35:55.391641 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.391612 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-kjjpn"] Jul 06 20:35:55.395050 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:35:55.395022 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f6cd921_5c67_4016_90a5_98c2ad891aa8.slice/crio-9efef4567dd45e5b950ad0f7bd14060a74f2a48a15960133b23ab95cbe3d428b WatchSource:0}: Error finding container 9efef4567dd45e5b950ad0f7bd14060a74f2a48a15960133b23ab95cbe3d428b: Status 404 returned error can't find the container with id 9efef4567dd45e5b950ad0f7bd14060a74f2a48a15960133b23ab95cbe3d428b Jul 06 20:35:55.407302 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.407269 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tmvn6"] Jul 06 20:35:55.409445 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.409407 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-kjjpn" event={"ID":"0f6cd921-5c67-4016-90a5-98c2ad891aa8","Type":"ContainerStarted","Data":"9efef4567dd45e5b950ad0f7bd14060a74f2a48a15960133b23ab95cbe3d428b"} Jul 06 20:35:55.411977 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:35:55.411955 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9ef32e7_80be_4b87_8f9b_e1394c0022f8.slice/crio-36827786f1117b0fd76c64b757fdbe071b38fd4265a2f72f4c2b8c8f984561f8 WatchSource:0}: Error finding container 36827786f1117b0fd76c64b757fdbe071b38fd4265a2f72f4c2b8c8f984561f8: Status 404 returned error can't find the container with id 36827786f1117b0fd76c64b757fdbe071b38fd4265a2f72f4c2b8c8f984561f8 Jul 06 20:35:55.596241 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.596138 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/50196b0e-a0bc-4f0b-a51d-8e789a9a890d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-85sm8\" (UID: \"50196b0e-a0bc-4f0b-a51d-8e789a9a890d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85sm8" Jul 06 20:35:55.596384 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:55.596289 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 20:35:55.596384 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:55.596359 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50196b0e-a0bc-4f0b-a51d-8e789a9a890d-cluster-monitoring-operator-tls podName:50196b0e-a0bc-4f0b-a51d-8e789a9a890d nodeName:}" failed. No retries permitted until 2026-07-06 20:35:56.596343645 +0000 UTC m=+59.013593053 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/50196b0e-a0bc-4f0b-a51d-8e789a9a890d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-85sm8" (UID: "50196b0e-a0bc-4f0b-a51d-8e789a9a890d") : secret "cluster-monitoring-operator-tls" not found Jul 06 20:35:55.696798 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:55.696752 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8da873c1-d92e-4dec-b980-e470b5263d61-registry-tls\") pod \"image-registry-5bd995454f-v4b97\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " pod="openshift-image-registry/image-registry-5bd995454f-v4b97" Jul 06 20:35:55.696997 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:55.696922 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:35:55.696997 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:55.696935 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bd995454f-v4b97: secret "image-registry-tls" not found Jul 06 20:35:55.696997 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:55.696992 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8da873c1-d92e-4dec-b980-e470b5263d61-registry-tls podName:8da873c1-d92e-4dec-b980-e470b5263d61 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:56.696977075 +0000 UTC m=+59.114226481 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8da873c1-d92e-4dec-b980-e470b5263d61-registry-tls") pod "image-registry-5bd995454f-v4b97" (UID: "8da873c1-d92e-4dec-b980-e470b5263d61") : secret "image-registry-tls" not found Jul 06 20:35:56.413868 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:56.413824 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tmvn6" event={"ID":"e9ef32e7-80be-4b87-8f9b-e1394c0022f8","Type":"ContainerStarted","Data":"36827786f1117b0fd76c64b757fdbe071b38fd4265a2f72f4c2b8c8f984561f8"} Jul 06 20:35:56.603508 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:56.603458 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/50196b0e-a0bc-4f0b-a51d-8e789a9a890d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-85sm8\" (UID: \"50196b0e-a0bc-4f0b-a51d-8e789a9a890d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85sm8" Jul 06 20:35:56.603686 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:56.603616 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 20:35:56.603765 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:56.603691 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50196b0e-a0bc-4f0b-a51d-8e789a9a890d-cluster-monitoring-operator-tls podName:50196b0e-a0bc-4f0b-a51d-8e789a9a890d nodeName:}" failed. No retries permitted until 2026-07-06 20:35:58.603671519 +0000 UTC m=+61.020920946 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/50196b0e-a0bc-4f0b-a51d-8e789a9a890d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-85sm8" (UID: "50196b0e-a0bc-4f0b-a51d-8e789a9a890d") : secret "cluster-monitoring-operator-tls" not found Jul 06 20:35:56.704844 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:56.704742 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8da873c1-d92e-4dec-b980-e470b5263d61-registry-tls\") pod \"image-registry-5bd995454f-v4b97\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " pod="openshift-image-registry/image-registry-5bd995454f-v4b97" Jul 06 20:35:56.705025 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:56.704939 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:35:56.705025 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:56.704958 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bd995454f-v4b97: secret "image-registry-tls" not found Jul 06 20:35:56.705025 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:56.705021 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8da873c1-d92e-4dec-b980-e470b5263d61-registry-tls podName:8da873c1-d92e-4dec-b980-e470b5263d61 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:58.705000732 +0000 UTC m=+61.122250139 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8da873c1-d92e-4dec-b980-e470b5263d61-registry-tls") pod "image-registry-5bd995454f-v4b97" (UID: "8da873c1-d92e-4dec-b980-e470b5263d61") : secret "image-registry-tls" not found Jul 06 20:35:57.418108 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:57.418068 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-kjjpn" event={"ID":"0f6cd921-5c67-4016-90a5-98c2ad891aa8","Type":"ContainerStarted","Data":"f9f82998df5cba678c124c2e64761693a1f4701d4af05535c38e9a0209bc4b42"} Jul 06 20:35:57.440968 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:57.440911 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-kjjpn" podStartSLOduration=1.588370388 podStartE2EDuration="3.440889857s" totalImagesPullingTime="1.852519469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:35:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:57.440139166 +0000 UTC m=+59.857388594" watchObservedRunningTime="2026-07-06 20:35:57.440889857 +0000 UTC m=+59.858139304" Jul 06 20:35:58.422260 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:58.422216 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tmvn6" event={"ID":"e9ef32e7-80be-4b87-8f9b-e1394c0022f8","Type":"ContainerStarted","Data":"5f9ac225b4b39b9b69105a72c09082e12547b8261c0cd873ea85981e697f896d"} Jul 06 20:35:58.445694 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:58.445630 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tmvn6" podStartSLOduration=1.872016934 podStartE2EDuration="4.445607778s" totalImagesPullingTime="2.573590844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:35:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:58.445273865 +0000 UTC m=+60.862523295" watchObservedRunningTime="2026-07-06 20:35:58.445607778 +0000 UTC m=+60.862857209" Jul 06 20:35:58.620442 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:58.620402 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/50196b0e-a0bc-4f0b-a51d-8e789a9a890d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-85sm8\" (UID: \"50196b0e-a0bc-4f0b-a51d-8e789a9a890d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85sm8" Jul 06 20:35:58.620645 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:58.620545 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 20:35:58.620645 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:58.620619 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50196b0e-a0bc-4f0b-a51d-8e789a9a890d-cluster-monitoring-operator-tls podName:50196b0e-a0bc-4f0b-a51d-8e789a9a890d nodeName:}" failed. No retries permitted until 2026-07-06 20:36:02.620600488 +0000 UTC m=+65.037849898 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/50196b0e-a0bc-4f0b-a51d-8e789a9a890d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-85sm8" (UID: "50196b0e-a0bc-4f0b-a51d-8e789a9a890d") : secret "cluster-monitoring-operator-tls" not found Jul 06 20:35:58.721373 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:58.721276 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8da873c1-d92e-4dec-b980-e470b5263d61-registry-tls\") pod \"image-registry-5bd995454f-v4b97\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " pod="openshift-image-registry/image-registry-5bd995454f-v4b97" Jul 06 20:35:58.721541 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:58.721446 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:35:58.721541 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:58.721475 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bd995454f-v4b97: secret "image-registry-tls" not found Jul 06 20:35:58.721541 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:58.721542 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8da873c1-d92e-4dec-b980-e470b5263d61-registry-tls podName:8da873c1-d92e-4dec-b980-e470b5263d61 nodeName:}" failed. No retries permitted until 2026-07-06 20:36:02.721521511 +0000 UTC m=+65.138770933 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8da873c1-d92e-4dec-b980-e470b5263d61-registry-tls") pod "image-registry-5bd995454f-v4b97" (UID: "8da873c1-d92e-4dec-b980-e470b5263d61") : secret "image-registry-tls" not found Jul 06 20:35:59.274001 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:59.273961 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cmkcf"] Jul 06 20:35:59.294982 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:59.294952 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cmkcf"] Jul 06 20:35:59.295152 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:59.295070 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cmkcf" Jul 06 20:35:59.299323 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:59.299288 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 20:35:59.299490 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:59.299333 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 20:35:59.299490 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:59.299454 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-42v4d\"" Jul 06 20:35:59.327259 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:59.327221 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlkv6\" (UniqueName: \"kubernetes.io/projected/e827580a-4554-4fca-88c6-91eacf3fe7e8-kube-api-access-zlkv6\") pod \"insights-runtime-extractor-cmkcf\" (UID: \"e827580a-4554-4fca-88c6-91eacf3fe7e8\") " pod="openshift-insights/insights-runtime-extractor-cmkcf" Jul 06 20:35:59.327259 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:59.327262 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e827580a-4554-4fca-88c6-91eacf3fe7e8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmkcf\" (UID: \"e827580a-4554-4fca-88c6-91eacf3fe7e8\") " pod="openshift-insights/insights-runtime-extractor-cmkcf" Jul 06 20:35:59.327499 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:59.327292 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e827580a-4554-4fca-88c6-91eacf3fe7e8-data-volume\") pod \"insights-runtime-extractor-cmkcf\" (UID: \"e827580a-4554-4fca-88c6-91eacf3fe7e8\") " pod="openshift-insights/insights-runtime-extractor-cmkcf" Jul 06 20:35:59.327499 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:59.327343 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e827580a-4554-4fca-88c6-91eacf3fe7e8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmkcf\" (UID: \"e827580a-4554-4fca-88c6-91eacf3fe7e8\") " pod="openshift-insights/insights-runtime-extractor-cmkcf" Jul 06 20:35:59.327499 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:59.327437 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e827580a-4554-4fca-88c6-91eacf3fe7e8-crio-socket\") pod \"insights-runtime-extractor-cmkcf\" (UID: \"e827580a-4554-4fca-88c6-91eacf3fe7e8\") " pod="openshift-insights/insights-runtime-extractor-cmkcf" Jul 06 20:35:59.428470 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:59.428440 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e827580a-4554-4fca-88c6-91eacf3fe7e8-crio-socket\") pod \"insights-runtime-extractor-cmkcf\" (UID: \"e827580a-4554-4fca-88c6-91eacf3fe7e8\") " pod="openshift-insights/insights-runtime-extractor-cmkcf" Jul 06 20:35:59.428946 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:59.428544 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlkv6\" (UniqueName: \"kubernetes.io/projected/e827580a-4554-4fca-88c6-91eacf3fe7e8-kube-api-access-zlkv6\") pod \"insights-runtime-extractor-cmkcf\" (UID: \"e827580a-4554-4fca-88c6-91eacf3fe7e8\") " pod="openshift-insights/insights-runtime-extractor-cmkcf" Jul 06 20:35:59.428946 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:59.428568 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e827580a-4554-4fca-88c6-91eacf3fe7e8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmkcf\" (UID: \"e827580a-4554-4fca-88c6-91eacf3fe7e8\") " pod="openshift-insights/insights-runtime-extractor-cmkcf" Jul 06 20:35:59.428946 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:59.428575 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e827580a-4554-4fca-88c6-91eacf3fe7e8-crio-socket\") pod \"insights-runtime-extractor-cmkcf\" (UID: \"e827580a-4554-4fca-88c6-91eacf3fe7e8\") " pod="openshift-insights/insights-runtime-extractor-cmkcf" Jul 06 20:35:59.428946 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:59.428588 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e827580a-4554-4fca-88c6-91eacf3fe7e8-data-volume\") pod \"insights-runtime-extractor-cmkcf\" (UID: \"e827580a-4554-4fca-88c6-91eacf3fe7e8\") " pod="openshift-insights/insights-runtime-extractor-cmkcf" Jul 06 20:35:59.428946 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:59.428618 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e827580a-4554-4fca-88c6-91eacf3fe7e8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmkcf\" (UID: \"e827580a-4554-4fca-88c6-91eacf3fe7e8\") " pod="openshift-insights/insights-runtime-extractor-cmkcf" Jul 06 20:35:59.428946 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:59.428711 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:35:59.428946 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:59.428734 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:35:59.428946 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:59.428783 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e827580a-4554-4fca-88c6-91eacf3fe7e8-insights-runtime-extractor-tls podName:e827580a-4554-4fca-88c6-91eacf3fe7e8 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:59.928765467 +0000 UTC m=+62.346014875 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e827580a-4554-4fca-88c6-91eacf3fe7e8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cmkcf" (UID: "e827580a-4554-4fca-88c6-91eacf3fe7e8") : secret "insights-runtime-extractor-tls" not found Jul 06 20:35:59.428946 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:59.428796 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e827580a-4554-4fca-88c6-91eacf3fe7e8-kube-rbac-proxy-cm podName:e827580a-4554-4fca-88c6-91eacf3fe7e8 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:59.928790099 +0000 UTC m=+62.346039506 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e827580a-4554-4fca-88c6-91eacf3fe7e8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cmkcf" (UID: "e827580a-4554-4fca-88c6-91eacf3fe7e8") : configmap "kube-rbac-proxy" not found Jul 06 20:35:59.429267 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:59.428950 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e827580a-4554-4fca-88c6-91eacf3fe7e8-data-volume\") pod \"insights-runtime-extractor-cmkcf\" (UID: \"e827580a-4554-4fca-88c6-91eacf3fe7e8\") " pod="openshift-insights/insights-runtime-extractor-cmkcf" Jul 06 20:35:59.442870 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:59.442837 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlkv6\" (UniqueName: \"kubernetes.io/projected/e827580a-4554-4fca-88c6-91eacf3fe7e8-kube-api-access-zlkv6\") pod \"insights-runtime-extractor-cmkcf\" (UID: \"e827580a-4554-4fca-88c6-91eacf3fe7e8\") " pod="openshift-insights/insights-runtime-extractor-cmkcf" Jul 06 20:35:59.932643 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:59.932597 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e827580a-4554-4fca-88c6-91eacf3fe7e8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmkcf\" (UID: \"e827580a-4554-4fca-88c6-91eacf3fe7e8\") " pod="openshift-insights/insights-runtime-extractor-cmkcf" Jul 06 20:35:59.932643 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:35:59.932645 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e827580a-4554-4fca-88c6-91eacf3fe7e8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmkcf\" (UID: \"e827580a-4554-4fca-88c6-91eacf3fe7e8\") " pod="openshift-insights/insights-runtime-extractor-cmkcf" Jul 06 20:35:59.932860 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:59.932735 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:35:59.932860 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:59.932788 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:35:59.932860 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:59.932808 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e827580a-4554-4fca-88c6-91eacf3fe7e8-kube-rbac-proxy-cm podName:e827580a-4554-4fca-88c6-91eacf3fe7e8 nodeName:}" failed. No retries permitted until 2026-07-06 20:36:00.932790257 +0000 UTC m=+63.350039664 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e827580a-4554-4fca-88c6-91eacf3fe7e8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cmkcf" (UID: "e827580a-4554-4fca-88c6-91eacf3fe7e8") : configmap "kube-rbac-proxy" not found Jul 06 20:35:59.932860 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:35:59.932826 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e827580a-4554-4fca-88c6-91eacf3fe7e8-insights-runtime-extractor-tls podName:e827580a-4554-4fca-88c6-91eacf3fe7e8 nodeName:}" failed. No retries permitted until 2026-07-06 20:36:00.932814959 +0000 UTC m=+63.350064367 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e827580a-4554-4fca-88c6-91eacf3fe7e8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cmkcf" (UID: "e827580a-4554-4fca-88c6-91eacf3fe7e8") : secret "insights-runtime-extractor-tls" not found Jul 06 20:36:00.348784 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:00.348711 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-82n9w" Jul 06 20:36:00.941033 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:00.940992 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e827580a-4554-4fca-88c6-91eacf3fe7e8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmkcf\" (UID: \"e827580a-4554-4fca-88c6-91eacf3fe7e8\") " pod="openshift-insights/insights-runtime-extractor-cmkcf" Jul 06 20:36:00.941033 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:00.941032 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e827580a-4554-4fca-88c6-91eacf3fe7e8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmkcf\" (UID: \"e827580a-4554-4fca-88c6-91eacf3fe7e8\") " pod="openshift-insights/insights-runtime-extractor-cmkcf" Jul 06 20:36:00.941574 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:00.941141 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:36:00.941574 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:00.941191 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e827580a-4554-4fca-88c6-91eacf3fe7e8-insights-runtime-extractor-tls podName:e827580a-4554-4fca-88c6-91eacf3fe7e8 nodeName:}" failed. No retries permitted until 2026-07-06 20:36:02.941176761 +0000 UTC m=+65.358426168 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e827580a-4554-4fca-88c6-91eacf3fe7e8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cmkcf" (UID: "e827580a-4554-4fca-88c6-91eacf3fe7e8") : secret "insights-runtime-extractor-tls" not found Jul 06 20:36:00.941574 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:00.941137 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:36:00.941574 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:00.941283 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e827580a-4554-4fca-88c6-91eacf3fe7e8-kube-rbac-proxy-cm podName:e827580a-4554-4fca-88c6-91eacf3fe7e8 nodeName:}" failed. No retries permitted until 2026-07-06 20:36:02.941264337 +0000 UTC m=+65.358513754 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e827580a-4554-4fca-88c6-91eacf3fe7e8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cmkcf" (UID: "e827580a-4554-4fca-88c6-91eacf3fe7e8") : configmap "kube-rbac-proxy" not found Jul 06 20:36:01.793664 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:01.793633 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-228pr_37d7b196-af22-4df9-bb34-5b739bc05578/dns-node-resolver/0.log" Jul 06 20:36:02.654504 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:02.654457 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/50196b0e-a0bc-4f0b-a51d-8e789a9a890d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-85sm8\" (UID: \"50196b0e-a0bc-4f0b-a51d-8e789a9a890d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85sm8" Jul 06 20:36:02.654925 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:02.654609 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 20:36:02.654925 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:02.654676 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50196b0e-a0bc-4f0b-a51d-8e789a9a890d-cluster-monitoring-operator-tls podName:50196b0e-a0bc-4f0b-a51d-8e789a9a890d nodeName:}" failed. No retries permitted until 2026-07-06 20:36:10.654660519 +0000 UTC m=+73.071909943 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/50196b0e-a0bc-4f0b-a51d-8e789a9a890d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-85sm8" (UID: "50196b0e-a0bc-4f0b-a51d-8e789a9a890d") : secret "cluster-monitoring-operator-tls" not found Jul 06 20:36:02.756149 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:02.756109 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8da873c1-d92e-4dec-b980-e470b5263d61-registry-tls\") pod \"image-registry-5bd995454f-v4b97\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " pod="openshift-image-registry/image-registry-5bd995454f-v4b97" Jul 06 20:36:02.756315 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:02.756242 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:36:02.756315 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:02.756255 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bd995454f-v4b97: secret "image-registry-tls" not found Jul 06 20:36:02.756315 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:02.756308 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8da873c1-d92e-4dec-b980-e470b5263d61-registry-tls podName:8da873c1-d92e-4dec-b980-e470b5263d61 nodeName:}" failed. No retries permitted until 2026-07-06 20:36:10.756291486 +0000 UTC m=+73.173540894 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8da873c1-d92e-4dec-b980-e470b5263d61-registry-tls") pod "image-registry-5bd995454f-v4b97" (UID: "8da873c1-d92e-4dec-b980-e470b5263d61") : secret "image-registry-tls" not found Jul 06 20:36:02.856748 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:02.856707 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng2r9\" (UniqueName: \"kubernetes.io/projected/3e34520c-432d-4ad4-a08a-3bcf6b082abc-kube-api-access-ng2r9\") pod \"network-check-target-gvkfp\" (UID: \"3e34520c-432d-4ad4-a08a-3bcf6b082abc\") " pod="openshift-network-diagnostics/network-check-target-gvkfp" Jul 06 20:36:02.856976 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:02.856759 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5620d06-ce9a-457c-8636-a60ad8234202-metrics-certs\") pod \"network-metrics-daemon-mjfls\" (UID: \"b5620d06-ce9a-457c-8636-a60ad8234202\") " pod="openshift-multus/network-metrics-daemon-mjfls" Jul 06 20:36:02.856976 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:02.856785 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/872de884-2edf-4de9-8ad6-2bc963363808-original-pull-secret\") pod \"global-pull-secret-syncer-4r7cf\" (UID: \"872de884-2edf-4de9-8ad6-2bc963363808\") " pod="kube-system/global-pull-secret-syncer-4r7cf" Jul 06 20:36:02.859955 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:02.859933 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 20:36:02.860095 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:02.859982 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 20:36:02.860095 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:02.859940 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 20:36:02.867394 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:02.867363 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 20:36:02.867525 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:02.867434 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5620d06-ce9a-457c-8636-a60ad8234202-metrics-certs podName:b5620d06-ce9a-457c-8636-a60ad8234202 nodeName:}" failed. No retries permitted until 2026-07-06 20:37:06.867414455 +0000 UTC m=+129.284663866 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5620d06-ce9a-457c-8636-a60ad8234202-metrics-certs") pod "network-metrics-daemon-mjfls" (UID: "b5620d06-ce9a-457c-8636-a60ad8234202") : secret "metrics-daemon-secret" not found Jul 06 20:36:02.869763 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:02.869737 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/872de884-2edf-4de9-8ad6-2bc963363808-original-pull-secret\") pod \"global-pull-secret-syncer-4r7cf\" (UID: \"872de884-2edf-4de9-8ad6-2bc963363808\") " pod="kube-system/global-pull-secret-syncer-4r7cf" Jul 06 20:36:02.870174 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:02.870159 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 20:36:02.880289 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:02.880263 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng2r9\" (UniqueName: \"kubernetes.io/projected/3e34520c-432d-4ad4-a08a-3bcf6b082abc-kube-api-access-ng2r9\") pod \"network-check-target-gvkfp\" (UID: \"3e34520c-432d-4ad4-a08a-3bcf6b082abc\") " pod="openshift-network-diagnostics/network-check-target-gvkfp" Jul 06 20:36:02.906060 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:02.905987 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6bf8b\"" Jul 06 20:36:02.913424 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:02.913400 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvkfp" Jul 06 20:36:02.913576 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:02.913559 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r7cf" Jul 06 20:36:02.957648 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:02.957611 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e827580a-4554-4fca-88c6-91eacf3fe7e8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmkcf\" (UID: \"e827580a-4554-4fca-88c6-91eacf3fe7e8\") " pod="openshift-insights/insights-runtime-extractor-cmkcf" Jul 06 20:36:02.957648 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:02.957653 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e827580a-4554-4fca-88c6-91eacf3fe7e8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmkcf\" (UID: \"e827580a-4554-4fca-88c6-91eacf3fe7e8\") " pod="openshift-insights/insights-runtime-extractor-cmkcf" Jul 06 20:36:02.957926 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:02.957778 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:36:02.957926 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:02.957865 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e827580a-4554-4fca-88c6-91eacf3fe7e8-kube-rbac-proxy-cm podName:e827580a-4554-4fca-88c6-91eacf3fe7e8 nodeName:}" failed. No retries permitted until 2026-07-06 20:36:06.957841017 +0000 UTC m=+69.375090427 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e827580a-4554-4fca-88c6-91eacf3fe7e8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cmkcf" (UID: "e827580a-4554-4fca-88c6-91eacf3fe7e8") : configmap "kube-rbac-proxy" not found Jul 06 20:36:02.957926 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:02.957789 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:36:02.957926 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:02.957927 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e827580a-4554-4fca-88c6-91eacf3fe7e8-insights-runtime-extractor-tls podName:e827580a-4554-4fca-88c6-91eacf3fe7e8 nodeName:}" failed. No retries permitted until 2026-07-06 20:36:06.957916065 +0000 UTC m=+69.375165488 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e827580a-4554-4fca-88c6-91eacf3fe7e8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cmkcf" (UID: "e827580a-4554-4fca-88c6-91eacf3fe7e8") : secret "insights-runtime-extractor-tls" not found Jul 06 20:36:02.993216 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:02.993186 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9627c_482c8ffc-6942-4433-988b-71ab836d0c4a/node-ca/0.log" Jul 06 20:36:03.052085 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:03.052027 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4r7cf"] Jul 06 20:36:03.055651 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:36:03.055621 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod872de884_2edf_4de9_8ad6_2bc963363808.slice/crio-4efc671a78310c3034cee10451df8e350e3dbceda5818c64b29c5fb5557cbb47 WatchSource:0}: Error finding container 4efc671a78310c3034cee10451df8e350e3dbceda5818c64b29c5fb5557cbb47: Status 404 returned error can't find the container with id 4efc671a78310c3034cee10451df8e350e3dbceda5818c64b29c5fb5557cbb47 Jul 06 20:36:03.081375 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:03.081342 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gvkfp"] Jul 06 20:36:03.085028 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:36:03.084997 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e34520c_432d_4ad4_a08a_3bcf6b082abc.slice/crio-818d6933b9141a5fd52c053858eb5363e3bafe1c1a3e5362a9a47c96498dcff6 WatchSource:0}: Error finding container 818d6933b9141a5fd52c053858eb5363e3bafe1c1a3e5362a9a47c96498dcff6: Status 404 returned error can't find the container with id 818d6933b9141a5fd52c053858eb5363e3bafe1c1a3e5362a9a47c96498dcff6 Jul 06 20:36:03.437108 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:03.437062 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4r7cf" event={"ID":"872de884-2edf-4de9-8ad6-2bc963363808","Type":"ContainerStarted","Data":"4efc671a78310c3034cee10451df8e350e3dbceda5818c64b29c5fb5557cbb47"} Jul 06 20:36:03.438549 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:03.438504 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gvkfp" event={"ID":"3e34520c-432d-4ad4-a08a-3bcf6b082abc","Type":"ContainerStarted","Data":"818d6933b9141a5fd52c053858eb5363e3bafe1c1a3e5362a9a47c96498dcff6"} Jul 06 20:36:03.491715 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:03.491677 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-5nvlr"] Jul 06 20:36:03.494041 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:03.494010 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-5nvlr" Jul 06 20:36:03.496862 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:03.496825 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 06 20:36:03.498322 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:03.498287 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 06 20:36:03.498488 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:03.498383 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 06 20:36:03.498718 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:03.498611 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-sqhfm\"" Jul 06 20:36:03.504747 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:03.500243 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 06 20:36:03.509200 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:03.509176 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-5nvlr"] Jul 06 20:36:03.563314 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:03.563276 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c6b8afd0-85d5-4ed0-84e4-826f05eb4708-signing-key\") pod \"service-ca-758f599c5-5nvlr\" (UID: \"c6b8afd0-85d5-4ed0-84e4-826f05eb4708\") " pod="openshift-service-ca/service-ca-758f599c5-5nvlr" Jul 06 20:36:03.563516 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:03.563425 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvb5v\" (UniqueName: \"kubernetes.io/projected/c6b8afd0-85d5-4ed0-84e4-826f05eb4708-kube-api-access-kvb5v\") pod \"service-ca-758f599c5-5nvlr\" (UID: \"c6b8afd0-85d5-4ed0-84e4-826f05eb4708\") " pod="openshift-service-ca/service-ca-758f599c5-5nvlr" Jul 06 20:36:03.563578 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:03.563559 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c6b8afd0-85d5-4ed0-84e4-826f05eb4708-signing-cabundle\") pod \"service-ca-758f599c5-5nvlr\" (UID: \"c6b8afd0-85d5-4ed0-84e4-826f05eb4708\") " pod="openshift-service-ca/service-ca-758f599c5-5nvlr" Jul 06 20:36:03.632447 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:03.632412 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-k76n2"] Jul 06 20:36:03.634821 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:03.634792 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-k76n2" Jul 06 20:36:03.637639 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:03.637611 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 06 20:36:03.637826 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:03.637698 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 06 20:36:03.637826 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:03.637707 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-zlmbt\"" Jul 06 20:36:03.646337 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:03.646298 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-k76n2"] Jul 06 20:36:03.664029 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:03.663988 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b324f54-aad4-4f39-b915-ed85edd3a3fa-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-k76n2\" (UID: \"2b324f54-aad4-4f39-b915-ed85edd3a3fa\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-k76n2" Jul 06 20:36:03.664519 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:03.664069 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c6b8afd0-85d5-4ed0-84e4-826f05eb4708-signing-cabundle\") pod \"service-ca-758f599c5-5nvlr\" (UID: \"c6b8afd0-85d5-4ed0-84e4-826f05eb4708\") " pod="openshift-service-ca/service-ca-758f599c5-5nvlr" Jul 06 20:36:03.664519 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:03.664177 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c6b8afd0-85d5-4ed0-84e4-826f05eb4708-signing-key\") pod \"service-ca-758f599c5-5nvlr\" (UID: \"c6b8afd0-85d5-4ed0-84e4-826f05eb4708\") " pod="openshift-service-ca/service-ca-758f599c5-5nvlr" Jul 06 20:36:03.664519 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:03.664240 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvb5v\" (UniqueName: \"kubernetes.io/projected/c6b8afd0-85d5-4ed0-84e4-826f05eb4708-kube-api-access-kvb5v\") pod \"service-ca-758f599c5-5nvlr\" (UID: \"c6b8afd0-85d5-4ed0-84e4-826f05eb4708\") " pod="openshift-service-ca/service-ca-758f599c5-5nvlr" Jul 06 20:36:03.664519 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:03.664369 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2b324f54-aad4-4f39-b915-ed85edd3a3fa-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-k76n2\" (UID: \"2b324f54-aad4-4f39-b915-ed85edd3a3fa\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-k76n2" Jul 06 20:36:03.664855 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:03.664807 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c6b8afd0-85d5-4ed0-84e4-826f05eb4708-signing-cabundle\") pod \"service-ca-758f599c5-5nvlr\" (UID: \"c6b8afd0-85d5-4ed0-84e4-826f05eb4708\") " pod="openshift-service-ca/service-ca-758f599c5-5nvlr" Jul 06 20:36:03.667056 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:03.667019 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c6b8afd0-85d5-4ed0-84e4-826f05eb4708-signing-key\") pod \"service-ca-758f599c5-5nvlr\" (UID: \"c6b8afd0-85d5-4ed0-84e4-826f05eb4708\") " pod="openshift-service-ca/service-ca-758f599c5-5nvlr" Jul 06 20:36:03.674611 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:03.674578 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvb5v\" (UniqueName: \"kubernetes.io/projected/c6b8afd0-85d5-4ed0-84e4-826f05eb4708-kube-api-access-kvb5v\") pod \"service-ca-758f599c5-5nvlr\" (UID: \"c6b8afd0-85d5-4ed0-84e4-826f05eb4708\") " pod="openshift-service-ca/service-ca-758f599c5-5nvlr" Jul 06 20:36:03.765324 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:03.765046 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2b324f54-aad4-4f39-b915-ed85edd3a3fa-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-k76n2\" (UID: \"2b324f54-aad4-4f39-b915-ed85edd3a3fa\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-k76n2" Jul 06 20:36:03.765324 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:03.765120 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b324f54-aad4-4f39-b915-ed85edd3a3fa-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-k76n2\" (UID: \"2b324f54-aad4-4f39-b915-ed85edd3a3fa\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-k76n2" Jul 06 20:36:03.765538 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:03.765321 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 20:36:03.765538 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:03.765405 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b324f54-aad4-4f39-b915-ed85edd3a3fa-networking-console-plugin-cert podName:2b324f54-aad4-4f39-b915-ed85edd3a3fa nodeName:}" failed. No retries permitted until 2026-07-06 20:36:04.265380574 +0000 UTC m=+66.682630004 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2b324f54-aad4-4f39-b915-ed85edd3a3fa-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-k76n2" (UID: "2b324f54-aad4-4f39-b915-ed85edd3a3fa") : secret "networking-console-plugin-cert" not found Jul 06 20:36:03.765938 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:03.765913 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2b324f54-aad4-4f39-b915-ed85edd3a3fa-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-k76n2\" (UID: \"2b324f54-aad4-4f39-b915-ed85edd3a3fa\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-k76n2" Jul 06 20:36:03.792693 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:03.792650 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lk74h_737b46c8-48bb-4732-858d-bec540223122/serve-healthcheck-canary/0.log" Jul 06 20:36:03.809597 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:03.809560 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-5nvlr" Jul 06 20:36:03.970991 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:03.970924 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-5nvlr"] Jul 06 20:36:03.993467 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:36:03.993383 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6b8afd0_85d5_4ed0_84e4_826f05eb4708.slice/crio-5c2675d03f092d0e6238e47a1abac8970a715ffde9142f995af5476f1356ff42 WatchSource:0}: Error finding container 5c2675d03f092d0e6238e47a1abac8970a715ffde9142f995af5476f1356ff42: Status 404 returned error can't find the container with id 5c2675d03f092d0e6238e47a1abac8970a715ffde9142f995af5476f1356ff42 Jul 06 20:36:04.269844 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:04.269801 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b324f54-aad4-4f39-b915-ed85edd3a3fa-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-k76n2\" (UID: \"2b324f54-aad4-4f39-b915-ed85edd3a3fa\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-k76n2" Jul 06 20:36:04.270055 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:04.269983 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 20:36:04.270125 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:04.270062 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b324f54-aad4-4f39-b915-ed85edd3a3fa-networking-console-plugin-cert podName:2b324f54-aad4-4f39-b915-ed85edd3a3fa nodeName:}" failed. No retries permitted until 2026-07-06 20:36:05.27004233 +0000 UTC m=+67.687291749 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2b324f54-aad4-4f39-b915-ed85edd3a3fa-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-k76n2" (UID: "2b324f54-aad4-4f39-b915-ed85edd3a3fa") : secret "networking-console-plugin-cert" not found Jul 06 20:36:04.370749 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:04.370710 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/778034a9-e32b-4305-bdc7-885c6393fcba-metrics-tls\") pod \"dns-default-2p2vp\" (UID: \"778034a9-e32b-4305-bdc7-885c6393fcba\") " pod="openshift-dns/dns-default-2p2vp" Jul 06 20:36:04.370947 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:04.370849 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:36:04.370947 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:04.370931 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/778034a9-e32b-4305-bdc7-885c6393fcba-metrics-tls podName:778034a9-e32b-4305-bdc7-885c6393fcba nodeName:}" failed. No retries permitted until 2026-07-06 20:36:36.370911127 +0000 UTC m=+98.788160536 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/778034a9-e32b-4305-bdc7-885c6393fcba-metrics-tls") pod "dns-default-2p2vp" (UID: "778034a9-e32b-4305-bdc7-885c6393fcba") : secret "dns-default-metrics-tls" not found Jul 06 20:36:04.443723 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:04.443674 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-5nvlr" event={"ID":"c6b8afd0-85d5-4ed0-84e4-826f05eb4708","Type":"ContainerStarted","Data":"5c2675d03f092d0e6238e47a1abac8970a715ffde9142f995af5476f1356ff42"} Jul 06 20:36:04.595455 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:04.595377 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-tmvn6_e9ef32e7-80be-4b87-8f9b-e1394c0022f8/kube-storage-version-migrator-operator/0.log" Jul 06 20:36:05.279422 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:05.279366 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b324f54-aad4-4f39-b915-ed85edd3a3fa-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-k76n2\" (UID: \"2b324f54-aad4-4f39-b915-ed85edd3a3fa\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-k76n2" Jul 06 20:36:05.280039 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:05.279538 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 20:36:05.280039 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:05.279723 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b324f54-aad4-4f39-b915-ed85edd3a3fa-networking-console-plugin-cert podName:2b324f54-aad4-4f39-b915-ed85edd3a3fa nodeName:}" failed. No retries permitted until 2026-07-06 20:36:07.279702109 +0000 UTC m=+69.696951521 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2b324f54-aad4-4f39-b915-ed85edd3a3fa-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-k76n2" (UID: "2b324f54-aad4-4f39-b915-ed85edd3a3fa") : secret "networking-console-plugin-cert" not found Jul 06 20:36:06.995914 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:06.995863 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e827580a-4554-4fca-88c6-91eacf3fe7e8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmkcf\" (UID: \"e827580a-4554-4fca-88c6-91eacf3fe7e8\") " pod="openshift-insights/insights-runtime-extractor-cmkcf" Jul 06 20:36:06.995914 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:06.995921 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e827580a-4554-4fca-88c6-91eacf3fe7e8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmkcf\" (UID: \"e827580a-4554-4fca-88c6-91eacf3fe7e8\") " pod="openshift-insights/insights-runtime-extractor-cmkcf" Jul 06 20:36:06.996415 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:06.996015 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:36:06.996415 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:06.996053 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:36:06.996415 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:06.996101 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e827580a-4554-4fca-88c6-91eacf3fe7e8-kube-rbac-proxy-cm podName:e827580a-4554-4fca-88c6-91eacf3fe7e8 nodeName:}" failed. No retries permitted until 2026-07-06 20:36:14.996079242 +0000 UTC m=+77.413328652 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e827580a-4554-4fca-88c6-91eacf3fe7e8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cmkcf" (UID: "e827580a-4554-4fca-88c6-91eacf3fe7e8") : configmap "kube-rbac-proxy" not found Jul 06 20:36:06.996415 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:06.996122 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e827580a-4554-4fca-88c6-91eacf3fe7e8-insights-runtime-extractor-tls podName:e827580a-4554-4fca-88c6-91eacf3fe7e8 nodeName:}" failed. No retries permitted until 2026-07-06 20:36:14.996111124 +0000 UTC m=+77.413360535 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e827580a-4554-4fca-88c6-91eacf3fe7e8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cmkcf" (UID: "e827580a-4554-4fca-88c6-91eacf3fe7e8") : secret "insights-runtime-extractor-tls" not found Jul 06 20:36:07.298920 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:07.298816 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b324f54-aad4-4f39-b915-ed85edd3a3fa-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-k76n2\" (UID: \"2b324f54-aad4-4f39-b915-ed85edd3a3fa\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-k76n2" Jul 06 20:36:07.299074 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:07.299023 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 20:36:07.299128 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:07.299108 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b324f54-aad4-4f39-b915-ed85edd3a3fa-networking-console-plugin-cert podName:2b324f54-aad4-4f39-b915-ed85edd3a3fa nodeName:}" failed. No retries permitted until 2026-07-06 20:36:11.29908449 +0000 UTC m=+73.716333900 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2b324f54-aad4-4f39-b915-ed85edd3a3fa-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-k76n2" (UID: "2b324f54-aad4-4f39-b915-ed85edd3a3fa") : secret "networking-console-plugin-cert" not found Jul 06 20:36:08.457234 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:08.457186 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-5nvlr" event={"ID":"c6b8afd0-85d5-4ed0-84e4-826f05eb4708","Type":"ContainerStarted","Data":"4133ece5ea6941c55fd480a73bf2af5b5f6710f05a0426677cebf69effa962ec"} Jul 06 20:36:08.458796 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:08.458760 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4r7cf" event={"ID":"872de884-2edf-4de9-8ad6-2bc963363808","Type":"ContainerStarted","Data":"60446959483d2b3f4c7a289251749b599cde8713705fa9dc86184f3e47c51e04"} Jul 06 20:36:08.460387 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:08.460361 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gvkfp" event={"ID":"3e34520c-432d-4ad4-a08a-3bcf6b082abc","Type":"ContainerStarted","Data":"aae60a6d823ccf24cb9c845c77d77ce738d47b92316a853113d59e71690848c4"} Jul 06 20:36:08.460491 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:08.460417 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gvkfp" Jul 06 20:36:08.476858 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:08.476805 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-5nvlr" podStartSLOduration=1.214644672 podStartE2EDuration="5.476790092s" totalImagesPullingTime="4.26214542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:36:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:36:08.475853706 +0000 UTC m=+70.893103135" watchObservedRunningTime="2026-07-06 20:36:08.476790092 +0000 UTC m=+70.894039546" Jul 06 20:36:08.496694 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:08.496581 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gvkfp" podStartSLOduration=66.331583677 podStartE2EDuration="1m11.49653506s" totalImagesPullingTime="5.164951383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:36:08.495695606 +0000 UTC m=+70.912945057" watchObservedRunningTime="2026-07-06 20:36:08.49653506 +0000 UTC m=+70.913784491" Jul 06 20:36:08.513940 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:08.513873 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4r7cf" podStartSLOduration=65.306779644 podStartE2EDuration="1m10.513856889s" totalImagesPullingTime="5.207077245s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:34:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:36:08.513689785 +0000 UTC m=+70.930939218" watchObservedRunningTime="2026-07-06 20:36:08.513856889 +0000 UTC m=+70.931106319" Jul 06 20:36:10.729128 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:10.729084 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/50196b0e-a0bc-4f0b-a51d-8e789a9a890d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-85sm8\" (UID: \"50196b0e-a0bc-4f0b-a51d-8e789a9a890d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85sm8" Jul 06 20:36:10.729576 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:10.729236 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 20:36:10.729576 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:10.729304 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50196b0e-a0bc-4f0b-a51d-8e789a9a890d-cluster-monitoring-operator-tls podName:50196b0e-a0bc-4f0b-a51d-8e789a9a890d nodeName:}" failed. No retries permitted until 2026-07-06 20:36:26.729287086 +0000 UTC m=+89.146536497 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/50196b0e-a0bc-4f0b-a51d-8e789a9a890d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-85sm8" (UID: "50196b0e-a0bc-4f0b-a51d-8e789a9a890d") : secret "cluster-monitoring-operator-tls" not found Jul 06 20:36:10.830456 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:10.830420 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8da873c1-d92e-4dec-b980-e470b5263d61-registry-tls\") pod \"image-registry-5bd995454f-v4b97\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " pod="openshift-image-registry/image-registry-5bd995454f-v4b97" Jul 06 20:36:10.830620 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:10.830600 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:36:10.830655 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:10.830622 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bd995454f-v4b97: secret "image-registry-tls" not found Jul 06 20:36:10.830687 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:10.830682 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8da873c1-d92e-4dec-b980-e470b5263d61-registry-tls podName:8da873c1-d92e-4dec-b980-e470b5263d61 nodeName:}" failed. No retries permitted until 2026-07-06 20:36:26.83066427 +0000 UTC m=+89.247913676 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8da873c1-d92e-4dec-b980-e470b5263d61-registry-tls") pod "image-registry-5bd995454f-v4b97" (UID: "8da873c1-d92e-4dec-b980-e470b5263d61") : secret "image-registry-tls" not found Jul 06 20:36:11.335325 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:11.335294 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b324f54-aad4-4f39-b915-ed85edd3a3fa-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-k76n2\" (UID: \"2b324f54-aad4-4f39-b915-ed85edd3a3fa\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-k76n2" Jul 06 20:36:11.335486 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:11.335445 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 20:36:11.335545 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:11.335522 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b324f54-aad4-4f39-b915-ed85edd3a3fa-networking-console-plugin-cert podName:2b324f54-aad4-4f39-b915-ed85edd3a3fa nodeName:}" failed. No retries permitted until 2026-07-06 20:36:19.335498034 +0000 UTC m=+81.752747441 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2b324f54-aad4-4f39-b915-ed85edd3a3fa-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-k76n2" (UID: "2b324f54-aad4-4f39-b915-ed85edd3a3fa") : secret "networking-console-plugin-cert" not found Jul 06 20:36:15.067646 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:15.067599 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e827580a-4554-4fca-88c6-91eacf3fe7e8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmkcf\" (UID: \"e827580a-4554-4fca-88c6-91eacf3fe7e8\") " pod="openshift-insights/insights-runtime-extractor-cmkcf" Jul 06 20:36:15.067646 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:15.067653 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e827580a-4554-4fca-88c6-91eacf3fe7e8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmkcf\" (UID: \"e827580a-4554-4fca-88c6-91eacf3fe7e8\") " pod="openshift-insights/insights-runtime-extractor-cmkcf" Jul 06 20:36:15.068144 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:15.067830 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:36:15.068144 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:15.067920 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e827580a-4554-4fca-88c6-91eacf3fe7e8-insights-runtime-extractor-tls podName:e827580a-4554-4fca-88c6-91eacf3fe7e8 nodeName:}" failed. No retries permitted until 2026-07-06 20:36:31.067902696 +0000 UTC m=+93.485152102 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e827580a-4554-4fca-88c6-91eacf3fe7e8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cmkcf" (UID: "e827580a-4554-4fca-88c6-91eacf3fe7e8") : secret "insights-runtime-extractor-tls" not found Jul 06 20:36:15.068224 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:15.068163 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e827580a-4554-4fca-88c6-91eacf3fe7e8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmkcf\" (UID: \"e827580a-4554-4fca-88c6-91eacf3fe7e8\") " pod="openshift-insights/insights-runtime-extractor-cmkcf" Jul 06 20:36:19.405389 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:19.405258 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b324f54-aad4-4f39-b915-ed85edd3a3fa-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-k76n2\" (UID: \"2b324f54-aad4-4f39-b915-ed85edd3a3fa\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-k76n2" Jul 06 20:36:19.407827 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:19.407799 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b324f54-aad4-4f39-b915-ed85edd3a3fa-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-k76n2\" (UID: \"2b324f54-aad4-4f39-b915-ed85edd3a3fa\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-k76n2" Jul 06 20:36:19.546808 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:19.546770 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-k76n2" Jul 06 20:36:19.675451 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:19.675370 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-k76n2"] Jul 06 20:36:19.678130 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:36:19.678101 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b324f54_aad4_4f39_b915_ed85edd3a3fa.slice/crio-ca06495494eaea2b235e79fc63c660f54180adea0841cd23a51f985581aa2eaa WatchSource:0}: Error finding container ca06495494eaea2b235e79fc63c660f54180adea0841cd23a51f985581aa2eaa: Status 404 returned error can't find the container with id ca06495494eaea2b235e79fc63c660f54180adea0841cd23a51f985581aa2eaa Jul 06 20:36:20.502989 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:20.502953 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-k76n2" event={"ID":"2b324f54-aad4-4f39-b915-ed85edd3a3fa","Type":"ContainerStarted","Data":"ca06495494eaea2b235e79fc63c660f54180adea0841cd23a51f985581aa2eaa"} Jul 06 20:36:21.507955 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:21.507923 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-k76n2" event={"ID":"2b324f54-aad4-4f39-b915-ed85edd3a3fa","Type":"ContainerStarted","Data":"2b7f5a590c27ecc213f761b58b8fdeb5e5000340d36f948e56ab0e0d181e2558"} Jul 06 20:36:21.527015 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:21.526960 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-k76n2" podStartSLOduration=17.085898026 podStartE2EDuration="18.52694291s" totalImagesPullingTime="1.441044884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:36:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:36:21.525995808 +0000 UTC m=+83.943245247" watchObservedRunningTime="2026-07-06 20:36:21.52694291 +0000 UTC m=+83.944192338" Jul 06 20:36:26.769083 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:26.769039 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/50196b0e-a0bc-4f0b-a51d-8e789a9a890d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-85sm8\" (UID: \"50196b0e-a0bc-4f0b-a51d-8e789a9a890d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85sm8" Jul 06 20:36:26.771446 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:26.771409 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/50196b0e-a0bc-4f0b-a51d-8e789a9a890d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-85sm8\" (UID: \"50196b0e-a0bc-4f0b-a51d-8e789a9a890d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85sm8" Jul 06 20:36:26.870571 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:26.870530 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8da873c1-d92e-4dec-b980-e470b5263d61-registry-tls\") pod \"image-registry-5bd995454f-v4b97\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " pod="openshift-image-registry/image-registry-5bd995454f-v4b97" Jul 06 20:36:26.872953 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:26.872928 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8da873c1-d92e-4dec-b980-e470b5263d61-registry-tls\") pod \"image-registry-5bd995454f-v4b97\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " pod="openshift-image-registry/image-registry-5bd995454f-v4b97" Jul 06 20:36:27.054386 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:27.054293 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5vr6p\"" Jul 06 20:36:27.062346 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:27.062321 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85sm8" Jul 06 20:36:27.150185 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:27.150159 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nc576\"" Jul 06 20:36:27.157525 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:27.157488 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bd995454f-v4b97" Jul 06 20:36:27.192509 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:27.192474 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85sm8"] Jul 06 20:36:27.196134 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:36:27.196106 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50196b0e_a0bc_4f0b_a51d_8e789a9a890d.slice/crio-75dc0841e0a901e12f49ee54c2dfd652b33cc506c6dd1b6c8cfc9dffac549415 WatchSource:0}: Error finding container 75dc0841e0a901e12f49ee54c2dfd652b33cc506c6dd1b6c8cfc9dffac549415: Status 404 returned error can't find the container with id 75dc0841e0a901e12f49ee54c2dfd652b33cc506c6dd1b6c8cfc9dffac549415 Jul 06 20:36:27.294542 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:27.294502 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bd995454f-v4b97"] Jul 06 20:36:27.297627 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:36:27.297602 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8da873c1_d92e_4dec_b980_e470b5263d61.slice/crio-6010dcd6309addf24f326610c1b3bd3d8b6a2735c8a77df0e13f655f70b8332a WatchSource:0}: Error finding container 6010dcd6309addf24f326610c1b3bd3d8b6a2735c8a77df0e13f655f70b8332a: Status 404 returned error can't find the container with id 6010dcd6309addf24f326610c1b3bd3d8b6a2735c8a77df0e13f655f70b8332a Jul 06 20:36:27.528931 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:27.528893 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bd995454f-v4b97" event={"ID":"8da873c1-d92e-4dec-b980-e470b5263d61","Type":"ContainerStarted","Data":"08ee553f4000c3278610e84338a27e2f044884252618bd3f86a782c1d94308a0"} Jul 06 20:36:27.529125 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:27.528959 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bd995454f-v4b97" event={"ID":"8da873c1-d92e-4dec-b980-e470b5263d61","Type":"ContainerStarted","Data":"6010dcd6309addf24f326610c1b3bd3d8b6a2735c8a77df0e13f655f70b8332a"} Jul 06 20:36:27.529125 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:27.529029 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5bd995454f-v4b97" Jul 06 20:36:27.530091 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:27.530063 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85sm8" event={"ID":"50196b0e-a0bc-4f0b-a51d-8e789a9a890d","Type":"ContainerStarted","Data":"75dc0841e0a901e12f49ee54c2dfd652b33cc506c6dd1b6c8cfc9dffac549415"} Jul 06 20:36:27.551316 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:27.551268 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5bd995454f-v4b97" podStartSLOduration=32.551250579 podStartE2EDuration="32.551250579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:35:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:36:27.549401594 +0000 UTC m=+89.966651022" watchObservedRunningTime="2026-07-06 20:36:27.551250579 +0000 UTC m=+89.968500007" Jul 06 20:36:27.959077 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:27.957027 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bcf7dc475-zh9gs"] Jul 06 20:36:27.960782 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:27.960745 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bcf7dc475-zh9gs" Jul 06 20:36:27.965022 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:27.964975 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 06 20:36:27.965251 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:27.965197 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 06 20:36:27.965347 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:27.965313 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 06 20:36:27.966015 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:27.965991 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 06 20:36:27.966280 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:27.966256 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 06 20:36:27.966474 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:27.966453 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 06 20:36:27.967568 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:27.967540 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 06 20:36:27.975301 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:27.975276 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bcf7dc475-zh9gs"] Jul 06 20:36:28.067763 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:28.067725 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bd995454f-v4b97"] Jul 06 20:36:28.080600 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:28.080556 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvgfs\" (UniqueName: \"kubernetes.io/projected/605c8ee3-ebee-4784-aafe-e5575f30ee83-kube-api-access-pvgfs\") pod \"cluster-proxy-proxy-agent-6bcf7dc475-zh9gs\" (UID: \"605c8ee3-ebee-4784-aafe-e5575f30ee83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bcf7dc475-zh9gs" Jul 06 20:36:28.080785 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:28.080639 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/605c8ee3-ebee-4784-aafe-e5575f30ee83-ca\") pod \"cluster-proxy-proxy-agent-6bcf7dc475-zh9gs\" (UID: \"605c8ee3-ebee-4784-aafe-e5575f30ee83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bcf7dc475-zh9gs" Jul 06 20:36:28.080785 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:28.080722 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/605c8ee3-ebee-4784-aafe-e5575f30ee83-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6bcf7dc475-zh9gs\" (UID: \"605c8ee3-ebee-4784-aafe-e5575f30ee83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bcf7dc475-zh9gs" Jul 06 20:36:28.080921 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:28.080782 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/605c8ee3-ebee-4784-aafe-e5575f30ee83-hub\") pod \"cluster-proxy-proxy-agent-6bcf7dc475-zh9gs\" (UID: \"605c8ee3-ebee-4784-aafe-e5575f30ee83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bcf7dc475-zh9gs" Jul 06 20:36:28.080921 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:28.080817 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/605c8ee3-ebee-4784-aafe-e5575f30ee83-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6bcf7dc475-zh9gs\" (UID: \"605c8ee3-ebee-4784-aafe-e5575f30ee83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bcf7dc475-zh9gs" Jul 06 20:36:28.080921 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:28.080841 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/605c8ee3-ebee-4784-aafe-e5575f30ee83-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6bcf7dc475-zh9gs\" (UID: \"605c8ee3-ebee-4784-aafe-e5575f30ee83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bcf7dc475-zh9gs" Jul 06 20:36:28.181346 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:28.181307 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvgfs\" (UniqueName: \"kubernetes.io/projected/605c8ee3-ebee-4784-aafe-e5575f30ee83-kube-api-access-pvgfs\") pod \"cluster-proxy-proxy-agent-6bcf7dc475-zh9gs\" (UID: \"605c8ee3-ebee-4784-aafe-e5575f30ee83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bcf7dc475-zh9gs" Jul 06 20:36:28.181533 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:28.181480 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/605c8ee3-ebee-4784-aafe-e5575f30ee83-ca\") pod \"cluster-proxy-proxy-agent-6bcf7dc475-zh9gs\" (UID: \"605c8ee3-ebee-4784-aafe-e5575f30ee83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bcf7dc475-zh9gs" Jul 06 20:36:28.181615 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:28.181550 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/605c8ee3-ebee-4784-aafe-e5575f30ee83-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6bcf7dc475-zh9gs\" (UID: \"605c8ee3-ebee-4784-aafe-e5575f30ee83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bcf7dc475-zh9gs" Jul 06 20:36:28.181669 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:28.181612 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/605c8ee3-ebee-4784-aafe-e5575f30ee83-hub\") pod \"cluster-proxy-proxy-agent-6bcf7dc475-zh9gs\" (UID: \"605c8ee3-ebee-4784-aafe-e5575f30ee83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bcf7dc475-zh9gs" Jul 06 20:36:28.181669 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:28.181650 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/605c8ee3-ebee-4784-aafe-e5575f30ee83-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6bcf7dc475-zh9gs\" (UID: \"605c8ee3-ebee-4784-aafe-e5575f30ee83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bcf7dc475-zh9gs" Jul 06 20:36:28.181765 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:28.181724 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/605c8ee3-ebee-4784-aafe-e5575f30ee83-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6bcf7dc475-zh9gs\" (UID: \"605c8ee3-ebee-4784-aafe-e5575f30ee83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bcf7dc475-zh9gs" Jul 06 20:36:28.182469 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:28.182420 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/605c8ee3-ebee-4784-aafe-e5575f30ee83-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6bcf7dc475-zh9gs\" (UID: \"605c8ee3-ebee-4784-aafe-e5575f30ee83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bcf7dc475-zh9gs" Jul 06 20:36:28.185091 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:28.185064 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/605c8ee3-ebee-4784-aafe-e5575f30ee83-ca\") pod \"cluster-proxy-proxy-agent-6bcf7dc475-zh9gs\" (UID: \"605c8ee3-ebee-4784-aafe-e5575f30ee83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bcf7dc475-zh9gs" Jul 06 20:36:28.185305 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:28.185286 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/605c8ee3-ebee-4784-aafe-e5575f30ee83-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6bcf7dc475-zh9gs\" (UID: \"605c8ee3-ebee-4784-aafe-e5575f30ee83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bcf7dc475-zh9gs" Jul 06 20:36:28.185375 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:28.185323 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/605c8ee3-ebee-4784-aafe-e5575f30ee83-hub\") pod \"cluster-proxy-proxy-agent-6bcf7dc475-zh9gs\" (UID: \"605c8ee3-ebee-4784-aafe-e5575f30ee83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bcf7dc475-zh9gs" Jul 06 20:36:28.185509 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:28.185482 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/605c8ee3-ebee-4784-aafe-e5575f30ee83-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6bcf7dc475-zh9gs\" (UID: \"605c8ee3-ebee-4784-aafe-e5575f30ee83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bcf7dc475-zh9gs" Jul 06 20:36:28.196082 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:28.196051 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvgfs\" (UniqueName: \"kubernetes.io/projected/605c8ee3-ebee-4784-aafe-e5575f30ee83-kube-api-access-pvgfs\") pod \"cluster-proxy-proxy-agent-6bcf7dc475-zh9gs\" (UID: \"605c8ee3-ebee-4784-aafe-e5575f30ee83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bcf7dc475-zh9gs" Jul 06 20:36:28.283322 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:28.283222 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bcf7dc475-zh9gs" Jul 06 20:36:28.445807 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:28.445775 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bcf7dc475-zh9gs"] Jul 06 20:36:28.815824 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:36:28.815784 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod605c8ee3_ebee_4784_aafe_e5575f30ee83.slice/crio-5d2b4210a9c5e9a966197f1d4d413acaa7749f0362084aadf25abd7400039505 WatchSource:0}: Error finding container 5d2b4210a9c5e9a966197f1d4d413acaa7749f0362084aadf25abd7400039505: Status 404 returned error can't find the container with id 5d2b4210a9c5e9a966197f1d4d413acaa7749f0362084aadf25abd7400039505 Jul 06 20:36:29.538329 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:29.538289 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85sm8" event={"ID":"50196b0e-a0bc-4f0b-a51d-8e789a9a890d","Type":"ContainerStarted","Data":"7910c8ead6a36ab7ac1a2891f16e7bb7b5d26fd2964f0d961a023d288f083fa3"} Jul 06 20:36:29.539458 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:29.539433 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bcf7dc475-zh9gs" event={"ID":"605c8ee3-ebee-4784-aafe-e5575f30ee83","Type":"ContainerStarted","Data":"5d2b4210a9c5e9a966197f1d4d413acaa7749f0362084aadf25abd7400039505"} Jul 06 20:36:29.556768 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:29.556696 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-85sm8" podStartSLOduration=33.913546348 podStartE2EDuration="35.556676388s" totalImagesPullingTime="1.64313004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:35:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:36:29.555340665 +0000 UTC m=+91.972590095" watchObservedRunningTime="2026-07-06 20:36:29.556676388 +0000 UTC m=+91.973925819" Jul 06 20:36:31.110485 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:31.110398 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e827580a-4554-4fca-88c6-91eacf3fe7e8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmkcf\" (UID: \"e827580a-4554-4fca-88c6-91eacf3fe7e8\") " pod="openshift-insights/insights-runtime-extractor-cmkcf" Jul 06 20:36:31.113057 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:31.113025 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e827580a-4554-4fca-88c6-91eacf3fe7e8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmkcf\" (UID: \"e827580a-4554-4fca-88c6-91eacf3fe7e8\") " pod="openshift-insights/insights-runtime-extractor-cmkcf" Jul 06 20:36:31.405940 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:31.405887 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cmkcf" Jul 06 20:36:32.569666 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:32.569332 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cmkcf"] Jul 06 20:36:32.585014 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:36:32.584981 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode827580a_4554_4fca_88c6_91eacf3fe7e8.slice/crio-ef3960972a7e4568ac65f1a033618278b0d8bb718c86294a83f1497d20ffb165 WatchSource:0}: Error finding container ef3960972a7e4568ac65f1a033618278b0d8bb718c86294a83f1497d20ffb165: Status 404 returned error can't find the container with id ef3960972a7e4568ac65f1a033618278b0d8bb718c86294a83f1497d20ffb165 Jul 06 20:36:33.559790 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:33.559183 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bcf7dc475-zh9gs" event={"ID":"605c8ee3-ebee-4784-aafe-e5575f30ee83","Type":"ContainerStarted","Data":"e6733aa381c95100695b83c3c6e3c5bb2505e6824c1620444647a617817bff63"} Jul 06 20:36:33.559790 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:33.559247 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bcf7dc475-zh9gs" event={"ID":"605c8ee3-ebee-4784-aafe-e5575f30ee83","Type":"ContainerStarted","Data":"af2cdc65d5fdfb68eaa7b8b48dfc0e8facaf989528cadff920fec60fa9839a02"} Jul 06 20:36:33.559790 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:33.559267 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bcf7dc475-zh9gs" event={"ID":"605c8ee3-ebee-4784-aafe-e5575f30ee83","Type":"ContainerStarted","Data":"74ac393f9c53e90e9dc6f2f73ff4407da38a3a7e1bc181155ce23cc09df15463"} Jul 06 20:36:33.561276 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:33.561246 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cmkcf" event={"ID":"e827580a-4554-4fca-88c6-91eacf3fe7e8","Type":"ContainerStarted","Data":"ef3960972a7e4568ac65f1a033618278b0d8bb718c86294a83f1497d20ffb165"} Jul 06 20:36:33.582989 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:33.582930 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bcf7dc475-zh9gs" podStartSLOduration=2.8924099659999998 podStartE2EDuration="6.582904444s" totalImagesPullingTime="3.690494478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:36:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:36:33.58125858 +0000 UTC m=+95.998508025" watchObservedRunningTime="2026-07-06 20:36:33.582904444 +0000 UTC m=+96.000153867" Jul 06 20:36:36.458016 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:36.457986 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/778034a9-e32b-4305-bdc7-885c6393fcba-metrics-tls\") pod \"dns-default-2p2vp\" (UID: \"778034a9-e32b-4305-bdc7-885c6393fcba\") " pod="openshift-dns/dns-default-2p2vp" Jul 06 20:36:36.460227 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:36.460207 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/778034a9-e32b-4305-bdc7-885c6393fcba-metrics-tls\") pod \"dns-default-2p2vp\" (UID: \"778034a9-e32b-4305-bdc7-885c6393fcba\") " pod="openshift-dns/dns-default-2p2vp" Jul 06 20:36:36.574588 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:36.574552 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cmkcf" event={"ID":"e827580a-4554-4fca-88c6-91eacf3fe7e8","Type":"ContainerStarted","Data":"d87f98e81cfc4033e6827458462005eefc170e8cac1c14f1258ee887f0f4c246"} Jul 06 20:36:36.689471 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:36.689383 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dqcct\"" Jul 06 20:36:36.696004 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:36.695981 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2p2vp" Jul 06 20:36:36.828458 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:36.828385 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2p2vp"] Jul 06 20:36:36.830838 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:36:36.830811 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod778034a9_e32b_4305_bdc7_885c6393fcba.slice/crio-e4f5ae92cc9652304c197e67a3b999de700f396de3853b2eefc1dce81266bd2d WatchSource:0}: Error finding container e4f5ae92cc9652304c197e67a3b999de700f396de3853b2eefc1dce81266bd2d: Status 404 returned error can't find the container with id e4f5ae92cc9652304c197e67a3b999de700f396de3853b2eefc1dce81266bd2d Jul 06 20:36:37.580760 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:37.580659 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cmkcf" event={"ID":"e827580a-4554-4fca-88c6-91eacf3fe7e8","Type":"ContainerStarted","Data":"d2ca6006cbec6e210d0ffef29f0f120acac741d064d4db851a324eb1a974bb42"} Jul 06 20:36:37.581931 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:37.581904 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2p2vp" event={"ID":"778034a9-e32b-4305-bdc7-885c6393fcba","Type":"ContainerStarted","Data":"e4f5ae92cc9652304c197e67a3b999de700f396de3853b2eefc1dce81266bd2d"} Jul 06 20:36:39.468189 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:39.468152 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gvkfp" Jul 06 20:36:39.592011 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:39.591964 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2p2vp" event={"ID":"778034a9-e32b-4305-bdc7-885c6393fcba","Type":"ContainerStarted","Data":"bb8f76547230885dadc7271b7debca55676613c6e5123c2a6f320c874d8626a6"} Jul 06 20:36:40.597498 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:40.597455 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2p2vp" event={"ID":"778034a9-e32b-4305-bdc7-885c6393fcba","Type":"ContainerStarted","Data":"40f6cf66d8f4db4aa2b83477eb9ebcae91af77410ba4a330e868844cba00f5be"} Jul 06 20:36:40.597952 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:40.597526 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2p2vp" Jul 06 20:36:40.599294 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:40.599268 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cmkcf" event={"ID":"e827580a-4554-4fca-88c6-91eacf3fe7e8","Type":"ContainerStarted","Data":"25ff7980c632c3eb3ce302f6c6142b4f9f0026505d68ca25533a07e55a003e79"} Jul 06 20:36:40.620839 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:40.620790 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2p2vp" podStartSLOduration=66.870809641 podStartE2EDuration="1m8.620773659s" totalImagesPullingTime="1.749964018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:35:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:36:40.62040608 +0000 UTC m=+103.037655509" watchObservedRunningTime="2026-07-06 20:36:40.620773659 +0000 UTC m=+103.038023087" Jul 06 20:36:40.641352 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:40.641295 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cmkcf" podStartSLOduration=34.545936604 podStartE2EDuration="41.641276471s" totalImagesPullingTime="7.095339867s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:35:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:36:40.639916726 +0000 UTC m=+103.057166156" watchObservedRunningTime="2026-07-06 20:36:40.641276471 +0000 UTC m=+103.058525900" Jul 06 20:36:42.896296 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:42.896262 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zl5tf"] Jul 06 20:36:42.919127 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:42.919095 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zl5tf" Jul 06 20:36:42.926913 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:42.922226 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 20:36:42.926913 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:42.923245 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gl26r\"" Jul 06 20:36:42.926913 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:42.923284 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 20:36:42.926913 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:42.923369 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 20:36:42.926913 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:42.924009 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 20:36:43.009532 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:43.009479 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zl5tf\" (UID: \"73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9\") " pod="openshift-monitoring/node-exporter-zl5tf" Jul 06 20:36:43.009532 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:43.009529 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9-metrics-client-ca\") pod \"node-exporter-zl5tf\" (UID: \"73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9\") " pod="openshift-monitoring/node-exporter-zl5tf" Jul 06 20:36:43.009785 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:43.009559 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9-node-exporter-textfile\") pod \"node-exporter-zl5tf\" (UID: \"73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9\") " pod="openshift-monitoring/node-exporter-zl5tf" Jul 06 20:36:43.009785 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:43.009636 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9-node-exporter-wtmp\") pod \"node-exporter-zl5tf\" (UID: \"73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9\") " pod="openshift-monitoring/node-exporter-zl5tf" Jul 06 20:36:43.009785 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:43.009683 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9-sys\") pod \"node-exporter-zl5tf\" (UID: \"73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9\") " pod="openshift-monitoring/node-exporter-zl5tf" Jul 06 20:36:43.009785 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:43.009710 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9-node-exporter-accelerators-collector-config\") pod \"node-exporter-zl5tf\" (UID: \"73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9\") " pod="openshift-monitoring/node-exporter-zl5tf" Jul 06 20:36:43.009785 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:43.009738 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj44r\" (UniqueName: \"kubernetes.io/projected/73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9-kube-api-access-wj44r\") pod \"node-exporter-zl5tf\" (UID: \"73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9\") " pod="openshift-monitoring/node-exporter-zl5tf" Jul 06 20:36:43.010034 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:43.009822 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9-root\") pod \"node-exporter-zl5tf\" (UID: \"73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9\") " pod="openshift-monitoring/node-exporter-zl5tf" Jul 06 20:36:43.010034 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:43.009862 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9-node-exporter-tls\") pod \"node-exporter-zl5tf\" (UID: \"73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9\") " pod="openshift-monitoring/node-exporter-zl5tf" Jul 06 20:36:43.110583 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:43.110538 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9-root\") pod \"node-exporter-zl5tf\" (UID: \"73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9\") " pod="openshift-monitoring/node-exporter-zl5tf" Jul 06 20:36:43.110757 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:43.110661 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9-root\") pod \"node-exporter-zl5tf\" (UID: \"73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9\") " pod="openshift-monitoring/node-exporter-zl5tf" Jul 06 20:36:43.110856 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:43.110834 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9-node-exporter-tls\") pod \"node-exporter-zl5tf\" (UID: \"73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9\") " pod="openshift-monitoring/node-exporter-zl5tf" Jul 06 20:36:43.110981 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:43.110962 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zl5tf\" (UID: \"73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9\") " pod="openshift-monitoring/node-exporter-zl5tf" Jul 06 20:36:43.111043 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:43.110983 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 06 20:36:43.111043 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:43.110994 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9-metrics-client-ca\") pod \"node-exporter-zl5tf\" (UID: \"73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9\") " pod="openshift-monitoring/node-exporter-zl5tf" Jul 06 20:36:43.111043 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:43.111028 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9-node-exporter-textfile\") pod \"node-exporter-zl5tf\" (UID: \"73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9\") " pod="openshift-monitoring/node-exporter-zl5tf" Jul 06 20:36:43.111198 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:43.111154 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9-node-exporter-tls podName:73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9 nodeName:}" failed. No retries permitted until 2026-07-06 20:36:43.611043312 +0000 UTC m=+106.028292729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9-node-exporter-tls") pod "node-exporter-zl5tf" (UID: "73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9") : secret "node-exporter-tls" not found Jul 06 20:36:43.111326 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:43.111292 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9-node-exporter-wtmp\") pod \"node-exporter-zl5tf\" (UID: \"73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9\") " pod="openshift-monitoring/node-exporter-zl5tf" Jul 06 20:36:43.111449 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:43.111431 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9-sys\") pod \"node-exporter-zl5tf\" (UID: \"73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9\") " pod="openshift-monitoring/node-exporter-zl5tf" Jul 06 20:36:43.111546 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:43.111529 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9-node-exporter-accelerators-collector-config\") pod \"node-exporter-zl5tf\" (UID: \"73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9\") " pod="openshift-monitoring/node-exporter-zl5tf" Jul 06 20:36:43.111670 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:43.111654 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj44r\" (UniqueName: \"kubernetes.io/projected/73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9-kube-api-access-wj44r\") pod \"node-exporter-zl5tf\" (UID: \"73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9\") " pod="openshift-monitoring/node-exporter-zl5tf" Jul 06 20:36:43.111783 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:43.111733 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9-metrics-client-ca\") pod \"node-exporter-zl5tf\" (UID: \"73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9\") " pod="openshift-monitoring/node-exporter-zl5tf" Jul 06 20:36:43.111783 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:43.111747 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9-sys\") pod \"node-exporter-zl5tf\" (UID: \"73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9\") " pod="openshift-monitoring/node-exporter-zl5tf" Jul 06 20:36:43.111783 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:43.111383 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9-node-exporter-textfile\") pod \"node-exporter-zl5tf\" (UID: \"73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9\") " pod="openshift-monitoring/node-exporter-zl5tf" Jul 06 20:36:43.111783 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:43.111706 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9-node-exporter-wtmp\") pod \"node-exporter-zl5tf\" (UID: \"73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9\") " pod="openshift-monitoring/node-exporter-zl5tf" Jul 06 20:36:43.112149 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:43.112131 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9-node-exporter-accelerators-collector-config\") pod \"node-exporter-zl5tf\" (UID: \"73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9\") " pod="openshift-monitoring/node-exporter-zl5tf" Jul 06 20:36:43.114175 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:43.114154 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zl5tf\" (UID: \"73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9\") " pod="openshift-monitoring/node-exporter-zl5tf" Jul 06 20:36:43.126221 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:43.126175 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj44r\" (UniqueName: \"kubernetes.io/projected/73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9-kube-api-access-wj44r\") pod \"node-exporter-zl5tf\" (UID: \"73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9\") " pod="openshift-monitoring/node-exporter-zl5tf" Jul 06 20:36:43.615205 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:43.615165 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9-node-exporter-tls\") pod \"node-exporter-zl5tf\" (UID: \"73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9\") " pod="openshift-monitoring/node-exporter-zl5tf" Jul 06 20:36:43.617602 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:43.617575 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9-node-exporter-tls\") pod \"node-exporter-zl5tf\" (UID: \"73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9\") " pod="openshift-monitoring/node-exporter-zl5tf" Jul 06 20:36:43.837720 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:43.837683 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zl5tf" Jul 06 20:36:43.878221 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:36:43.878184 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73ee17a0_7dd3_4a84_acd1_7f81a9dac5e9.slice/crio-9bdc5497a2f2e850f1c6d74acb22d9c5d20a1c4b6fbbb3bf0ca57c6ddf15e290 WatchSource:0}: Error finding container 9bdc5497a2f2e850f1c6d74acb22d9c5d20a1c4b6fbbb3bf0ca57c6ddf15e290: Status 404 returned error can't find the container with id 9bdc5497a2f2e850f1c6d74acb22d9c5d20a1c4b6fbbb3bf0ca57c6ddf15e290 Jul 06 20:36:44.615570 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:44.615532 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zl5tf" event={"ID":"73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9","Type":"ContainerStarted","Data":"9bdc5497a2f2e850f1c6d74acb22d9c5d20a1c4b6fbbb3bf0ca57c6ddf15e290"} Jul 06 20:36:45.620853 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:45.620813 2562 generic.go:356] "Generic (PLEG): container finished" podID="73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9" containerID="e46e48daebbd7363542e035207b5ae545e0f23df370260220d76bb85f83baa2c" exitCode=0 Jul 06 20:36:45.621245 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:45.620901 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zl5tf" event={"ID":"73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9","Type":"ContainerDied","Data":"e46e48daebbd7363542e035207b5ae545e0f23df370260220d76bb85f83baa2c"} Jul 06 20:36:46.625978 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:46.625944 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zl5tf" event={"ID":"73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9","Type":"ContainerStarted","Data":"8cf24e47c117ffbd0af60b90043bdc4625e6481adca894aaf7a2715415871919"} Jul 06 20:36:46.626353 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:46.626002 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zl5tf" event={"ID":"73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9","Type":"ContainerStarted","Data":"074a6341e7048126da23b72469d2e7fb4750d67c61a07a21d3beba27347123a0"} Jul 06 20:36:46.649480 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:46.649419 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zl5tf" podStartSLOduration=3.504188874 podStartE2EDuration="4.649402996s" totalImagesPullingTime="1.077560677s" totalInitContainerRuntime="67.653445ms" isStatefulPod=true podCreationTimestamp="2026-07-06 20:36:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:36:46.648576571 +0000 UTC m=+109.065826001" watchObservedRunningTime="2026-07-06 20:36:46.649402996 +0000 UTC m=+109.066652424" Jul 06 20:36:49.470171 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:49.470136 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-756cfd8566-gnswd"] Jul 06 20:36:49.472239 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:49.472221 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-756cfd8566-gnswd" Jul 06 20:36:49.476518 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:49.476487 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 20:36:49.476783 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:49.476495 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 20:36:49.476902 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:49.476521 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 20:36:49.476902 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:49.476852 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 20:36:49.476902 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:49.476543 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-n2dlm\"" Jul 06 20:36:49.476902 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:49.476604 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 20:36:49.477066 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:49.476607 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 20:36:49.477066 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:49.476521 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 20:36:49.481112 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:49.481091 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 20:36:49.485739 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:49.485717 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-756cfd8566-gnswd"] Jul 06 20:36:49.545666 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:49.545637 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5bd995454f-v4b97" Jul 06 20:36:49.565466 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:49.565432 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-console-oauth-config\") pod \"console-756cfd8566-gnswd\" (UID: \"d5cfb151-e8d2-49bc-b546-5b8366dc83ca\") " pod="openshift-console/console-756cfd8566-gnswd" Jul 06 20:36:49.565638 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:49.565476 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29zxc\" (UniqueName: \"kubernetes.io/projected/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-kube-api-access-29zxc\") pod \"console-756cfd8566-gnswd\" (UID: \"d5cfb151-e8d2-49bc-b546-5b8366dc83ca\") " pod="openshift-console/console-756cfd8566-gnswd" Jul 06 20:36:49.565638 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:49.565510 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-console-config\") pod \"console-756cfd8566-gnswd\" (UID: \"d5cfb151-e8d2-49bc-b546-5b8366dc83ca\") " pod="openshift-console/console-756cfd8566-gnswd" Jul 06 20:36:49.565638 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:49.565556 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-service-ca\") pod \"console-756cfd8566-gnswd\" (UID: \"d5cfb151-e8d2-49bc-b546-5b8366dc83ca\") " pod="openshift-console/console-756cfd8566-gnswd" Jul 06 20:36:49.565638 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:49.565598 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-console-serving-cert\") pod \"console-756cfd8566-gnswd\" (UID: \"d5cfb151-e8d2-49bc-b546-5b8366dc83ca\") " pod="openshift-console/console-756cfd8566-gnswd" Jul 06 20:36:49.565638 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:49.565635 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-oauth-serving-cert\") pod \"console-756cfd8566-gnswd\" (UID: \"d5cfb151-e8d2-49bc-b546-5b8366dc83ca\") " pod="openshift-console/console-756cfd8566-gnswd" Jul 06 20:36:49.565814 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:49.565671 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-trusted-ca-bundle\") pod \"console-756cfd8566-gnswd\" (UID: \"d5cfb151-e8d2-49bc-b546-5b8366dc83ca\") " pod="openshift-console/console-756cfd8566-gnswd" Jul 06 20:36:49.666871 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:49.666828 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29zxc\" (UniqueName: \"kubernetes.io/projected/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-kube-api-access-29zxc\") pod \"console-756cfd8566-gnswd\" (UID: \"d5cfb151-e8d2-49bc-b546-5b8366dc83ca\") " pod="openshift-console/console-756cfd8566-gnswd" Jul 06 20:36:49.667079 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:49.666902 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-console-config\") pod \"console-756cfd8566-gnswd\" (UID: \"d5cfb151-e8d2-49bc-b546-5b8366dc83ca\") " pod="openshift-console/console-756cfd8566-gnswd" Jul 06 20:36:49.667079 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:49.666930 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-service-ca\") pod \"console-756cfd8566-gnswd\" (UID: \"d5cfb151-e8d2-49bc-b546-5b8366dc83ca\") " pod="openshift-console/console-756cfd8566-gnswd" Jul 06 20:36:49.667079 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:49.666957 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-console-serving-cert\") pod \"console-756cfd8566-gnswd\" (UID: \"d5cfb151-e8d2-49bc-b546-5b8366dc83ca\") " pod="openshift-console/console-756cfd8566-gnswd" Jul 06 20:36:49.667079 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:49.666990 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-oauth-serving-cert\") pod \"console-756cfd8566-gnswd\" (UID: \"d5cfb151-e8d2-49bc-b546-5b8366dc83ca\") " pod="openshift-console/console-756cfd8566-gnswd" Jul 06 20:36:49.667079 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:49.667023 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-trusted-ca-bundle\") pod \"console-756cfd8566-gnswd\" (UID: \"d5cfb151-e8d2-49bc-b546-5b8366dc83ca\") " pod="openshift-console/console-756cfd8566-gnswd" Jul 06 20:36:49.667079 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:49.667073 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-console-oauth-config\") pod \"console-756cfd8566-gnswd\" (UID: \"d5cfb151-e8d2-49bc-b546-5b8366dc83ca\") " pod="openshift-console/console-756cfd8566-gnswd" Jul 06 20:36:49.667749 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:49.667721 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-service-ca\") pod \"console-756cfd8566-gnswd\" (UID: \"d5cfb151-e8d2-49bc-b546-5b8366dc83ca\") " pod="openshift-console/console-756cfd8566-gnswd" Jul 06 20:36:49.667864 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:49.667787 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-console-config\") pod \"console-756cfd8566-gnswd\" (UID: \"d5cfb151-e8d2-49bc-b546-5b8366dc83ca\") " pod="openshift-console/console-756cfd8566-gnswd" Jul 06 20:36:49.667972 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:49.667952 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-trusted-ca-bundle\") pod \"console-756cfd8566-gnswd\" (UID: \"d5cfb151-e8d2-49bc-b546-5b8366dc83ca\") " pod="openshift-console/console-756cfd8566-gnswd" Jul 06 20:36:49.668028 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:49.668011 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-oauth-serving-cert\") pod \"console-756cfd8566-gnswd\" (UID: \"d5cfb151-e8d2-49bc-b546-5b8366dc83ca\") " pod="openshift-console/console-756cfd8566-gnswd" Jul 06 20:36:49.669651 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:49.669626 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-console-oauth-config\") pod \"console-756cfd8566-gnswd\" (UID: \"d5cfb151-e8d2-49bc-b546-5b8366dc83ca\") " pod="openshift-console/console-756cfd8566-gnswd" Jul 06 20:36:49.669742 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:49.669724 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-console-serving-cert\") pod \"console-756cfd8566-gnswd\" (UID: \"d5cfb151-e8d2-49bc-b546-5b8366dc83ca\") " pod="openshift-console/console-756cfd8566-gnswd" Jul 06 20:36:49.675992 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:49.675956 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29zxc\" (UniqueName: \"kubernetes.io/projected/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-kube-api-access-29zxc\") pod \"console-756cfd8566-gnswd\" (UID: \"d5cfb151-e8d2-49bc-b546-5b8366dc83ca\") " pod="openshift-console/console-756cfd8566-gnswd" Jul 06 20:36:49.781819 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:49.781721 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-756cfd8566-gnswd" Jul 06 20:36:49.913674 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:49.913648 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-756cfd8566-gnswd"] Jul 06 20:36:49.916343 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:36:49.916314 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5cfb151_e8d2_49bc_b546_5b8366dc83ca.slice/crio-fefc95ad7ae9a5d57f03e7b2c54a9b5326c08bde96d1240d6ee747fb9b519391 WatchSource:0}: Error finding container fefc95ad7ae9a5d57f03e7b2c54a9b5326c08bde96d1240d6ee747fb9b519391: Status 404 returned error can't find the container with id fefc95ad7ae9a5d57f03e7b2c54a9b5326c08bde96d1240d6ee747fb9b519391 Jul 06 20:36:50.605616 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:50.605579 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2p2vp" Jul 06 20:36:50.642100 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:50.642058 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-756cfd8566-gnswd" event={"ID":"d5cfb151-e8d2-49bc-b546-5b8366dc83ca","Type":"ContainerStarted","Data":"fefc95ad7ae9a5d57f03e7b2c54a9b5326c08bde96d1240d6ee747fb9b519391"} Jul 06 20:36:52.771339 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:52.771312 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-756cfd8566-gnswd"] Jul 06 20:36:52.814576 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:52.814546 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54b69b94c8-ggm9q"] Jul 06 20:36:52.816504 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:52.816471 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54b69b94c8-ggm9q" Jul 06 20:36:52.837346 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:52.837273 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54b69b94c8-ggm9q"] Jul 06 20:36:52.894705 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:52.894675 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6afc23be-733d-4d6a-886e-5e0b7403175c-console-oauth-config\") pod \"console-54b69b94c8-ggm9q\" (UID: \"6afc23be-733d-4d6a-886e-5e0b7403175c\") " pod="openshift-console/console-54b69b94c8-ggm9q" Jul 06 20:36:52.894909 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:52.894712 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjm2z\" (UniqueName: \"kubernetes.io/projected/6afc23be-733d-4d6a-886e-5e0b7403175c-kube-api-access-tjm2z\") pod \"console-54b69b94c8-ggm9q\" (UID: \"6afc23be-733d-4d6a-886e-5e0b7403175c\") " pod="openshift-console/console-54b69b94c8-ggm9q" Jul 06 20:36:52.894909 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:52.894741 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6afc23be-733d-4d6a-886e-5e0b7403175c-trusted-ca-bundle\") pod \"console-54b69b94c8-ggm9q\" (UID: \"6afc23be-733d-4d6a-886e-5e0b7403175c\") " pod="openshift-console/console-54b69b94c8-ggm9q" Jul 06 20:36:52.894909 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:52.894765 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6afc23be-733d-4d6a-886e-5e0b7403175c-console-config\") pod \"console-54b69b94c8-ggm9q\" (UID: \"6afc23be-733d-4d6a-886e-5e0b7403175c\") " pod="openshift-console/console-54b69b94c8-ggm9q" Jul 06 20:36:52.895077 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:52.894899 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6afc23be-733d-4d6a-886e-5e0b7403175c-console-serving-cert\") pod \"console-54b69b94c8-ggm9q\" (UID: \"6afc23be-733d-4d6a-886e-5e0b7403175c\") " pod="openshift-console/console-54b69b94c8-ggm9q" Jul 06 20:36:52.895077 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:52.894956 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6afc23be-733d-4d6a-886e-5e0b7403175c-oauth-serving-cert\") pod \"console-54b69b94c8-ggm9q\" (UID: \"6afc23be-733d-4d6a-886e-5e0b7403175c\") " pod="openshift-console/console-54b69b94c8-ggm9q" Jul 06 20:36:52.895077 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:52.895004 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6afc23be-733d-4d6a-886e-5e0b7403175c-service-ca\") pod \"console-54b69b94c8-ggm9q\" (UID: \"6afc23be-733d-4d6a-886e-5e0b7403175c\") " pod="openshift-console/console-54b69b94c8-ggm9q" Jul 06 20:36:52.996036 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:52.995929 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6afc23be-733d-4d6a-886e-5e0b7403175c-service-ca\") pod \"console-54b69b94c8-ggm9q\" (UID: \"6afc23be-733d-4d6a-886e-5e0b7403175c\") " pod="openshift-console/console-54b69b94c8-ggm9q" Jul 06 20:36:52.996036 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:52.995977 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6afc23be-733d-4d6a-886e-5e0b7403175c-console-oauth-config\") pod \"console-54b69b94c8-ggm9q\" (UID: \"6afc23be-733d-4d6a-886e-5e0b7403175c\") " pod="openshift-console/console-54b69b94c8-ggm9q" Jul 06 20:36:52.996036 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:52.995997 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjm2z\" (UniqueName: \"kubernetes.io/projected/6afc23be-733d-4d6a-886e-5e0b7403175c-kube-api-access-tjm2z\") pod \"console-54b69b94c8-ggm9q\" (UID: \"6afc23be-733d-4d6a-886e-5e0b7403175c\") " pod="openshift-console/console-54b69b94c8-ggm9q" Jul 06 20:36:52.996036 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:52.996033 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6afc23be-733d-4d6a-886e-5e0b7403175c-trusted-ca-bundle\") pod \"console-54b69b94c8-ggm9q\" (UID: \"6afc23be-733d-4d6a-886e-5e0b7403175c\") " pod="openshift-console/console-54b69b94c8-ggm9q" Jul 06 20:36:52.996367 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:52.996070 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6afc23be-733d-4d6a-886e-5e0b7403175c-console-config\") pod \"console-54b69b94c8-ggm9q\" (UID: \"6afc23be-733d-4d6a-886e-5e0b7403175c\") " pod="openshift-console/console-54b69b94c8-ggm9q" Jul 06 20:36:52.996367 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:52.996128 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6afc23be-733d-4d6a-886e-5e0b7403175c-console-serving-cert\") pod \"console-54b69b94c8-ggm9q\" (UID: \"6afc23be-733d-4d6a-886e-5e0b7403175c\") " pod="openshift-console/console-54b69b94c8-ggm9q" Jul 06 20:36:52.996367 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:52.996163 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6afc23be-733d-4d6a-886e-5e0b7403175c-oauth-serving-cert\") pod \"console-54b69b94c8-ggm9q\" (UID: \"6afc23be-733d-4d6a-886e-5e0b7403175c\") " pod="openshift-console/console-54b69b94c8-ggm9q" Jul 06 20:36:52.996746 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:52.996718 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6afc23be-733d-4d6a-886e-5e0b7403175c-service-ca\") pod \"console-54b69b94c8-ggm9q\" (UID: \"6afc23be-733d-4d6a-886e-5e0b7403175c\") " pod="openshift-console/console-54b69b94c8-ggm9q" Jul 06 20:36:52.996931 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:52.996873 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6afc23be-733d-4d6a-886e-5e0b7403175c-console-config\") pod \"console-54b69b94c8-ggm9q\" (UID: \"6afc23be-733d-4d6a-886e-5e0b7403175c\") " pod="openshift-console/console-54b69b94c8-ggm9q" Jul 06 20:36:52.997020 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:52.996929 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6afc23be-733d-4d6a-886e-5e0b7403175c-oauth-serving-cert\") pod \"console-54b69b94c8-ggm9q\" (UID: \"6afc23be-733d-4d6a-886e-5e0b7403175c\") " pod="openshift-console/console-54b69b94c8-ggm9q" Jul 06 20:36:52.997103 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:52.997084 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6afc23be-733d-4d6a-886e-5e0b7403175c-trusted-ca-bundle\") pod \"console-54b69b94c8-ggm9q\" (UID: \"6afc23be-733d-4d6a-886e-5e0b7403175c\") " pod="openshift-console/console-54b69b94c8-ggm9q" Jul 06 20:36:52.998602 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:52.998579 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6afc23be-733d-4d6a-886e-5e0b7403175c-console-serving-cert\") pod \"console-54b69b94c8-ggm9q\" (UID: \"6afc23be-733d-4d6a-886e-5e0b7403175c\") " pod="openshift-console/console-54b69b94c8-ggm9q" Jul 06 20:36:52.998696 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:52.998630 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6afc23be-733d-4d6a-886e-5e0b7403175c-console-oauth-config\") pod \"console-54b69b94c8-ggm9q\" (UID: \"6afc23be-733d-4d6a-886e-5e0b7403175c\") " pod="openshift-console/console-54b69b94c8-ggm9q" Jul 06 20:36:53.007115 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:53.007092 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjm2z\" (UniqueName: \"kubernetes.io/projected/6afc23be-733d-4d6a-886e-5e0b7403175c-kube-api-access-tjm2z\") pod \"console-54b69b94c8-ggm9q\" (UID: \"6afc23be-733d-4d6a-886e-5e0b7403175c\") " pod="openshift-console/console-54b69b94c8-ggm9q" Jul 06 20:36:53.128633 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:53.128576 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54b69b94c8-ggm9q" Jul 06 20:36:53.263002 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:53.262798 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54b69b94c8-ggm9q"] Jul 06 20:36:53.265427 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:36:53.265400 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6afc23be_733d_4d6a_886e_5e0b7403175c.slice/crio-0dc803cb64ff0f35561a61c5e275747f63f8a41f4c179958345d143101d1ec90 WatchSource:0}: Error finding container 0dc803cb64ff0f35561a61c5e275747f63f8a41f4c179958345d143101d1ec90: Status 404 returned error can't find the container with id 0dc803cb64ff0f35561a61c5e275747f63f8a41f4c179958345d143101d1ec90 Jul 06 20:36:53.655806 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:53.655765 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54b69b94c8-ggm9q" event={"ID":"6afc23be-733d-4d6a-886e-5e0b7403175c","Type":"ContainerStarted","Data":"4cea2a1963d7856cd1a985db552ddaaa1298b63ea5460998624b264b673f222e"} Jul 06 20:36:53.656112 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:53.655832 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54b69b94c8-ggm9q" event={"ID":"6afc23be-733d-4d6a-886e-5e0b7403175c","Type":"ContainerStarted","Data":"0dc803cb64ff0f35561a61c5e275747f63f8a41f4c179958345d143101d1ec90"} Jul 06 20:36:53.657270 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:53.657245 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-756cfd8566-gnswd" event={"ID":"d5cfb151-e8d2-49bc-b546-5b8366dc83ca","Type":"ContainerStarted","Data":"8a6779fb40336b791f864e440718b2c01b4c31fd1506df97f7f67521e764aca6"} Jul 06 20:36:53.702177 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:53.702118 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54b69b94c8-ggm9q" podStartSLOduration=1.702101106 podStartE2EDuration="1.702101106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:36:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:36:53.678280016 +0000 UTC m=+116.095529446" watchObservedRunningTime="2026-07-06 20:36:53.702101106 +0000 UTC m=+116.119350534" Jul 06 20:36:53.706899 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:53.703798 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-756cfd8566-gnswd" podStartSLOduration=1.877249956 podStartE2EDuration="4.703779776s" totalImagesPullingTime="2.82652982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:36:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:36:53.701272341 +0000 UTC m=+116.118521771" watchObservedRunningTime="2026-07-06 20:36:53.703779776 +0000 UTC m=+116.121029208" Jul 06 20:36:54.559503 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:54.559452 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5bd995454f-v4b97" podUID="8da873c1-d92e-4dec-b980-e470b5263d61" containerName="registry" containerID="cri-o://08ee553f4000c3278610e84338a27e2f044884252618bd3f86a782c1d94308a0" gracePeriod=30 Jul 06 20:36:54.801002 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:54.800975 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bd995454f-v4b97" Jul 06 20:36:54.914581 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:54.914538 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8da873c1-d92e-4dec-b980-e470b5263d61-registry-tls\") pod \"8da873c1-d92e-4dec-b980-e470b5263d61\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " Jul 06 20:36:54.914581 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:54.914591 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8da873c1-d92e-4dec-b980-e470b5263d61-installation-pull-secrets\") pod \"8da873c1-d92e-4dec-b980-e470b5263d61\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " Jul 06 20:36:54.914810 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:54.914635 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8da873c1-d92e-4dec-b980-e470b5263d61-bound-sa-token\") pod \"8da873c1-d92e-4dec-b980-e470b5263d61\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " Jul 06 20:36:54.914810 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:54.914759 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8da873c1-d92e-4dec-b980-e470b5263d61-registry-certificates\") pod \"8da873c1-d92e-4dec-b980-e470b5263d61\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " Jul 06 20:36:54.914952 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:54.914826 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8da873c1-d92e-4dec-b980-e470b5263d61-trusted-ca\") pod \"8da873c1-d92e-4dec-b980-e470b5263d61\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " Jul 06 20:36:54.914952 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:54.914874 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jv6p\" (UniqueName: \"kubernetes.io/projected/8da873c1-d92e-4dec-b980-e470b5263d61-kube-api-access-8jv6p\") pod \"8da873c1-d92e-4dec-b980-e470b5263d61\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " Jul 06 20:36:54.914952 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:54.914948 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8da873c1-d92e-4dec-b980-e470b5263d61-image-registry-private-configuration\") pod \"8da873c1-d92e-4dec-b980-e470b5263d61\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " Jul 06 20:36:54.915107 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:54.914988 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8da873c1-d92e-4dec-b980-e470b5263d61-ca-trust-extracted\") pod \"8da873c1-d92e-4dec-b980-e470b5263d61\" (UID: \"8da873c1-d92e-4dec-b980-e470b5263d61\") " Jul 06 20:36:54.915284 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:54.915245 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8da873c1-d92e-4dec-b980-e470b5263d61-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8da873c1-d92e-4dec-b980-e470b5263d61" (UID: "8da873c1-d92e-4dec-b980-e470b5263d61"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:36:54.915427 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:54.915284 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8da873c1-d92e-4dec-b980-e470b5263d61-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8da873c1-d92e-4dec-b980-e470b5263d61" (UID: "8da873c1-d92e-4dec-b980-e470b5263d61"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:36:54.917371 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:54.917336 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8da873c1-d92e-4dec-b980-e470b5263d61-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8da873c1-d92e-4dec-b980-e470b5263d61" (UID: "8da873c1-d92e-4dec-b980-e470b5263d61"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:36:54.917371 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:54.917356 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8da873c1-d92e-4dec-b980-e470b5263d61-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8da873c1-d92e-4dec-b980-e470b5263d61" (UID: "8da873c1-d92e-4dec-b980-e470b5263d61"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:36:54.917548 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:54.917463 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8da873c1-d92e-4dec-b980-e470b5263d61-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8da873c1-d92e-4dec-b980-e470b5263d61" (UID: "8da873c1-d92e-4dec-b980-e470b5263d61"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:36:54.917548 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:54.917488 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8da873c1-d92e-4dec-b980-e470b5263d61-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8da873c1-d92e-4dec-b980-e470b5263d61" (UID: "8da873c1-d92e-4dec-b980-e470b5263d61"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:36:54.917548 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:54.917534 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8da873c1-d92e-4dec-b980-e470b5263d61-kube-api-access-8jv6p" (OuterVolumeSpecName: "kube-api-access-8jv6p") pod "8da873c1-d92e-4dec-b980-e470b5263d61" (UID: "8da873c1-d92e-4dec-b980-e470b5263d61"). InnerVolumeSpecName "kube-api-access-8jv6p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:36:54.923791 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:54.923764 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8da873c1-d92e-4dec-b980-e470b5263d61-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8da873c1-d92e-4dec-b980-e470b5263d61" (UID: "8da873c1-d92e-4dec-b980-e470b5263d61"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:36:55.016352 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:55.016310 2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8da873c1-d92e-4dec-b980-e470b5263d61-ca-trust-extracted\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 20:36:55.016352 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:55.016344 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8da873c1-d92e-4dec-b980-e470b5263d61-registry-tls\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 20:36:55.016352 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:55.016354 2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8da873c1-d92e-4dec-b980-e470b5263d61-installation-pull-secrets\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 20:36:55.016352 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:55.016365 2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8da873c1-d92e-4dec-b980-e470b5263d61-bound-sa-token\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 20:36:55.016613 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:55.016373 2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8da873c1-d92e-4dec-b980-e470b5263d61-registry-certificates\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 20:36:55.016613 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:55.016382 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8da873c1-d92e-4dec-b980-e470b5263d61-trusted-ca\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 20:36:55.016613 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:55.016390 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jv6p\" (UniqueName: \"kubernetes.io/projected/8da873c1-d92e-4dec-b980-e470b5263d61-kube-api-access-8jv6p\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 20:36:55.016613 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:55.016399 2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8da873c1-d92e-4dec-b980-e470b5263d61-image-registry-private-configuration\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 20:36:55.666820 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:55.666781 2562 generic.go:356] "Generic (PLEG): container finished" podID="8da873c1-d92e-4dec-b980-e470b5263d61" containerID="08ee553f4000c3278610e84338a27e2f044884252618bd3f86a782c1d94308a0" exitCode=0 Jul 06 20:36:55.667242 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:55.666832 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bd995454f-v4b97" Jul 06 20:36:55.667242 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:55.666865 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bd995454f-v4b97" event={"ID":"8da873c1-d92e-4dec-b980-e470b5263d61","Type":"ContainerDied","Data":"08ee553f4000c3278610e84338a27e2f044884252618bd3f86a782c1d94308a0"} Jul 06 20:36:55.667242 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:55.666940 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bd995454f-v4b97" event={"ID":"8da873c1-d92e-4dec-b980-e470b5263d61","Type":"ContainerDied","Data":"6010dcd6309addf24f326610c1b3bd3d8b6a2735c8a77df0e13f655f70b8332a"} Jul 06 20:36:55.667242 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:55.666974 2562 scope.go:117] "RemoveContainer" containerID="08ee553f4000c3278610e84338a27e2f044884252618bd3f86a782c1d94308a0" Jul 06 20:36:55.675739 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:55.675718 2562 scope.go:117] "RemoveContainer" containerID="08ee553f4000c3278610e84338a27e2f044884252618bd3f86a782c1d94308a0" Jul 06 20:36:55.676068 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:36:55.676046 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08ee553f4000c3278610e84338a27e2f044884252618bd3f86a782c1d94308a0\": container with ID starting with 08ee553f4000c3278610e84338a27e2f044884252618bd3f86a782c1d94308a0 not found: ID does not exist" containerID="08ee553f4000c3278610e84338a27e2f044884252618bd3f86a782c1d94308a0" Jul 06 20:36:55.676121 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:55.676077 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08ee553f4000c3278610e84338a27e2f044884252618bd3f86a782c1d94308a0"} err="failed to get container status \"08ee553f4000c3278610e84338a27e2f044884252618bd3f86a782c1d94308a0\": rpc error: code = NotFound desc = could not find container \"08ee553f4000c3278610e84338a27e2f044884252618bd3f86a782c1d94308a0\": container with ID starting with 08ee553f4000c3278610e84338a27e2f044884252618bd3f86a782c1d94308a0 not found: ID does not exist" Jul 06 20:36:55.687772 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:55.687738 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bd995454f-v4b97"] Jul 06 20:36:55.692122 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:55.692087 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5bd995454f-v4b97"] Jul 06 20:36:56.100789 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:56.100710 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8da873c1-d92e-4dec-b980-e470b5263d61" path="/var/lib/kubelet/pods/8da873c1-d92e-4dec-b980-e470b5263d61/volumes" Jul 06 20:36:59.782237 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:36:59.782198 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-756cfd8566-gnswd" Jul 06 20:37:03.128795 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:03.128758 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54b69b94c8-ggm9q" Jul 06 20:37:03.129288 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:03.128826 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54b69b94c8-ggm9q" Jul 06 20:37:03.133638 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:03.133615 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54b69b94c8-ggm9q" Jul 06 20:37:03.699444 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:03.699413 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54b69b94c8-ggm9q" Jul 06 20:37:06.915696 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:06.915653 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5620d06-ce9a-457c-8636-a60ad8234202-metrics-certs\") pod \"network-metrics-daemon-mjfls\" (UID: \"b5620d06-ce9a-457c-8636-a60ad8234202\") " pod="openshift-multus/network-metrics-daemon-mjfls" Jul 06 20:37:06.918036 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:06.918013 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5620d06-ce9a-457c-8636-a60ad8234202-metrics-certs\") pod \"network-metrics-daemon-mjfls\" (UID: \"b5620d06-ce9a-457c-8636-a60ad8234202\") " pod="openshift-multus/network-metrics-daemon-mjfls" Jul 06 20:37:07.112451 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:07.112414 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dl572\"" Jul 06 20:37:07.120505 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:07.120468 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mjfls" Jul 06 20:37:07.266508 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:07.266467 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mjfls"] Jul 06 20:37:07.271244 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:37:07.271208 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5620d06_ce9a_457c_8636_a60ad8234202.slice/crio-f6b5eda4f075690ee5d392b38788f27b88d0337c477a9d65007c2d59c9a51f14 WatchSource:0}: Error finding container f6b5eda4f075690ee5d392b38788f27b88d0337c477a9d65007c2d59c9a51f14: Status 404 returned error can't find the container with id f6b5eda4f075690ee5d392b38788f27b88d0337c477a9d65007c2d59c9a51f14 Jul 06 20:37:07.711157 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:07.711112 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mjfls" event={"ID":"b5620d06-ce9a-457c-8636-a60ad8234202","Type":"ContainerStarted","Data":"f6b5eda4f075690ee5d392b38788f27b88d0337c477a9d65007c2d59c9a51f14"} Jul 06 20:37:08.716656 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:08.716613 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mjfls" event={"ID":"b5620d06-ce9a-457c-8636-a60ad8234202","Type":"ContainerStarted","Data":"7958e20aa8ecd0c87dfb22ebabf9d92aa82108e187f9f5a30beee3cef3804490"} Jul 06 20:37:08.717124 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:08.716673 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mjfls" event={"ID":"b5620d06-ce9a-457c-8636-a60ad8234202","Type":"ContainerStarted","Data":"099b537c025c0ecc755cebdeeea911276388797565c175a0e8899516462374f6"} Jul 06 20:37:08.736538 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:08.736487 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mjfls" podStartSLOduration=129.942538674 podStartE2EDuration="2m10.736469205s" totalImagesPullingTime="793.930531ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:34:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:37:08.735758954 +0000 UTC m=+131.153008382" watchObservedRunningTime="2026-07-06 20:37:08.736469205 +0000 UTC m=+131.153718634" Jul 06 20:37:18.677040 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:18.676980 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-756cfd8566-gnswd" podUID="d5cfb151-e8d2-49bc-b546-5b8366dc83ca" containerName="console" containerID="cri-o://8a6779fb40336b791f864e440718b2c01b4c31fd1506df97f7f67521e764aca6" gracePeriod=15 Jul 06 20:37:18.757429 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:18.757392 2562 generic.go:356] "Generic (PLEG): container finished" podID="0f6cd921-5c67-4016-90a5-98c2ad891aa8" containerID="f9f82998df5cba678c124c2e64761693a1f4701d4af05535c38e9a0209bc4b42" exitCode=0 Jul 06 20:37:18.757626 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:18.757472 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-kjjpn" event={"ID":"0f6cd921-5c67-4016-90a5-98c2ad891aa8","Type":"ContainerDied","Data":"f9f82998df5cba678c124c2e64761693a1f4701d4af05535c38e9a0209bc4b42"} Jul 06 20:37:18.757859 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:18.757843 2562 scope.go:117] "RemoveContainer" containerID="f9f82998df5cba678c124c2e64761693a1f4701d4af05535c38e9a0209bc4b42" Jul 06 20:37:18.759095 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:18.759073 2562 generic.go:356] "Generic (PLEG): container finished" podID="e9ef32e7-80be-4b87-8f9b-e1394c0022f8" containerID="5f9ac225b4b39b9b69105a72c09082e12547b8261c0cd873ea85981e697f896d" exitCode=0 Jul 06 20:37:18.759217 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:18.759116 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tmvn6" event={"ID":"e9ef32e7-80be-4b87-8f9b-e1394c0022f8","Type":"ContainerDied","Data":"5f9ac225b4b39b9b69105a72c09082e12547b8261c0cd873ea85981e697f896d"} Jul 06 20:37:18.759374 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:18.759357 2562 scope.go:117] "RemoveContainer" containerID="5f9ac225b4b39b9b69105a72c09082e12547b8261c0cd873ea85981e697f896d" Jul 06 20:37:18.929827 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:18.929801 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-756cfd8566-gnswd" Jul 06 20:37:19.016480 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:19.016441 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-oauth-serving-cert\") pod \"d5cfb151-e8d2-49bc-b546-5b8366dc83ca\" (UID: \"d5cfb151-e8d2-49bc-b546-5b8366dc83ca\") " Jul 06 20:37:19.016480 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:19.016480 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-trusted-ca-bundle\") pod \"d5cfb151-e8d2-49bc-b546-5b8366dc83ca\" (UID: \"d5cfb151-e8d2-49bc-b546-5b8366dc83ca\") " Jul 06 20:37:19.016721 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:19.016512 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-console-config\") pod \"d5cfb151-e8d2-49bc-b546-5b8366dc83ca\" (UID: \"d5cfb151-e8d2-49bc-b546-5b8366dc83ca\") " Jul 06 20:37:19.016721 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:19.016570 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29zxc\" (UniqueName: \"kubernetes.io/projected/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-kube-api-access-29zxc\") pod \"d5cfb151-e8d2-49bc-b546-5b8366dc83ca\" (UID: \"d5cfb151-e8d2-49bc-b546-5b8366dc83ca\") " Jul 06 20:37:19.016721 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:19.016607 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-console-oauth-config\") pod \"d5cfb151-e8d2-49bc-b546-5b8366dc83ca\" (UID: \"d5cfb151-e8d2-49bc-b546-5b8366dc83ca\") " Jul 06 20:37:19.016721 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:19.016632 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-service-ca\") pod \"d5cfb151-e8d2-49bc-b546-5b8366dc83ca\" (UID: \"d5cfb151-e8d2-49bc-b546-5b8366dc83ca\") " Jul 06 20:37:19.016721 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:19.016681 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-console-serving-cert\") pod \"d5cfb151-e8d2-49bc-b546-5b8366dc83ca\" (UID: \"d5cfb151-e8d2-49bc-b546-5b8366dc83ca\") " Jul 06 20:37:19.016981 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:19.016926 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-console-config" (OuterVolumeSpecName: "console-config") pod "d5cfb151-e8d2-49bc-b546-5b8366dc83ca" (UID: "d5cfb151-e8d2-49bc-b546-5b8366dc83ca"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:37:19.016981 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:19.016954 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d5cfb151-e8d2-49bc-b546-5b8366dc83ca" (UID: "d5cfb151-e8d2-49bc-b546-5b8366dc83ca"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:37:19.017230 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:19.017205 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-service-ca" (OuterVolumeSpecName: "service-ca") pod "d5cfb151-e8d2-49bc-b546-5b8366dc83ca" (UID: "d5cfb151-e8d2-49bc-b546-5b8366dc83ca"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:37:19.017356 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:19.017299 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d5cfb151-e8d2-49bc-b546-5b8366dc83ca" (UID: "d5cfb151-e8d2-49bc-b546-5b8366dc83ca"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:37:19.019532 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:19.019492 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d5cfb151-e8d2-49bc-b546-5b8366dc83ca" (UID: "d5cfb151-e8d2-49bc-b546-5b8366dc83ca"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:37:19.019532 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:19.019501 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-kube-api-access-29zxc" (OuterVolumeSpecName: "kube-api-access-29zxc") pod "d5cfb151-e8d2-49bc-b546-5b8366dc83ca" (UID: "d5cfb151-e8d2-49bc-b546-5b8366dc83ca"). InnerVolumeSpecName "kube-api-access-29zxc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:37:19.019711 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:19.019578 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d5cfb151-e8d2-49bc-b546-5b8366dc83ca" (UID: "d5cfb151-e8d2-49bc-b546-5b8366dc83ca"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:37:19.117867 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:19.117768 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-oauth-serving-cert\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 20:37:19.117867 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:19.117806 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-trusted-ca-bundle\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 20:37:19.117867 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:19.117818 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-console-config\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 20:37:19.117867 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:19.117827 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29zxc\" (UniqueName: \"kubernetes.io/projected/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-kube-api-access-29zxc\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 20:37:19.117867 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:19.117836 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-console-oauth-config\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 20:37:19.117867 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:19.117845 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-service-ca\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 20:37:19.117867 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:19.117853 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5cfb151-e8d2-49bc-b546-5b8366dc83ca-console-serving-cert\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 20:37:19.764696 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:19.764663 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tmvn6" event={"ID":"e9ef32e7-80be-4b87-8f9b-e1394c0022f8","Type":"ContainerStarted","Data":"82cafd5b58e19ab4f9b1e7fabd6fc6f60c2aa29c565ba0b9d86ae1f7755e52d1"} Jul 06 20:37:19.766049 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:19.766021 2562 generic.go:356] "Generic (PLEG): container finished" podID="d5cfb151-e8d2-49bc-b546-5b8366dc83ca" containerID="8a6779fb40336b791f864e440718b2c01b4c31fd1506df97f7f67521e764aca6" exitCode=0 Jul 06 20:37:19.766170 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:19.766061 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-756cfd8566-gnswd" Jul 06 20:37:19.766170 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:19.766102 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-756cfd8566-gnswd" event={"ID":"d5cfb151-e8d2-49bc-b546-5b8366dc83ca","Type":"ContainerDied","Data":"8a6779fb40336b791f864e440718b2c01b4c31fd1506df97f7f67521e764aca6"} Jul 06 20:37:19.766170 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:19.766141 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-756cfd8566-gnswd" event={"ID":"d5cfb151-e8d2-49bc-b546-5b8366dc83ca","Type":"ContainerDied","Data":"fefc95ad7ae9a5d57f03e7b2c54a9b5326c08bde96d1240d6ee747fb9b519391"} Jul 06 20:37:19.766170 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:19.766167 2562 scope.go:117] "RemoveContainer" containerID="8a6779fb40336b791f864e440718b2c01b4c31fd1506df97f7f67521e764aca6" Jul 06 20:37:19.768048 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:19.768024 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-kjjpn" event={"ID":"0f6cd921-5c67-4016-90a5-98c2ad891aa8","Type":"ContainerStarted","Data":"a927508867c2e4aac33887c5fc891ade3ef36cd07ff65e49956c225c2c787740"} Jul 06 20:37:19.774404 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:19.774385 2562 scope.go:117] "RemoveContainer" containerID="8a6779fb40336b791f864e440718b2c01b4c31fd1506df97f7f67521e764aca6" Jul 06 20:37:19.774692 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:37:19.774674 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a6779fb40336b791f864e440718b2c01b4c31fd1506df97f7f67521e764aca6\": container with ID starting with 8a6779fb40336b791f864e440718b2c01b4c31fd1506df97f7f67521e764aca6 not found: ID does not exist" containerID="8a6779fb40336b791f864e440718b2c01b4c31fd1506df97f7f67521e764aca6" Jul 06 20:37:19.774731 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:19.774701 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a6779fb40336b791f864e440718b2c01b4c31fd1506df97f7f67521e764aca6"} err="failed to get container status \"8a6779fb40336b791f864e440718b2c01b4c31fd1506df97f7f67521e764aca6\": rpc error: code = NotFound desc = could not find container \"8a6779fb40336b791f864e440718b2c01b4c31fd1506df97f7f67521e764aca6\": container with ID starting with 8a6779fb40336b791f864e440718b2c01b4c31fd1506df97f7f67521e764aca6 not found: ID does not exist" Jul 06 20:37:19.799817 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:19.799784 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-756cfd8566-gnswd"] Jul 06 20:37:19.807689 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:19.807660 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-756cfd8566-gnswd"] Jul 06 20:37:20.097224 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:37:20.097137 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5cfb151-e8d2-49bc-b546-5b8366dc83ca" path="/var/lib/kubelet/pods/d5cfb151-e8d2-49bc-b546-5b8366dc83ca/volumes" Jul 06 20:38:18.186073 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:18.186037 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7954d98b8f-p9fbv"] Jul 06 20:38:18.186557 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:18.186281 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8da873c1-d92e-4dec-b980-e470b5263d61" containerName="registry" Jul 06 20:38:18.186557 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:18.186292 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8da873c1-d92e-4dec-b980-e470b5263d61" containerName="registry" Jul 06 20:38:18.186557 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:18.186305 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5cfb151-e8d2-49bc-b546-5b8366dc83ca" containerName="console" Jul 06 20:38:18.186557 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:18.186312 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5cfb151-e8d2-49bc-b546-5b8366dc83ca" containerName="console" Jul 06 20:38:18.186557 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:18.186351 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8da873c1-d92e-4dec-b980-e470b5263d61" containerName="registry" Jul 06 20:38:18.186557 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:18.186358 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5cfb151-e8d2-49bc-b546-5b8366dc83ca" containerName="console" Jul 06 20:38:18.189135 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:18.189114 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7954d98b8f-p9fbv" Jul 06 20:38:18.219562 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:18.219532 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7954d98b8f-p9fbv"] Jul 06 20:38:18.283232 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:18.283198 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-oauth-serving-cert\") pod \"console-7954d98b8f-p9fbv\" (UID: \"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6\") " pod="openshift-console/console-7954d98b8f-p9fbv" Jul 06 20:38:18.283417 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:18.283238 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq6lv\" (UniqueName: \"kubernetes.io/projected/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-kube-api-access-cq6lv\") pod \"console-7954d98b8f-p9fbv\" (UID: \"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6\") " pod="openshift-console/console-7954d98b8f-p9fbv" Jul 06 20:38:18.283417 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:18.283309 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-console-serving-cert\") pod \"console-7954d98b8f-p9fbv\" (UID: \"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6\") " pod="openshift-console/console-7954d98b8f-p9fbv" Jul 06 20:38:18.283417 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:18.283351 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-console-config\") pod \"console-7954d98b8f-p9fbv\" (UID: \"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6\") " pod="openshift-console/console-7954d98b8f-p9fbv" Jul 06 20:38:18.283587 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:18.283443 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-trusted-ca-bundle\") pod \"console-7954d98b8f-p9fbv\" (UID: \"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6\") " pod="openshift-console/console-7954d98b8f-p9fbv" Jul 06 20:38:18.283587 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:18.283497 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-service-ca\") pod \"console-7954d98b8f-p9fbv\" (UID: \"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6\") " pod="openshift-console/console-7954d98b8f-p9fbv" Jul 06 20:38:18.283587 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:18.283529 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-console-oauth-config\") pod \"console-7954d98b8f-p9fbv\" (UID: \"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6\") " pod="openshift-console/console-7954d98b8f-p9fbv" Jul 06 20:38:18.384727 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:18.384688 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-oauth-serving-cert\") pod \"console-7954d98b8f-p9fbv\" (UID: \"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6\") " pod="openshift-console/console-7954d98b8f-p9fbv" Jul 06 20:38:18.384727 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:18.384729 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq6lv\" (UniqueName: \"kubernetes.io/projected/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-kube-api-access-cq6lv\") pod \"console-7954d98b8f-p9fbv\" (UID: \"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6\") " pod="openshift-console/console-7954d98b8f-p9fbv" Jul 06 20:38:18.385011 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:18.384760 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-console-serving-cert\") pod \"console-7954d98b8f-p9fbv\" (UID: \"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6\") " pod="openshift-console/console-7954d98b8f-p9fbv" Jul 06 20:38:18.385011 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:18.384785 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-console-config\") pod \"console-7954d98b8f-p9fbv\" (UID: \"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6\") " pod="openshift-console/console-7954d98b8f-p9fbv" Jul 06 20:38:18.385011 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:18.384808 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-trusted-ca-bundle\") pod \"console-7954d98b8f-p9fbv\" (UID: \"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6\") " pod="openshift-console/console-7954d98b8f-p9fbv" Jul 06 20:38:18.385011 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:18.384827 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-service-ca\") pod \"console-7954d98b8f-p9fbv\" (UID: \"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6\") " pod="openshift-console/console-7954d98b8f-p9fbv" Jul 06 20:38:18.385011 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:18.384844 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-console-oauth-config\") pod \"console-7954d98b8f-p9fbv\" (UID: \"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6\") " pod="openshift-console/console-7954d98b8f-p9fbv" Jul 06 20:38:18.385614 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:18.385585 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-console-config\") pod \"console-7954d98b8f-p9fbv\" (UID: \"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6\") " pod="openshift-console/console-7954d98b8f-p9fbv" Jul 06 20:38:18.385732 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:18.385585 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-oauth-serving-cert\") pod \"console-7954d98b8f-p9fbv\" (UID: \"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6\") " pod="openshift-console/console-7954d98b8f-p9fbv" Jul 06 20:38:18.385797 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:18.385734 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-service-ca\") pod \"console-7954d98b8f-p9fbv\" (UID: \"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6\") " pod="openshift-console/console-7954d98b8f-p9fbv" Jul 06 20:38:18.385797 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:18.385770 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-trusted-ca-bundle\") pod \"console-7954d98b8f-p9fbv\" (UID: \"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6\") " pod="openshift-console/console-7954d98b8f-p9fbv" Jul 06 20:38:18.387392 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:18.387362 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-console-serving-cert\") pod \"console-7954d98b8f-p9fbv\" (UID: \"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6\") " pod="openshift-console/console-7954d98b8f-p9fbv" Jul 06 20:38:18.387499 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:18.387460 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-console-oauth-config\") pod \"console-7954d98b8f-p9fbv\" (UID: \"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6\") " pod="openshift-console/console-7954d98b8f-p9fbv" Jul 06 20:38:18.398593 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:18.398564 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq6lv\" (UniqueName: \"kubernetes.io/projected/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-kube-api-access-cq6lv\") pod \"console-7954d98b8f-p9fbv\" (UID: \"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6\") " pod="openshift-console/console-7954d98b8f-p9fbv" Jul 06 20:38:18.498177 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:18.498074 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7954d98b8f-p9fbv" Jul 06 20:38:18.633046 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:18.633021 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7954d98b8f-p9fbv"] Jul 06 20:38:18.635463 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:38:18.635436 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc5c832b_86a5_4f79_ad58_7aacceeaf3d6.slice/crio-d0a0d4e1f83c1ffcbd59ef1c0f00988571ad9e62a4b07d54dc10605328b0e36b WatchSource:0}: Error finding container d0a0d4e1f83c1ffcbd59ef1c0f00988571ad9e62a4b07d54dc10605328b0e36b: Status 404 returned error can't find the container with id d0a0d4e1f83c1ffcbd59ef1c0f00988571ad9e62a4b07d54dc10605328b0e36b Jul 06 20:38:18.987184 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:18.987148 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7954d98b8f-p9fbv" event={"ID":"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6","Type":"ContainerStarted","Data":"a5872fbf3fc69d248167203e48947e5e8fb22c5e3c13ecf74695ef3962a46ad0"} Jul 06 20:38:18.987363 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:18.987223 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7954d98b8f-p9fbv" event={"ID":"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6","Type":"ContainerStarted","Data":"d0a0d4e1f83c1ffcbd59ef1c0f00988571ad9e62a4b07d54dc10605328b0e36b"} Jul 06 20:38:19.009136 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:19.009086 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7954d98b8f-p9fbv" podStartSLOduration=1.009070916 podStartE2EDuration="1.009070916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:38:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:38:19.008106156 +0000 UTC m=+201.425355585" watchObservedRunningTime="2026-07-06 20:38:19.009070916 +0000 UTC m=+201.426320411" Jul 06 20:38:28.498205 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:28.498171 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7954d98b8f-p9fbv" Jul 06 20:38:28.498667 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:28.498237 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7954d98b8f-p9fbv" Jul 06 20:38:28.504325 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:28.504301 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7954d98b8f-p9fbv" Jul 06 20:38:29.027741 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:29.027713 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7954d98b8f-p9fbv" Jul 06 20:38:29.079001 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:29.078971 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54b69b94c8-ggm9q"] Jul 06 20:38:54.103710 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:54.103666 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-54b69b94c8-ggm9q" podUID="6afc23be-733d-4d6a-886e-5e0b7403175c" containerName="console" containerID="cri-o://4cea2a1963d7856cd1a985db552ddaaa1298b63ea5460998624b264b673f222e" gracePeriod=15 Jul 06 20:38:54.340836 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:54.340802 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54b69b94c8-ggm9q" Jul 06 20:38:54.452043 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:54.452008 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6afc23be-733d-4d6a-886e-5e0b7403175c-console-oauth-config\") pod \"6afc23be-733d-4d6a-886e-5e0b7403175c\" (UID: \"6afc23be-733d-4d6a-886e-5e0b7403175c\") " Jul 06 20:38:54.452043 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:54.452055 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6afc23be-733d-4d6a-886e-5e0b7403175c-service-ca\") pod \"6afc23be-733d-4d6a-886e-5e0b7403175c\" (UID: \"6afc23be-733d-4d6a-886e-5e0b7403175c\") " Jul 06 20:38:54.452295 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:54.452074 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjm2z\" (UniqueName: \"kubernetes.io/projected/6afc23be-733d-4d6a-886e-5e0b7403175c-kube-api-access-tjm2z\") pod \"6afc23be-733d-4d6a-886e-5e0b7403175c\" (UID: \"6afc23be-733d-4d6a-886e-5e0b7403175c\") " Jul 06 20:38:54.452295 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:54.452113 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6afc23be-733d-4d6a-886e-5e0b7403175c-console-config\") pod \"6afc23be-733d-4d6a-886e-5e0b7403175c\" (UID: \"6afc23be-733d-4d6a-886e-5e0b7403175c\") " Jul 06 20:38:54.452295 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:54.452137 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6afc23be-733d-4d6a-886e-5e0b7403175c-oauth-serving-cert\") pod \"6afc23be-733d-4d6a-886e-5e0b7403175c\" (UID: \"6afc23be-733d-4d6a-886e-5e0b7403175c\") " Jul 06 20:38:54.452295 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:54.452155 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6afc23be-733d-4d6a-886e-5e0b7403175c-trusted-ca-bundle\") pod \"6afc23be-733d-4d6a-886e-5e0b7403175c\" (UID: \"6afc23be-733d-4d6a-886e-5e0b7403175c\") " Jul 06 20:38:54.452295 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:54.452214 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6afc23be-733d-4d6a-886e-5e0b7403175c-console-serving-cert\") pod \"6afc23be-733d-4d6a-886e-5e0b7403175c\" (UID: \"6afc23be-733d-4d6a-886e-5e0b7403175c\") " Jul 06 20:38:54.452577 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:54.452554 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6afc23be-733d-4d6a-886e-5e0b7403175c-console-config" (OuterVolumeSpecName: "console-config") pod "6afc23be-733d-4d6a-886e-5e0b7403175c" (UID: "6afc23be-733d-4d6a-886e-5e0b7403175c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:38:54.452640 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:54.452580 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6afc23be-733d-4d6a-886e-5e0b7403175c-service-ca" (OuterVolumeSpecName: "service-ca") pod "6afc23be-733d-4d6a-886e-5e0b7403175c" (UID: "6afc23be-733d-4d6a-886e-5e0b7403175c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:38:54.452640 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:54.452613 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6afc23be-733d-4d6a-886e-5e0b7403175c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6afc23be-733d-4d6a-886e-5e0b7403175c" (UID: "6afc23be-733d-4d6a-886e-5e0b7403175c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:38:54.452722 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:54.452654 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6afc23be-733d-4d6a-886e-5e0b7403175c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6afc23be-733d-4d6a-886e-5e0b7403175c" (UID: "6afc23be-733d-4d6a-886e-5e0b7403175c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:38:54.454595 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:54.454566 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6afc23be-733d-4d6a-886e-5e0b7403175c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6afc23be-733d-4d6a-886e-5e0b7403175c" (UID: "6afc23be-733d-4d6a-886e-5e0b7403175c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:38:54.454730 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:54.454618 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6afc23be-733d-4d6a-886e-5e0b7403175c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6afc23be-733d-4d6a-886e-5e0b7403175c" (UID: "6afc23be-733d-4d6a-886e-5e0b7403175c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:38:54.454730 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:54.454621 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6afc23be-733d-4d6a-886e-5e0b7403175c-kube-api-access-tjm2z" (OuterVolumeSpecName: "kube-api-access-tjm2z") pod "6afc23be-733d-4d6a-886e-5e0b7403175c" (UID: "6afc23be-733d-4d6a-886e-5e0b7403175c"). InnerVolumeSpecName "kube-api-access-tjm2z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:38:54.553262 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:54.553224 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6afc23be-733d-4d6a-886e-5e0b7403175c-trusted-ca-bundle\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 20:38:54.553262 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:54.553253 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6afc23be-733d-4d6a-886e-5e0b7403175c-console-serving-cert\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 20:38:54.553262 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:54.553262 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6afc23be-733d-4d6a-886e-5e0b7403175c-console-oauth-config\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 20:38:54.553262 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:54.553272 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6afc23be-733d-4d6a-886e-5e0b7403175c-service-ca\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 20:38:54.553525 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:54.553280 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjm2z\" (UniqueName: \"kubernetes.io/projected/6afc23be-733d-4d6a-886e-5e0b7403175c-kube-api-access-tjm2z\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 20:38:54.553525 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:54.553289 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6afc23be-733d-4d6a-886e-5e0b7403175c-console-config\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 20:38:54.553525 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:54.553298 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6afc23be-733d-4d6a-886e-5e0b7403175c-oauth-serving-cert\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 20:38:55.115142 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:55.115106 2562 generic.go:356] "Generic (PLEG): container finished" podID="6afc23be-733d-4d6a-886e-5e0b7403175c" containerID="4cea2a1963d7856cd1a985db552ddaaa1298b63ea5460998624b264b673f222e" exitCode=0 Jul 06 20:38:55.115528 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:55.115160 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54b69b94c8-ggm9q" Jul 06 20:38:55.115528 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:55.115194 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54b69b94c8-ggm9q" event={"ID":"6afc23be-733d-4d6a-886e-5e0b7403175c","Type":"ContainerDied","Data":"4cea2a1963d7856cd1a985db552ddaaa1298b63ea5460998624b264b673f222e"} Jul 06 20:38:55.115528 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:55.115264 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54b69b94c8-ggm9q" event={"ID":"6afc23be-733d-4d6a-886e-5e0b7403175c","Type":"ContainerDied","Data":"0dc803cb64ff0f35561a61c5e275747f63f8a41f4c179958345d143101d1ec90"} Jul 06 20:38:55.115528 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:55.115286 2562 scope.go:117] "RemoveContainer" containerID="4cea2a1963d7856cd1a985db552ddaaa1298b63ea5460998624b264b673f222e" Jul 06 20:38:55.123525 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:55.123506 2562 scope.go:117] "RemoveContainer" containerID="4cea2a1963d7856cd1a985db552ddaaa1298b63ea5460998624b264b673f222e" Jul 06 20:38:55.123819 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:38:55.123801 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cea2a1963d7856cd1a985db552ddaaa1298b63ea5460998624b264b673f222e\": container with ID starting with 4cea2a1963d7856cd1a985db552ddaaa1298b63ea5460998624b264b673f222e not found: ID does not exist" containerID="4cea2a1963d7856cd1a985db552ddaaa1298b63ea5460998624b264b673f222e" Jul 06 20:38:55.123855 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:55.123827 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cea2a1963d7856cd1a985db552ddaaa1298b63ea5460998624b264b673f222e"} err="failed to get container status \"4cea2a1963d7856cd1a985db552ddaaa1298b63ea5460998624b264b673f222e\": rpc error: code = NotFound desc = could not find container \"4cea2a1963d7856cd1a985db552ddaaa1298b63ea5460998624b264b673f222e\": container with ID starting with 4cea2a1963d7856cd1a985db552ddaaa1298b63ea5460998624b264b673f222e not found: ID does not exist" Jul 06 20:38:55.139560 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:55.139526 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54b69b94c8-ggm9q"] Jul 06 20:38:55.145905 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:55.145866 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54b69b94c8-ggm9q"] Jul 06 20:38:56.096924 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:38:56.096870 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6afc23be-733d-4d6a-886e-5e0b7403175c" path="/var/lib/kubelet/pods/6afc23be-733d-4d6a-886e-5e0b7403175c/volumes" Jul 06 20:39:40.553158 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:40.553122 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-lxtnq"] Jul 06 20:39:40.553738 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:40.553487 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6afc23be-733d-4d6a-886e-5e0b7403175c" containerName="console" Jul 06 20:39:40.553738 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:40.553505 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6afc23be-733d-4d6a-886e-5e0b7403175c" containerName="console" Jul 06 20:39:40.553738 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:40.553585 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6afc23be-733d-4d6a-886e-5e0b7403175c" containerName="console" Jul 06 20:39:40.556531 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:40.556510 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-lxtnq" Jul 06 20:39:40.560094 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:40.560072 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 06 20:39:40.560259 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:40.560240 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 06 20:39:40.560354 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:40.560332 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-zj54c\"" Jul 06 20:39:40.560653 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:40.560638 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 06 20:39:40.610291 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:40.610260 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-lxtnq"] Jul 06 20:39:40.702228 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:40.702191 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpflv\" (UniqueName: \"kubernetes.io/projected/2561f367-a5e1-4d1e-841c-7fa7df5a411e-kube-api-access-vpflv\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-lxtnq\" (UID: \"2561f367-a5e1-4d1e-841c-7fa7df5a411e\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-lxtnq" Jul 06 20:39:40.702228 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:40.702244 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/2561f367-a5e1-4d1e-841c-7fa7df5a411e-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-lxtnq\" (UID: \"2561f367-a5e1-4d1e-841c-7fa7df5a411e\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-lxtnq" Jul 06 20:39:40.803009 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:40.802976 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpflv\" (UniqueName: \"kubernetes.io/projected/2561f367-a5e1-4d1e-841c-7fa7df5a411e-kube-api-access-vpflv\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-lxtnq\" (UID: \"2561f367-a5e1-4d1e-841c-7fa7df5a411e\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-lxtnq" Jul 06 20:39:40.803131 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:40.803018 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/2561f367-a5e1-4d1e-841c-7fa7df5a411e-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-lxtnq\" (UID: \"2561f367-a5e1-4d1e-841c-7fa7df5a411e\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-lxtnq" Jul 06 20:39:40.805437 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:40.805371 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/2561f367-a5e1-4d1e-841c-7fa7df5a411e-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-lxtnq\" (UID: \"2561f367-a5e1-4d1e-841c-7fa7df5a411e\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-lxtnq" Jul 06 20:39:40.813400 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:40.813372 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpflv\" (UniqueName: \"kubernetes.io/projected/2561f367-a5e1-4d1e-841c-7fa7df5a411e-kube-api-access-vpflv\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-lxtnq\" (UID: \"2561f367-a5e1-4d1e-841c-7fa7df5a411e\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-lxtnq" Jul 06 20:39:40.866072 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:40.866013 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-lxtnq" Jul 06 20:39:41.005153 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:41.005117 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-lxtnq"] Jul 06 20:39:41.008430 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:39:41.008391 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2561f367_a5e1_4d1e_841c_7fa7df5a411e.slice/crio-1788b56a87d0fac3fcd4ab26efc2fcc5935bb08d9116a7c4944b2d2093cfded6 WatchSource:0}: Error finding container 1788b56a87d0fac3fcd4ab26efc2fcc5935bb08d9116a7c4944b2d2093cfded6: Status 404 returned error can't find the container with id 1788b56a87d0fac3fcd4ab26efc2fcc5935bb08d9116a7c4944b2d2093cfded6 Jul 06 20:39:41.276556 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:41.276517 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-lxtnq" event={"ID":"2561f367-a5e1-4d1e-841c-7fa7df5a411e","Type":"ContainerStarted","Data":"1788b56a87d0fac3fcd4ab26efc2fcc5935bb08d9116a7c4944b2d2093cfded6"} Jul 06 20:39:44.292708 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:44.292619 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-lxtnq" event={"ID":"2561f367-a5e1-4d1e-841c-7fa7df5a411e","Type":"ContainerStarted","Data":"2d099bb338a361ac97db46e79b097ded586a0364fb625b81a3b09930bc63d9a5"} Jul 06 20:39:44.293113 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:44.292755 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-lxtnq" Jul 06 20:39:45.603312 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:45.603258 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-lxtnq" podStartSLOduration=2.628997448 podStartE2EDuration="5.603240123s" totalImagesPullingTime="2.974242675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:39:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:39:44.322759064 +0000 UTC m=+286.740008493" watchObservedRunningTime="2026-07-06 20:39:45.603240123 +0000 UTC m=+288.020489553" Jul 06 20:39:45.603832 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:45.603449 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-66hkd"] Jul 06 20:39:45.606669 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:45.606651 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-66hkd" Jul 06 20:39:45.609625 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:45.609606 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-tvqxx\"" Jul 06 20:39:45.609707 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:45.609627 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 06 20:39:45.609707 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:45.609606 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 06 20:39:45.620123 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:45.620098 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-66hkd"] Jul 06 20:39:45.741420 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:45.741378 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/79f1f3ad-dcd5-45c9-8a18-39b7dcf1973e-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-66hkd\" (UID: \"79f1f3ad-dcd5-45c9-8a18-39b7dcf1973e\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-66hkd" Jul 06 20:39:45.741613 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:45.741429 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/79f1f3ad-dcd5-45c9-8a18-39b7dcf1973e-certificates\") pod \"keda-metrics-apiserver-559f75f947-66hkd\" (UID: \"79f1f3ad-dcd5-45c9-8a18-39b7dcf1973e\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-66hkd" Jul 06 20:39:45.741613 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:45.741500 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhxlw\" (UniqueName: \"kubernetes.io/projected/79f1f3ad-dcd5-45c9-8a18-39b7dcf1973e-kube-api-access-nhxlw\") pod \"keda-metrics-apiserver-559f75f947-66hkd\" (UID: \"79f1f3ad-dcd5-45c9-8a18-39b7dcf1973e\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-66hkd" Jul 06 20:39:45.766062 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:45.766018 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-47c8s"] Jul 06 20:39:45.769629 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:45.769606 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-47c8s" Jul 06 20:39:45.773319 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:45.773291 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 06 20:39:45.791764 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:45.791731 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-47c8s"] Jul 06 20:39:45.842749 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:45.842698 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhxlw\" (UniqueName: \"kubernetes.io/projected/79f1f3ad-dcd5-45c9-8a18-39b7dcf1973e-kube-api-access-nhxlw\") pod \"keda-metrics-apiserver-559f75f947-66hkd\" (UID: \"79f1f3ad-dcd5-45c9-8a18-39b7dcf1973e\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-66hkd" Jul 06 20:39:45.842993 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:45.842804 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf2v7\" (UniqueName: \"kubernetes.io/projected/ad7c02e0-444b-4492-86d5-d32235855903-kube-api-access-mf2v7\") pod \"keda-admission-5fbd5c4644-47c8s\" (UID: \"ad7c02e0-444b-4492-86d5-d32235855903\") " pod="openshift-keda/keda-admission-5fbd5c4644-47c8s" Jul 06 20:39:45.842993 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:45.842847 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/79f1f3ad-dcd5-45c9-8a18-39b7dcf1973e-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-66hkd\" (UID: \"79f1f3ad-dcd5-45c9-8a18-39b7dcf1973e\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-66hkd" Jul 06 20:39:45.842993 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:45.842900 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/79f1f3ad-dcd5-45c9-8a18-39b7dcf1973e-certificates\") pod \"keda-metrics-apiserver-559f75f947-66hkd\" (UID: \"79f1f3ad-dcd5-45c9-8a18-39b7dcf1973e\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-66hkd" Jul 06 20:39:45.842993 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:45.842943 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/ad7c02e0-444b-4492-86d5-d32235855903-certificates\") pod \"keda-admission-5fbd5c4644-47c8s\" (UID: \"ad7c02e0-444b-4492-86d5-d32235855903\") " pod="openshift-keda/keda-admission-5fbd5c4644-47c8s" Jul 06 20:39:45.843213 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:39:45.843061 2562 projected.go:266] Couldn't get secret openshift-keda/keda-metrics-apiserver-certs: secret "keda-metrics-apiserver-certs" not found Jul 06 20:39:45.843213 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:39:45.843086 2562 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-559f75f947-66hkd: secret "keda-metrics-apiserver-certs" not found Jul 06 20:39:45.843213 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:39:45.843166 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79f1f3ad-dcd5-45c9-8a18-39b7dcf1973e-certificates podName:79f1f3ad-dcd5-45c9-8a18-39b7dcf1973e nodeName:}" failed. No retries permitted until 2026-07-06 20:39:46.343146026 +0000 UTC m=+288.760395436 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/79f1f3ad-dcd5-45c9-8a18-39b7dcf1973e-certificates") pod "keda-metrics-apiserver-559f75f947-66hkd" (UID: "79f1f3ad-dcd5-45c9-8a18-39b7dcf1973e") : secret "keda-metrics-apiserver-certs" not found Jul 06 20:39:45.843372 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:45.843219 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/79f1f3ad-dcd5-45c9-8a18-39b7dcf1973e-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-66hkd\" (UID: \"79f1f3ad-dcd5-45c9-8a18-39b7dcf1973e\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-66hkd" Jul 06 20:39:45.867142 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:45.867059 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhxlw\" (UniqueName: \"kubernetes.io/projected/79f1f3ad-dcd5-45c9-8a18-39b7dcf1973e-kube-api-access-nhxlw\") pod \"keda-metrics-apiserver-559f75f947-66hkd\" (UID: \"79f1f3ad-dcd5-45c9-8a18-39b7dcf1973e\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-66hkd" Jul 06 20:39:45.944227 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:45.944190 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/ad7c02e0-444b-4492-86d5-d32235855903-certificates\") pod \"keda-admission-5fbd5c4644-47c8s\" (UID: \"ad7c02e0-444b-4492-86d5-d32235855903\") " pod="openshift-keda/keda-admission-5fbd5c4644-47c8s" Jul 06 20:39:45.944447 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:45.944264 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf2v7\" (UniqueName: \"kubernetes.io/projected/ad7c02e0-444b-4492-86d5-d32235855903-kube-api-access-mf2v7\") pod \"keda-admission-5fbd5c4644-47c8s\" (UID: \"ad7c02e0-444b-4492-86d5-d32235855903\") " pod="openshift-keda/keda-admission-5fbd5c4644-47c8s" Jul 06 20:39:45.946791 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:45.946762 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/ad7c02e0-444b-4492-86d5-d32235855903-certificates\") pod \"keda-admission-5fbd5c4644-47c8s\" (UID: \"ad7c02e0-444b-4492-86d5-d32235855903\") " pod="openshift-keda/keda-admission-5fbd5c4644-47c8s" Jul 06 20:39:45.973591 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:45.973557 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf2v7\" (UniqueName: \"kubernetes.io/projected/ad7c02e0-444b-4492-86d5-d32235855903-kube-api-access-mf2v7\") pod \"keda-admission-5fbd5c4644-47c8s\" (UID: \"ad7c02e0-444b-4492-86d5-d32235855903\") " pod="openshift-keda/keda-admission-5fbd5c4644-47c8s" Jul 06 20:39:46.079715 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:46.079676 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-47c8s" Jul 06 20:39:46.220844 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:46.220801 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-47c8s"] Jul 06 20:39:46.224187 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:39:46.224160 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad7c02e0_444b_4492_86d5_d32235855903.slice/crio-9739018d9c35083ea7da77f6784b9c18151c2e5c26599e1bde58fe45a67a9071 WatchSource:0}: Error finding container 9739018d9c35083ea7da77f6784b9c18151c2e5c26599e1bde58fe45a67a9071: Status 404 returned error can't find the container with id 9739018d9c35083ea7da77f6784b9c18151c2e5c26599e1bde58fe45a67a9071 Jul 06 20:39:46.301028 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:46.300993 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-47c8s" event={"ID":"ad7c02e0-444b-4492-86d5-d32235855903","Type":"ContainerStarted","Data":"9739018d9c35083ea7da77f6784b9c18151c2e5c26599e1bde58fe45a67a9071"} Jul 06 20:39:46.347337 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:46.347300 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/79f1f3ad-dcd5-45c9-8a18-39b7dcf1973e-certificates\") pod \"keda-metrics-apiserver-559f75f947-66hkd\" (UID: \"79f1f3ad-dcd5-45c9-8a18-39b7dcf1973e\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-66hkd" Jul 06 20:39:46.349789 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:46.349762 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/79f1f3ad-dcd5-45c9-8a18-39b7dcf1973e-certificates\") pod \"keda-metrics-apiserver-559f75f947-66hkd\" (UID: \"79f1f3ad-dcd5-45c9-8a18-39b7dcf1973e\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-66hkd" Jul 06 20:39:46.516489 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:46.516403 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-66hkd" Jul 06 20:39:46.664620 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:46.664596 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-66hkd"] Jul 06 20:39:46.667159 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:39:46.667128 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79f1f3ad_dcd5_45c9_8a18_39b7dcf1973e.slice/crio-ec0e4a8126287d31b503f707c1fa169bfd2ba0f79bb715cc74a2763ba86a6df2 WatchSource:0}: Error finding container ec0e4a8126287d31b503f707c1fa169bfd2ba0f79bb715cc74a2763ba86a6df2: Status 404 returned error can't find the container with id ec0e4a8126287d31b503f707c1fa169bfd2ba0f79bb715cc74a2763ba86a6df2 Jul 06 20:39:47.306969 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:47.306930 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-66hkd" event={"ID":"79f1f3ad-dcd5-45c9-8a18-39b7dcf1973e","Type":"ContainerStarted","Data":"ec0e4a8126287d31b503f707c1fa169bfd2ba0f79bb715cc74a2763ba86a6df2"} Jul 06 20:39:48.312871 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:48.312832 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-47c8s" event={"ID":"ad7c02e0-444b-4492-86d5-d32235855903","Type":"ContainerStarted","Data":"56db3d76708f4dab93342f1af004c83a4a75424e0981b09f5662988f78453a12"} Jul 06 20:39:48.313326 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:48.312928 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-5fbd5c4644-47c8s" Jul 06 20:39:48.333660 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:48.333582 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-5fbd5c4644-47c8s" podStartSLOduration=1.9533590699999999 podStartE2EDuration="3.333557668s" totalImagesPullingTime="1.380198598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:39:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:39:48.332454995 +0000 UTC m=+290.749704426" watchObservedRunningTime="2026-07-06 20:39:48.333557668 +0000 UTC m=+290.750807102" Jul 06 20:39:49.318159 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:49.318083 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-66hkd" event={"ID":"79f1f3ad-dcd5-45c9-8a18-39b7dcf1973e","Type":"ContainerStarted","Data":"470f5c9946a1a1064effa5525367f96ce127e352e689cdd538345a84f11eae4a"} Jul 06 20:39:49.337320 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:49.337261 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-559f75f947-66hkd" podStartSLOduration=1.949969399 podStartE2EDuration="4.337242805s" totalImagesPullingTime="2.387273406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:39:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:39:49.336266039 +0000 UTC m=+291.753515468" watchObservedRunningTime="2026-07-06 20:39:49.337242805 +0000 UTC m=+291.754492234" Jul 06 20:39:50.322192 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:50.322159 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-66hkd" Jul 06 20:39:57.970208 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:57.970168 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 20:39:57.970671 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:57.970378 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 20:39:57.977918 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:39:57.977895 2562 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 20:40:01.330011 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:40:01.329976 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-66hkd" Jul 06 20:40:05.298811 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:40:05.298775 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-lxtnq" Jul 06 20:40:09.321233 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:40:09.321199 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-5fbd5c4644-47c8s" Jul 06 20:40:52.283458 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:40:52.283382 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-28mhv"] Jul 06 20:40:52.285612 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:40:52.285594 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-28mhv" Jul 06 20:40:52.288554 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:40:52.288529 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 06 20:40:52.288689 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:40:52.288674 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-fqzmq\"" Jul 06 20:40:52.289830 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:40:52.289811 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 06 20:40:52.289933 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:40:52.289870 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 06 20:40:52.298472 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:40:52.298445 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-28mhv"] Jul 06 20:40:52.362090 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:40:52.362041 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8ace2ca9-3026-4fd7-b526-115fd975302c-data\") pod \"seaweedfs-64568bcd49-28mhv\" (UID: \"8ace2ca9-3026-4fd7-b526-115fd975302c\") " pod="kserve/seaweedfs-64568bcd49-28mhv" Jul 06 20:40:52.362272 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:40:52.362154 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szxpb\" (UniqueName: \"kubernetes.io/projected/8ace2ca9-3026-4fd7-b526-115fd975302c-kube-api-access-szxpb\") pod \"seaweedfs-64568bcd49-28mhv\" (UID: \"8ace2ca9-3026-4fd7-b526-115fd975302c\") " pod="kserve/seaweedfs-64568bcd49-28mhv" Jul 06 20:40:52.463315 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:40:52.463275 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szxpb\" (UniqueName: \"kubernetes.io/projected/8ace2ca9-3026-4fd7-b526-115fd975302c-kube-api-access-szxpb\") pod \"seaweedfs-64568bcd49-28mhv\" (UID: \"8ace2ca9-3026-4fd7-b526-115fd975302c\") " pod="kserve/seaweedfs-64568bcd49-28mhv" Jul 06 20:40:52.463507 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:40:52.463340 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8ace2ca9-3026-4fd7-b526-115fd975302c-data\") pod \"seaweedfs-64568bcd49-28mhv\" (UID: \"8ace2ca9-3026-4fd7-b526-115fd975302c\") " pod="kserve/seaweedfs-64568bcd49-28mhv" Jul 06 20:40:52.463789 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:40:52.463765 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8ace2ca9-3026-4fd7-b526-115fd975302c-data\") pod \"seaweedfs-64568bcd49-28mhv\" (UID: \"8ace2ca9-3026-4fd7-b526-115fd975302c\") " pod="kserve/seaweedfs-64568bcd49-28mhv" Jul 06 20:40:52.474605 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:40:52.474571 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szxpb\" (UniqueName: \"kubernetes.io/projected/8ace2ca9-3026-4fd7-b526-115fd975302c-kube-api-access-szxpb\") pod \"seaweedfs-64568bcd49-28mhv\" (UID: \"8ace2ca9-3026-4fd7-b526-115fd975302c\") " pod="kserve/seaweedfs-64568bcd49-28mhv" Jul 06 20:40:52.597730 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:40:52.597639 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-28mhv" Jul 06 20:40:52.733782 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:40:52.733660 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-28mhv"] Jul 06 20:40:52.736385 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:40:52.736355 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ace2ca9_3026_4fd7_b526_115fd975302c.slice/crio-5db20a28e4a4620ac3a62136d6f19282e5b30f4f72df125e2055fe98984c736a WatchSource:0}: Error finding container 5db20a28e4a4620ac3a62136d6f19282e5b30f4f72df125e2055fe98984c736a: Status 404 returned error can't find the container with id 5db20a28e4a4620ac3a62136d6f19282e5b30f4f72df125e2055fe98984c736a Jul 06 20:40:52.737674 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:40:52.737654 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 20:40:53.558230 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:40:53.558192 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-28mhv" event={"ID":"8ace2ca9-3026-4fd7-b526-115fd975302c","Type":"ContainerStarted","Data":"5db20a28e4a4620ac3a62136d6f19282e5b30f4f72df125e2055fe98984c736a"} Jul 06 20:40:56.570619 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:40:56.570584 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-28mhv" event={"ID":"8ace2ca9-3026-4fd7-b526-115fd975302c","Type":"ContainerStarted","Data":"c17b64127f872b993e6552da93ab226a5a1aa50fa51073283a1d3ab111d42bfc"} Jul 06 20:40:56.571040 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:40:56.570693 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-28mhv" Jul 06 20:40:56.588758 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:40:56.588706 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-28mhv" podStartSLOduration=1.252105327 podStartE2EDuration="4.5886877s" totalImagesPullingTime="3.336582373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:40:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:40:56.587428342 +0000 UTC m=+359.004677772" watchObservedRunningTime="2026-07-06 20:40:56.5886877 +0000 UTC m=+359.005937129" Jul 06 20:41:02.577399 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:41:02.577369 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-28mhv" Jul 06 20:41:47.699332 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:41:47.699295 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-tfx4q"] Jul 06 20:41:47.703725 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:41:47.703704 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-tfx4q" Jul 06 20:41:47.709043 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:41:47.709017 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 06 20:41:47.709261 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:41:47.709074 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:41:47.709261 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:41:47.709153 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-v82w5\"" Jul 06 20:41:47.723114 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:41:47.723084 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-tfx4q"] Jul 06 20:41:47.800456 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:41:47.800419 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70b6b38c-8062-4a92-805a-584163affd60-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-tfx4q\" (UID: \"70b6b38c-8062-4a92-805a-584163affd60\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-tfx4q" Jul 06 20:41:47.800456 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:41:47.800460 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb644\" (UniqueName: \"kubernetes.io/projected/70b6b38c-8062-4a92-805a-584163affd60-kube-api-access-wb644\") pod \"cert-manager-operator-controller-manager-684f79c9b9-tfx4q\" (UID: \"70b6b38c-8062-4a92-805a-584163affd60\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-tfx4q" Jul 06 20:41:47.901811 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:41:47.901771 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70b6b38c-8062-4a92-805a-584163affd60-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-tfx4q\" (UID: \"70b6b38c-8062-4a92-805a-584163affd60\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-tfx4q" Jul 06 20:41:47.901811 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:41:47.901811 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb644\" (UniqueName: \"kubernetes.io/projected/70b6b38c-8062-4a92-805a-584163affd60-kube-api-access-wb644\") pod \"cert-manager-operator-controller-manager-684f79c9b9-tfx4q\" (UID: \"70b6b38c-8062-4a92-805a-584163affd60\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-tfx4q" Jul 06 20:41:47.902243 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:41:47.902223 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70b6b38c-8062-4a92-805a-584163affd60-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-tfx4q\" (UID: \"70b6b38c-8062-4a92-805a-584163affd60\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-tfx4q" Jul 06 20:41:47.912294 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:41:47.912262 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb644\" (UniqueName: \"kubernetes.io/projected/70b6b38c-8062-4a92-805a-584163affd60-kube-api-access-wb644\") pod \"cert-manager-operator-controller-manager-684f79c9b9-tfx4q\" (UID: \"70b6b38c-8062-4a92-805a-584163affd60\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-tfx4q" Jul 06 20:41:48.013641 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:41:48.013548 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-tfx4q" Jul 06 20:41:48.173797 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:41:48.173757 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-tfx4q"] Jul 06 20:41:48.177030 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:41:48.176998 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70b6b38c_8062_4a92_805a_584163affd60.slice/crio-87332953145ecbdb97500e6009a3261b53a0795d5960148f705b323a596da731 WatchSource:0}: Error finding container 87332953145ecbdb97500e6009a3261b53a0795d5960148f705b323a596da731: Status 404 returned error can't find the container with id 87332953145ecbdb97500e6009a3261b53a0795d5960148f705b323a596da731 Jul 06 20:41:48.771988 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:41:48.771948 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-tfx4q" event={"ID":"70b6b38c-8062-4a92-805a-584163affd60","Type":"ContainerStarted","Data":"87332953145ecbdb97500e6009a3261b53a0795d5960148f705b323a596da731"} Jul 06 20:42:07.376168 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:07.376128 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7954d98b8f-p9fbv"] Jul 06 20:42:09.865713 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:09.865676 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-tfx4q" event={"ID":"70b6b38c-8062-4a92-805a-584163affd60","Type":"ContainerStarted","Data":"6090fb6458f33a24871a83306b72875f14c02296b95de5ddeb342970675a170f"} Jul 06 20:42:09.894811 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:09.894758 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-tfx4q" podStartSLOduration=2.07933706 podStartE2EDuration="22.894740127s" totalImagesPullingTime="20.815403067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:41:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:42:09.892349665 +0000 UTC m=+432.309599111" watchObservedRunningTime="2026-07-06 20:42:09.894740127 +0000 UTC m=+432.311989556" Jul 06 20:42:32.396903 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:32.396821 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7954d98b8f-p9fbv" podUID="bc5c832b-86a5-4f79-ad58-7aacceeaf3d6" containerName="console" containerID="cri-o://a5872fbf3fc69d248167203e48947e5e8fb22c5e3c13ecf74695ef3962a46ad0" gracePeriod=15 Jul 06 20:42:32.635837 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:32.635812 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7954d98b8f-p9fbv" Jul 06 20:42:32.777828 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:32.777730 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-console-serving-cert\") pod \"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6\" (UID: \"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6\") " Jul 06 20:42:32.777828 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:32.777806 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-console-config\") pod \"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6\" (UID: \"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6\") " Jul 06 20:42:32.777828 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:32.777829 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-service-ca\") pod \"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6\" (UID: \"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6\") " Jul 06 20:42:32.778129 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:32.777850 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-oauth-serving-cert\") pod \"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6\" (UID: \"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6\") " Jul 06 20:42:32.778129 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:32.777872 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cq6lv\" (UniqueName: \"kubernetes.io/projected/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-kube-api-access-cq6lv\") pod \"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6\" (UID: \"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6\") " Jul 06 20:42:32.778129 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:32.778055 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-trusted-ca-bundle\") pod \"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6\" (UID: \"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6\") " Jul 06 20:42:32.778129 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:32.778118 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-console-oauth-config\") pod \"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6\" (UID: \"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6\") " Jul 06 20:42:32.778339 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:32.778310 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-console-config" (OuterVolumeSpecName: "console-config") pod "bc5c832b-86a5-4f79-ad58-7aacceeaf3d6" (UID: "bc5c832b-86a5-4f79-ad58-7aacceeaf3d6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:42:32.778339 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:32.778314 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-service-ca" (OuterVolumeSpecName: "service-ca") pod "bc5c832b-86a5-4f79-ad58-7aacceeaf3d6" (UID: "bc5c832b-86a5-4f79-ad58-7aacceeaf3d6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:42:32.778339 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:32.778322 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bc5c832b-86a5-4f79-ad58-7aacceeaf3d6" (UID: "bc5c832b-86a5-4f79-ad58-7aacceeaf3d6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:42:32.778483 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:32.778356 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bc5c832b-86a5-4f79-ad58-7aacceeaf3d6" (UID: "bc5c832b-86a5-4f79-ad58-7aacceeaf3d6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:42:32.780112 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:32.780081 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bc5c832b-86a5-4f79-ad58-7aacceeaf3d6" (UID: "bc5c832b-86a5-4f79-ad58-7aacceeaf3d6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:42:32.780230 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:32.780186 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-kube-api-access-cq6lv" (OuterVolumeSpecName: "kube-api-access-cq6lv") pod "bc5c832b-86a5-4f79-ad58-7aacceeaf3d6" (UID: "bc5c832b-86a5-4f79-ad58-7aacceeaf3d6"). InnerVolumeSpecName "kube-api-access-cq6lv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:42:32.780276 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:32.780257 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bc5c832b-86a5-4f79-ad58-7aacceeaf3d6" (UID: "bc5c832b-86a5-4f79-ad58-7aacceeaf3d6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:42:32.879089 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:32.879052 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-console-config\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 20:42:32.879089 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:32.879082 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-service-ca\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 20:42:32.879089 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:32.879094 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-oauth-serving-cert\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 20:42:32.879324 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:32.879108 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cq6lv\" (UniqueName: \"kubernetes.io/projected/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-kube-api-access-cq6lv\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 20:42:32.879324 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:32.879122 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-trusted-ca-bundle\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 20:42:32.879324 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:32.879136 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-console-oauth-config\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 20:42:32.879324 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:32.879147 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6-console-serving-cert\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 20:42:32.958978 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:32.958944 2562 generic.go:356] "Generic (PLEG): container finished" podID="bc5c832b-86a5-4f79-ad58-7aacceeaf3d6" containerID="a5872fbf3fc69d248167203e48947e5e8fb22c5e3c13ecf74695ef3962a46ad0" exitCode=0 Jul 06 20:42:32.959151 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:32.958994 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7954d98b8f-p9fbv" Jul 06 20:42:32.959151 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:32.959023 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7954d98b8f-p9fbv" event={"ID":"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6","Type":"ContainerDied","Data":"a5872fbf3fc69d248167203e48947e5e8fb22c5e3c13ecf74695ef3962a46ad0"} Jul 06 20:42:32.959151 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:32.959079 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7954d98b8f-p9fbv" event={"ID":"bc5c832b-86a5-4f79-ad58-7aacceeaf3d6","Type":"ContainerDied","Data":"d0a0d4e1f83c1ffcbd59ef1c0f00988571ad9e62a4b07d54dc10605328b0e36b"} Jul 06 20:42:32.959151 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:32.959100 2562 scope.go:117] "RemoveContainer" containerID="a5872fbf3fc69d248167203e48947e5e8fb22c5e3c13ecf74695ef3962a46ad0" Jul 06 20:42:32.967785 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:32.967761 2562 scope.go:117] "RemoveContainer" containerID="a5872fbf3fc69d248167203e48947e5e8fb22c5e3c13ecf74695ef3962a46ad0" Jul 06 20:42:32.968153 ip-10-0-142-77 kubenswrapper[2562]: E0706 20:42:32.968131 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5872fbf3fc69d248167203e48947e5e8fb22c5e3c13ecf74695ef3962a46ad0\": container with ID starting with a5872fbf3fc69d248167203e48947e5e8fb22c5e3c13ecf74695ef3962a46ad0 not found: ID does not exist" containerID="a5872fbf3fc69d248167203e48947e5e8fb22c5e3c13ecf74695ef3962a46ad0" Jul 06 20:42:32.968233 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:32.968160 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5872fbf3fc69d248167203e48947e5e8fb22c5e3c13ecf74695ef3962a46ad0"} err="failed to get container status \"a5872fbf3fc69d248167203e48947e5e8fb22c5e3c13ecf74695ef3962a46ad0\": rpc error: code = NotFound desc = could not find container \"a5872fbf3fc69d248167203e48947e5e8fb22c5e3c13ecf74695ef3962a46ad0\": container with ID starting with a5872fbf3fc69d248167203e48947e5e8fb22c5e3c13ecf74695ef3962a46ad0 not found: ID does not exist" Jul 06 20:42:32.981494 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:32.981462 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7954d98b8f-p9fbv"] Jul 06 20:42:32.985444 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:32.985413 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7954d98b8f-p9fbv"] Jul 06 20:42:34.098136 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:34.098099 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc5c832b-86a5-4f79-ad58-7aacceeaf3d6" path="/var/lib/kubelet/pods/bc5c832b-86a5-4f79-ad58-7aacceeaf3d6/volumes" Jul 06 20:42:41.139129 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.139089 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmx9k"] Jul 06 20:42:41.139594 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.139399 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc5c832b-86a5-4f79-ad58-7aacceeaf3d6" containerName="console" Jul 06 20:42:41.139594 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.139411 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc5c832b-86a5-4f79-ad58-7aacceeaf3d6" containerName="console" Jul 06 20:42:41.139594 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.139458 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc5c832b-86a5-4f79-ad58-7aacceeaf3d6" containerName="console" Jul 06 20:42:41.143917 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.143893 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmx9k" Jul 06 20:42:41.146676 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.146643 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 06 20:42:41.146676 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.146659 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 06 20:42:41.146924 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.146707 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 20:42:41.146924 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.146722 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 06 20:42:41.147056 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.147027 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 20:42:41.147143 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.147125 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-j8stx\"" Jul 06 20:42:41.147213 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.147158 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 20:42:41.156928 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.156904 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmx9k"] Jul 06 20:42:41.244650 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.244614 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-zmx9k\" (UID: \"58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmx9k" Jul 06 20:42:41.244650 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.244649 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-zmx9k\" (UID: \"58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmx9k" Jul 06 20:42:41.244931 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.244673 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-zmx9k\" (UID: \"58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmx9k" Jul 06 20:42:41.244931 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.244742 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-zmx9k\" (UID: \"58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmx9k" Jul 06 20:42:41.244931 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.244800 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-zmx9k\" (UID: \"58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmx9k" Jul 06 20:42:41.244931 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.244820 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-zmx9k\" (UID: \"58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmx9k" Jul 06 20:42:41.244931 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.244838 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52km6\" (UniqueName: \"kubernetes.io/projected/58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab-kube-api-access-52km6\") pod \"istiod-openshift-gateway-94bb8fbfd-zmx9k\" (UID: \"58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmx9k" Jul 06 20:42:41.345998 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.345957 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-zmx9k\" (UID: \"58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmx9k" Jul 06 20:42:41.345998 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.345995 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-zmx9k\" (UID: \"58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmx9k" Jul 06 20:42:41.346259 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.346013 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52km6\" (UniqueName: \"kubernetes.io/projected/58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab-kube-api-access-52km6\") pod \"istiod-openshift-gateway-94bb8fbfd-zmx9k\" (UID: \"58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmx9k" Jul 06 20:42:41.346259 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.346053 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-zmx9k\" (UID: \"58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmx9k" Jul 06 20:42:41.346259 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.346069 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-zmx9k\" (UID: \"58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmx9k" Jul 06 20:42:41.346259 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.346096 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-zmx9k\" (UID: \"58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmx9k" Jul 06 20:42:41.346259 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.346124 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-zmx9k\" (UID: \"58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmx9k" Jul 06 20:42:41.346778 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.346753 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-zmx9k\" (UID: \"58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmx9k" Jul 06 20:42:41.348453 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.348417 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-zmx9k\" (UID: \"58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmx9k" Jul 06 20:42:41.348632 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.348603 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-zmx9k\" (UID: \"58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmx9k" Jul 06 20:42:41.348813 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.348798 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-zmx9k\" (UID: \"58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmx9k" Jul 06 20:42:41.348897 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.348853 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-zmx9k\" (UID: \"58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmx9k" Jul 06 20:42:41.355714 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.355688 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-zmx9k\" (UID: \"58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmx9k" Jul 06 20:42:41.356114 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.356092 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52km6\" (UniqueName: \"kubernetes.io/projected/58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab-kube-api-access-52km6\") pod \"istiod-openshift-gateway-94bb8fbfd-zmx9k\" (UID: \"58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmx9k" Jul 06 20:42:41.453283 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.453191 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmx9k" Jul 06 20:42:41.598902 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.598846 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmx9k"] Jul 06 20:42:41.602102 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:42:41.602075 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58c5f93d_bb5c_4b9a_9fa9_56cb83e17cab.slice/crio-0e8318e94ea48e8a6ff3b1ac0a6f4616fd6f315b5daffdb8dbe3d2d2c03c33f3 WatchSource:0}: Error finding container 0e8318e94ea48e8a6ff3b1ac0a6f4616fd6f315b5daffdb8dbe3d2d2c03c33f3: Status 404 returned error can't find the container with id 0e8318e94ea48e8a6ff3b1ac0a6f4616fd6f315b5daffdb8dbe3d2d2c03c33f3 Jul 06 20:42:41.999712 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:41.999678 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmx9k" event={"ID":"58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab","Type":"ContainerStarted","Data":"0e8318e94ea48e8a6ff3b1ac0a6f4616fd6f315b5daffdb8dbe3d2d2c03c33f3"} Jul 06 20:42:43.921502 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:43.921464 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:42:43.921747 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:43.921539 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:42:44.011133 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:44.011097 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmx9k" event={"ID":"58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab","Type":"ContainerStarted","Data":"a3a8211c3cb749254a0a10e42da579374e3ac954c0b04adfbb1cead5b878cb13"} Jul 06 20:42:44.011335 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:44.011280 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmx9k" Jul 06 20:42:44.012901 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:44.012861 2562 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-zmx9k container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.24:8080/ready\": dial tcp 10.133.0.24:8080: connect: connection refused" start-of-body= Jul 06 20:42:44.012961 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:44.012930 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmx9k" podUID="58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab" containerName="discovery" probeResult="failure" output="Get \"http://10.133.0.24:8080/ready\": dial tcp 10.133.0.24:8080: connect: connection refused" Jul 06 20:42:44.042911 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:44.042845 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmx9k" podStartSLOduration=0.725933658 podStartE2EDuration="3.042824385s" totalImagesPullingTime="2.316890727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:42:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:42:44.040464458 +0000 UTC m=+466.457713887" watchObservedRunningTime="2026-07-06 20:42:44.042824385 +0000 UTC m=+466.460073814" Jul 06 20:42:45.017064 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:42:45.017037 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmx9k" Jul 06 20:43:09.128152 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:43:09.128122 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7845fd6587-tgmtj"] Jul 06 20:43:09.132217 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:43:09.132195 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7845fd6587-tgmtj" Jul 06 20:43:09.135663 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:43:09.135638 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 06 20:43:09.135805 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:43:09.135640 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 06 20:43:09.135805 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:43:09.135688 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-24pnd\"" Jul 06 20:43:09.135953 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:43:09.135940 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 20:43:09.151172 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:43:09.151145 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:43:09.152978 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:43:09.152955 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 06 20:43:09.163705 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:43:09.163672 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7845fd6587-tgmtj"] Jul 06 20:43:09.175854 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:43:09.175825 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdwzp\" (UniqueName: \"kubernetes.io/projected/d91ddef4-fcea-4a6c-afbb-7cb8e2faa4f1-kube-api-access-xdwzp\") pod \"lws-controller-manager-7845fd6587-tgmtj\" (UID: \"d91ddef4-fcea-4a6c-afbb-7cb8e2faa4f1\") " pod="openshift-lws-operator/lws-controller-manager-7845fd6587-tgmtj" Jul 06 20:43:09.175854 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:43:09.175858 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d91ddef4-fcea-4a6c-afbb-7cb8e2faa4f1-metrics-cert\") pod \"lws-controller-manager-7845fd6587-tgmtj\" (UID: \"d91ddef4-fcea-4a6c-afbb-7cb8e2faa4f1\") " pod="openshift-lws-operator/lws-controller-manager-7845fd6587-tgmtj" Jul 06 20:43:09.176103 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:43:09.175905 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d91ddef4-fcea-4a6c-afbb-7cb8e2faa4f1-manager-config\") pod \"lws-controller-manager-7845fd6587-tgmtj\" (UID: \"d91ddef4-fcea-4a6c-afbb-7cb8e2faa4f1\") " pod="openshift-lws-operator/lws-controller-manager-7845fd6587-tgmtj" Jul 06 20:43:09.176103 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:43:09.176008 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d91ddef4-fcea-4a6c-afbb-7cb8e2faa4f1-cert\") pod \"lws-controller-manager-7845fd6587-tgmtj\" (UID: \"d91ddef4-fcea-4a6c-afbb-7cb8e2faa4f1\") " pod="openshift-lws-operator/lws-controller-manager-7845fd6587-tgmtj" Jul 06 20:43:09.276592 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:43:09.276543 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d91ddef4-fcea-4a6c-afbb-7cb8e2faa4f1-cert\") pod \"lws-controller-manager-7845fd6587-tgmtj\" (UID: \"d91ddef4-fcea-4a6c-afbb-7cb8e2faa4f1\") " pod="openshift-lws-operator/lws-controller-manager-7845fd6587-tgmtj" Jul 06 20:43:09.276784 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:43:09.276636 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdwzp\" (UniqueName: \"kubernetes.io/projected/d91ddef4-fcea-4a6c-afbb-7cb8e2faa4f1-kube-api-access-xdwzp\") pod \"lws-controller-manager-7845fd6587-tgmtj\" (UID: \"d91ddef4-fcea-4a6c-afbb-7cb8e2faa4f1\") " pod="openshift-lws-operator/lws-controller-manager-7845fd6587-tgmtj" Jul 06 20:43:09.276784 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:43:09.276656 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d91ddef4-fcea-4a6c-afbb-7cb8e2faa4f1-metrics-cert\") pod \"lws-controller-manager-7845fd6587-tgmtj\" (UID: \"d91ddef4-fcea-4a6c-afbb-7cb8e2faa4f1\") " pod="openshift-lws-operator/lws-controller-manager-7845fd6587-tgmtj" Jul 06 20:43:09.276784 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:43:09.276675 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d91ddef4-fcea-4a6c-afbb-7cb8e2faa4f1-manager-config\") pod \"lws-controller-manager-7845fd6587-tgmtj\" (UID: \"d91ddef4-fcea-4a6c-afbb-7cb8e2faa4f1\") " pod="openshift-lws-operator/lws-controller-manager-7845fd6587-tgmtj" Jul 06 20:43:09.277390 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:43:09.277361 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d91ddef4-fcea-4a6c-afbb-7cb8e2faa4f1-manager-config\") pod \"lws-controller-manager-7845fd6587-tgmtj\" (UID: \"d91ddef4-fcea-4a6c-afbb-7cb8e2faa4f1\") " pod="openshift-lws-operator/lws-controller-manager-7845fd6587-tgmtj" Jul 06 20:43:09.279195 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:43:09.279165 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d91ddef4-fcea-4a6c-afbb-7cb8e2faa4f1-cert\") pod \"lws-controller-manager-7845fd6587-tgmtj\" (UID: \"d91ddef4-fcea-4a6c-afbb-7cb8e2faa4f1\") " pod="openshift-lws-operator/lws-controller-manager-7845fd6587-tgmtj" Jul 06 20:43:09.279322 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:43:09.279213 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d91ddef4-fcea-4a6c-afbb-7cb8e2faa4f1-metrics-cert\") pod \"lws-controller-manager-7845fd6587-tgmtj\" (UID: \"d91ddef4-fcea-4a6c-afbb-7cb8e2faa4f1\") " pod="openshift-lws-operator/lws-controller-manager-7845fd6587-tgmtj" Jul 06 20:43:09.289089 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:43:09.289061 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdwzp\" (UniqueName: \"kubernetes.io/projected/d91ddef4-fcea-4a6c-afbb-7cb8e2faa4f1-kube-api-access-xdwzp\") pod \"lws-controller-manager-7845fd6587-tgmtj\" (UID: \"d91ddef4-fcea-4a6c-afbb-7cb8e2faa4f1\") " pod="openshift-lws-operator/lws-controller-manager-7845fd6587-tgmtj" Jul 06 20:43:09.441096 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:43:09.441006 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7845fd6587-tgmtj" Jul 06 20:43:09.598198 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:43:09.598167 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7845fd6587-tgmtj"] Jul 06 20:43:09.601718 ip-10-0-142-77 kubenswrapper[2562]: W0706 20:43:09.601685 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd91ddef4_fcea_4a6c_afbb_7cb8e2faa4f1.slice/crio-df7642b1faa41491ef191810f0a86799ecf70d8a9a3f28d397053eee540cff0b WatchSource:0}: Error finding container df7642b1faa41491ef191810f0a86799ecf70d8a9a3f28d397053eee540cff0b: Status 404 returned error can't find the container with id df7642b1faa41491ef191810f0a86799ecf70d8a9a3f28d397053eee540cff0b Jul 06 20:43:10.138168 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:43:10.138127 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7845fd6587-tgmtj" event={"ID":"d91ddef4-fcea-4a6c-afbb-7cb8e2faa4f1","Type":"ContainerStarted","Data":"df7642b1faa41491ef191810f0a86799ecf70d8a9a3f28d397053eee540cff0b"} Jul 06 20:43:13.153598 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:43:13.153555 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7845fd6587-tgmtj" event={"ID":"d91ddef4-fcea-4a6c-afbb-7cb8e2faa4f1","Type":"ContainerStarted","Data":"4c6dade1be614f0df39ac399d52236e779b4517a330a3eafd03e33f68882bb74"} Jul 06 20:43:13.154041 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:43:13.153644 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7845fd6587-tgmtj" Jul 06 20:43:13.186130 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:43:13.186080 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7845fd6587-tgmtj" podStartSLOduration=1.6367899750000001 podStartE2EDuration="4.186064899s" totalImagesPullingTime="2.549274924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:43:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:43:13.184209429 +0000 UTC m=+495.601458859" watchObservedRunningTime="2026-07-06 20:43:13.186064899 +0000 UTC m=+495.603314329" Jul 06 20:43:24.160597 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:43:24.160567 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7845fd6587-tgmtj" Jul 06 20:44:57.993835 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:44:57.993800 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 20:44:57.995129 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:44:57.995108 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 20:49:58.016737 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:49:58.016656 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 20:49:58.019049 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:49:58.019021 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 20:54:58.040437 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:54:58.040409 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 20:54:58.043184 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:54:58.043160 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 20:59:58.062750 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:59:58.062721 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 20:59:58.066259 ip-10-0-142-77 kubenswrapper[2562]: I0706 20:59:58.066230 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 21:04:58.085337 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:04:58.085303 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 21:04:58.089264 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:04:58.089243 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 21:09:58.108385 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:09:58.108358 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 21:09:58.114397 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:09:58.114372 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 21:14:58.130314 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:14:58.130285 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 21:14:58.136780 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:14:58.136756 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 21:19:58.153069 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:19:58.152997 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 21:19:58.160046 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:19:58.160022 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 21:24:58.176088 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:24:58.176056 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 21:24:58.183599 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:24:58.183578 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 21:29:58.197326 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:29:58.197297 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 21:29:58.206706 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:29:58.206682 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 21:34:58.219107 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:34:58.219076 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 21:34:58.228975 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:34:58.228949 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 21:39:58.242420 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:39:58.242381 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 21:39:58.252377 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:39:58.252351 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 21:44:58.264821 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:44:58.264711 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 21:44:58.275708 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:44:58.275686 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 21:49:58.286670 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:49:58.286564 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 21:49:58.297780 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:49:58.297760 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 21:54:58.315088 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:54:58.314969 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 21:54:58.323303 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:54:58.323283 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 21:59:51.654580 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:59:51.654543 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8"] Jul 06 21:59:51.657551 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:59:51.657535 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8" Jul 06 21:59:51.661238 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:59:51.661215 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"rolling-upgrade-test-kserve-self-signed-certs\"" Jul 06 21:59:51.661497 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:59:51.661480 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 06 21:59:51.661683 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:59:51.661668 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Jul 06 21:59:51.661751 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:59:51.661677 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-6qcsh\"" Jul 06 21:59:51.672572 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:59:51.672549 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8"] Jul 06 21:59:51.786638 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:59:51.786593 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3efa9b3-3d18-424b-8985-7d15a7dd3d63-home\") pod \"rolling-upgrade-test-kserve-859df57bcb-xcph8\" (UID: \"b3efa9b3-3d18-424b-8985-7d15a7dd3d63\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8" Jul 06 21:59:51.786638 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:59:51.786639 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4wlx\" (UniqueName: \"kubernetes.io/projected/b3efa9b3-3d18-424b-8985-7d15a7dd3d63-kube-api-access-j4wlx\") pod \"rolling-upgrade-test-kserve-859df57bcb-xcph8\" (UID: \"b3efa9b3-3d18-424b-8985-7d15a7dd3d63\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8" Jul 06 21:59:51.786858 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:59:51.786707 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3efa9b3-3d18-424b-8985-7d15a7dd3d63-dshm\") pod \"rolling-upgrade-test-kserve-859df57bcb-xcph8\" (UID: \"b3efa9b3-3d18-424b-8985-7d15a7dd3d63\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8" Jul 06 21:59:51.786858 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:59:51.786764 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3efa9b3-3d18-424b-8985-7d15a7dd3d63-tls-certs\") pod \"rolling-upgrade-test-kserve-859df57bcb-xcph8\" (UID: \"b3efa9b3-3d18-424b-8985-7d15a7dd3d63\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8" Jul 06 21:59:51.786858 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:59:51.786785 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3efa9b3-3d18-424b-8985-7d15a7dd3d63-model-cache\") pod \"rolling-upgrade-test-kserve-859df57bcb-xcph8\" (UID: \"b3efa9b3-3d18-424b-8985-7d15a7dd3d63\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8" Jul 06 21:59:51.786858 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:59:51.786829 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3efa9b3-3d18-424b-8985-7d15a7dd3d63-tmp-dir\") pod \"rolling-upgrade-test-kserve-859df57bcb-xcph8\" (UID: \"b3efa9b3-3d18-424b-8985-7d15a7dd3d63\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8" Jul 06 21:59:51.888191 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:59:51.888149 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3efa9b3-3d18-424b-8985-7d15a7dd3d63-tmp-dir\") pod \"rolling-upgrade-test-kserve-859df57bcb-xcph8\" (UID: \"b3efa9b3-3d18-424b-8985-7d15a7dd3d63\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8" Jul 06 21:59:51.888191 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:59:51.888190 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3efa9b3-3d18-424b-8985-7d15a7dd3d63-home\") pod \"rolling-upgrade-test-kserve-859df57bcb-xcph8\" (UID: \"b3efa9b3-3d18-424b-8985-7d15a7dd3d63\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8" Jul 06 21:59:51.888425 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:59:51.888210 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4wlx\" (UniqueName: \"kubernetes.io/projected/b3efa9b3-3d18-424b-8985-7d15a7dd3d63-kube-api-access-j4wlx\") pod \"rolling-upgrade-test-kserve-859df57bcb-xcph8\" (UID: \"b3efa9b3-3d18-424b-8985-7d15a7dd3d63\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8" Jul 06 21:59:51.888425 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:59:51.888247 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3efa9b3-3d18-424b-8985-7d15a7dd3d63-dshm\") pod \"rolling-upgrade-test-kserve-859df57bcb-xcph8\" (UID: \"b3efa9b3-3d18-424b-8985-7d15a7dd3d63\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8" Jul 06 21:59:51.888425 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:59:51.888291 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3efa9b3-3d18-424b-8985-7d15a7dd3d63-tls-certs\") pod \"rolling-upgrade-test-kserve-859df57bcb-xcph8\" (UID: \"b3efa9b3-3d18-424b-8985-7d15a7dd3d63\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8" Jul 06 21:59:51.888425 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:59:51.888318 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3efa9b3-3d18-424b-8985-7d15a7dd3d63-model-cache\") pod \"rolling-upgrade-test-kserve-859df57bcb-xcph8\" (UID: \"b3efa9b3-3d18-424b-8985-7d15a7dd3d63\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8" Jul 06 21:59:51.888668 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:59:51.888641 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3efa9b3-3d18-424b-8985-7d15a7dd3d63-tmp-dir\") pod \"rolling-upgrade-test-kserve-859df57bcb-xcph8\" (UID: \"b3efa9b3-3d18-424b-8985-7d15a7dd3d63\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8" Jul 06 21:59:51.888728 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:59:51.888685 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3efa9b3-3d18-424b-8985-7d15a7dd3d63-home\") pod \"rolling-upgrade-test-kserve-859df57bcb-xcph8\" (UID: \"b3efa9b3-3d18-424b-8985-7d15a7dd3d63\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8" Jul 06 21:59:51.888728 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:59:51.888721 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3efa9b3-3d18-424b-8985-7d15a7dd3d63-model-cache\") pod \"rolling-upgrade-test-kserve-859df57bcb-xcph8\" (UID: \"b3efa9b3-3d18-424b-8985-7d15a7dd3d63\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8" Jul 06 21:59:51.890664 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:59:51.890641 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3efa9b3-3d18-424b-8985-7d15a7dd3d63-dshm\") pod \"rolling-upgrade-test-kserve-859df57bcb-xcph8\" (UID: \"b3efa9b3-3d18-424b-8985-7d15a7dd3d63\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8" Jul 06 21:59:51.890850 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:59:51.890831 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3efa9b3-3d18-424b-8985-7d15a7dd3d63-tls-certs\") pod \"rolling-upgrade-test-kserve-859df57bcb-xcph8\" (UID: \"b3efa9b3-3d18-424b-8985-7d15a7dd3d63\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8" Jul 06 21:59:51.897017 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:59:51.896996 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4wlx\" (UniqueName: \"kubernetes.io/projected/b3efa9b3-3d18-424b-8985-7d15a7dd3d63-kube-api-access-j4wlx\") pod \"rolling-upgrade-test-kserve-859df57bcb-xcph8\" (UID: \"b3efa9b3-3d18-424b-8985-7d15a7dd3d63\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8" Jul 06 21:59:51.967837 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:59:51.967742 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8" Jul 06 21:59:52.111989 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:59:52.111955 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8"] Jul 06 21:59:52.115538 ip-10-0-142-77 kubenswrapper[2562]: W0706 21:59:52.115489 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3efa9b3_3d18_424b_8985_7d15a7dd3d63.slice/crio-308b8ee047d77b0c03e1bcec669be1a0d00e84c5348c42ab70517d7b4d2e1918 WatchSource:0}: Error finding container 308b8ee047d77b0c03e1bcec669be1a0d00e84c5348c42ab70517d7b4d2e1918: Status 404 returned error can't find the container with id 308b8ee047d77b0c03e1bcec669be1a0d00e84c5348c42ab70517d7b4d2e1918 Jul 06 21:59:52.117404 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:59:52.117387 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 21:59:53.059292 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:59:53.059242 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8" event={"ID":"b3efa9b3-3d18-424b-8985-7d15a7dd3d63","Type":"ContainerStarted","Data":"308b8ee047d77b0c03e1bcec669be1a0d00e84c5348c42ab70517d7b4d2e1918"} Jul 06 21:59:54.064950 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:59:54.064910 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8" event={"ID":"b3efa9b3-3d18-424b-8985-7d15a7dd3d63","Type":"ContainerStarted","Data":"656f1fc53c02905050176e3a4389289de9943ae18a3a6cf52a07db58cfc4bb1e"} Jul 06 21:59:54.084657 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:59:54.084599 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8" podStartSLOduration=2.076570873 podStartE2EDuration="3.084581302s" totalImagesPullingTime="1.008010429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:59:54.08281564 +0000 UTC m=+5096.500065084" watchObservedRunningTime="2026-07-06 21:59:54.084581302 +0000 UTC m=+5096.501830782" Jul 06 21:59:54.968590 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:59:54.968552 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8" Jul 06 21:59:58.338339 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:59:58.338210 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 21:59:58.346186 ip-10-0-142-77 kubenswrapper[2562]: I0706 21:59:58.346163 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 22:00:01.967958 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:00:01.967921 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8" Jul 06 22:00:01.980668 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:00:01.980632 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8" Jul 06 22:00:02.115606 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:00:02.115570 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8" Jul 06 22:00:25.988046 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:00:25.987954 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8"] Jul 06 22:00:41.017546 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:00:41.017497 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8" podUID="b3efa9b3-3d18-424b-8985-7d15a7dd3d63" containerName="main" containerID="cri-o://656f1fc53c02905050176e3a4389289de9943ae18a3a6cf52a07db58cfc4bb1e" gracePeriod=45 Jul 06 22:00:41.104808 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:00:41.104760 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8" podUID="b3efa9b3-3d18-424b-8985-7d15a7dd3d63" containerName="main" probeResult="failure" output="Get \"https://10.133.0.26:8000/health\": dial tcp 10.133.0.26:8000: connect: connection refused" Jul 06 22:00:41.265303 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:00:41.265265 2562 generic.go:356] "Generic (PLEG): container finished" podID="b3efa9b3-3d18-424b-8985-7d15a7dd3d63" containerID="656f1fc53c02905050176e3a4389289de9943ae18a3a6cf52a07db58cfc4bb1e" exitCode=0 Jul 06 22:00:41.265450 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:00:41.265327 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8" event={"ID":"b3efa9b3-3d18-424b-8985-7d15a7dd3d63","Type":"ContainerDied","Data":"656f1fc53c02905050176e3a4389289de9943ae18a3a6cf52a07db58cfc4bb1e"} Jul 06 22:00:41.265450 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:00:41.265380 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8" event={"ID":"b3efa9b3-3d18-424b-8985-7d15a7dd3d63","Type":"ContainerDied","Data":"308b8ee047d77b0c03e1bcec669be1a0d00e84c5348c42ab70517d7b4d2e1918"} Jul 06 22:00:41.265450 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:00:41.265420 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="308b8ee047d77b0c03e1bcec669be1a0d00e84c5348c42ab70517d7b4d2e1918" Jul 06 22:00:41.268651 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:00:41.268605 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8" Jul 06 22:00:41.315712 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:00:41.315676 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3efa9b3-3d18-424b-8985-7d15a7dd3d63-dshm\") pod \"b3efa9b3-3d18-424b-8985-7d15a7dd3d63\" (UID: \"b3efa9b3-3d18-424b-8985-7d15a7dd3d63\") " Jul 06 22:00:41.315712 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:00:41.315711 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3efa9b3-3d18-424b-8985-7d15a7dd3d63-tls-certs\") pod \"b3efa9b3-3d18-424b-8985-7d15a7dd3d63\" (UID: \"b3efa9b3-3d18-424b-8985-7d15a7dd3d63\") " Jul 06 22:00:41.315967 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:00:41.315735 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3efa9b3-3d18-424b-8985-7d15a7dd3d63-tmp-dir\") pod \"b3efa9b3-3d18-424b-8985-7d15a7dd3d63\" (UID: \"b3efa9b3-3d18-424b-8985-7d15a7dd3d63\") " Jul 06 22:00:41.315967 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:00:41.315784 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3efa9b3-3d18-424b-8985-7d15a7dd3d63-model-cache\") pod \"b3efa9b3-3d18-424b-8985-7d15a7dd3d63\" (UID: \"b3efa9b3-3d18-424b-8985-7d15a7dd3d63\") " Jul 06 22:00:41.315967 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:00:41.315809 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4wlx\" (UniqueName: \"kubernetes.io/projected/b3efa9b3-3d18-424b-8985-7d15a7dd3d63-kube-api-access-j4wlx\") pod \"b3efa9b3-3d18-424b-8985-7d15a7dd3d63\" (UID: \"b3efa9b3-3d18-424b-8985-7d15a7dd3d63\") " Jul 06 22:00:41.315967 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:00:41.315852 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3efa9b3-3d18-424b-8985-7d15a7dd3d63-home\") pod \"b3efa9b3-3d18-424b-8985-7d15a7dd3d63\" (UID: \"b3efa9b3-3d18-424b-8985-7d15a7dd3d63\") " Jul 06 22:00:41.316163 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:00:41.316117 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3efa9b3-3d18-424b-8985-7d15a7dd3d63-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b3efa9b3-3d18-424b-8985-7d15a7dd3d63" (UID: "b3efa9b3-3d18-424b-8985-7d15a7dd3d63"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:00:41.316163 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:00:41.316130 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3efa9b3-3d18-424b-8985-7d15a7dd3d63-home" (OuterVolumeSpecName: "home") pod "b3efa9b3-3d18-424b-8985-7d15a7dd3d63" (UID: "b3efa9b3-3d18-424b-8985-7d15a7dd3d63"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:00:41.316270 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:00:41.316146 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3efa9b3-3d18-424b-8985-7d15a7dd3d63-model-cache" (OuterVolumeSpecName: "model-cache") pod "b3efa9b3-3d18-424b-8985-7d15a7dd3d63" (UID: "b3efa9b3-3d18-424b-8985-7d15a7dd3d63"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:00:41.318089 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:00:41.318057 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3efa9b3-3d18-424b-8985-7d15a7dd3d63-dshm" (OuterVolumeSpecName: "dshm") pod "b3efa9b3-3d18-424b-8985-7d15a7dd3d63" (UID: "b3efa9b3-3d18-424b-8985-7d15a7dd3d63"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:00:41.318199 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:00:41.318141 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3efa9b3-3d18-424b-8985-7d15a7dd3d63-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b3efa9b3-3d18-424b-8985-7d15a7dd3d63" (UID: "b3efa9b3-3d18-424b-8985-7d15a7dd3d63"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:00:41.318199 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:00:41.318147 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3efa9b3-3d18-424b-8985-7d15a7dd3d63-kube-api-access-j4wlx" (OuterVolumeSpecName: "kube-api-access-j4wlx") pod "b3efa9b3-3d18-424b-8985-7d15a7dd3d63" (UID: "b3efa9b3-3d18-424b-8985-7d15a7dd3d63"). InnerVolumeSpecName "kube-api-access-j4wlx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:00:41.416690 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:00:41.416657 2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3efa9b3-3d18-424b-8985-7d15a7dd3d63-home\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 22:00:41.416690 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:00:41.416687 2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3efa9b3-3d18-424b-8985-7d15a7dd3d63-dshm\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 22:00:41.416690 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:00:41.416696 2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3efa9b3-3d18-424b-8985-7d15a7dd3d63-tls-certs\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 22:00:41.416916 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:00:41.416704 2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3efa9b3-3d18-424b-8985-7d15a7dd3d63-tmp-dir\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 22:00:41.416916 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:00:41.416712 2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3efa9b3-3d18-424b-8985-7d15a7dd3d63-model-cache\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 22:00:41.416916 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:00:41.416721 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4wlx\" (UniqueName: \"kubernetes.io/projected/b3efa9b3-3d18-424b-8985-7d15a7dd3d63-kube-api-access-j4wlx\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 22:00:42.269948 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:00:42.269919 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8" Jul 06 22:00:42.286852 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:00:42.286818 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8"] Jul 06 22:00:42.290715 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:00:42.290686 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-xcph8"] Jul 06 22:00:44.098617 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:00:44.098581 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3efa9b3-3d18-424b-8985-7d15a7dd3d63" path="/var/lib/kubelet/pods/b3efa9b3-3d18-424b-8985-7d15a7dd3d63/volumes" Jul 06 22:02:50.279261 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:02:50.279227 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm"] Jul 06 22:02:50.279790 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:02:50.279516 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3efa9b3-3d18-424b-8985-7d15a7dd3d63" containerName="main" Jul 06 22:02:50.279790 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:02:50.279527 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3efa9b3-3d18-424b-8985-7d15a7dd3d63" containerName="main" Jul 06 22:02:50.279790 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:02:50.279590 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3efa9b3-3d18-424b-8985-7d15a7dd3d63" containerName="main" Jul 06 22:02:50.282385 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:02:50.282368 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm" Jul 06 22:02:50.287514 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:02:50.287476 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 06 22:02:50.287514 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:02:50.287509 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Jul 06 22:02:50.287719 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:02:50.287481 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-6qcsh\"" Jul 06 22:02:50.287719 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:02:50.287552 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-ha-replicas-test-epp-sa-dockercfg-bkrv6\"" Jul 06 22:02:50.287719 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:02:50.287581 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-ha-replicas-test-kserve-self-signed-certs\"" Jul 06 22:02:50.298624 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:02:50.298594 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm"] Jul 06 22:02:50.394756 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:02:50.394718 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf8f38e6-62c9-47f2-9010-c78540ae393d-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm\" (UID: \"cf8f38e6-62c9-47f2-9010-c78540ae393d\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm" Jul 06 22:02:50.394756 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:02:50.394754 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hw8s\" (UniqueName: \"kubernetes.io/projected/cf8f38e6-62c9-47f2-9010-c78540ae393d-kube-api-access-8hw8s\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm\" (UID: \"cf8f38e6-62c9-47f2-9010-c78540ae393d\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm" Jul 06 22:02:50.395017 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:02:50.394813 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/cf8f38e6-62c9-47f2-9010-c78540ae393d-tokenizer-uds\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm\" (UID: \"cf8f38e6-62c9-47f2-9010-c78540ae393d\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm" Jul 06 22:02:50.495838 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:02:50.495801 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf8f38e6-62c9-47f2-9010-c78540ae393d-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm\" (UID: \"cf8f38e6-62c9-47f2-9010-c78540ae393d\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm" Jul 06 22:02:50.495838 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:02:50.495838 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hw8s\" (UniqueName: \"kubernetes.io/projected/cf8f38e6-62c9-47f2-9010-c78540ae393d-kube-api-access-8hw8s\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm\" (UID: \"cf8f38e6-62c9-47f2-9010-c78540ae393d\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm" Jul 06 22:02:50.496123 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:02:50.496047 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/cf8f38e6-62c9-47f2-9010-c78540ae393d-tokenizer-uds\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm\" (UID: \"cf8f38e6-62c9-47f2-9010-c78540ae393d\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm" Jul 06 22:02:50.496390 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:02:50.496367 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/cf8f38e6-62c9-47f2-9010-c78540ae393d-tokenizer-uds\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm\" (UID: \"cf8f38e6-62c9-47f2-9010-c78540ae393d\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm" Jul 06 22:02:50.498348 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:02:50.498327 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf8f38e6-62c9-47f2-9010-c78540ae393d-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm\" (UID: \"cf8f38e6-62c9-47f2-9010-c78540ae393d\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm" Jul 06 22:02:50.507437 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:02:50.507408 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hw8s\" (UniqueName: \"kubernetes.io/projected/cf8f38e6-62c9-47f2-9010-c78540ae393d-kube-api-access-8hw8s\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm\" (UID: \"cf8f38e6-62c9-47f2-9010-c78540ae393d\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm" Jul 06 22:02:50.591546 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:02:50.591445 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm" Jul 06 22:02:50.728569 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:02:50.728543 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm"] Jul 06 22:02:50.731279 ip-10-0-142-77 kubenswrapper[2562]: W0706 22:02:50.731255 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf8f38e6_62c9_47f2_9010_c78540ae393d.slice/crio-95f9dc2189f2a70d31335a7afb8436cfc16c682dd316300d23b6d840d9a631d3 WatchSource:0}: Error finding container 95f9dc2189f2a70d31335a7afb8436cfc16c682dd316300d23b6d840d9a631d3: Status 404 returned error can't find the container with id 95f9dc2189f2a70d31335a7afb8436cfc16c682dd316300d23b6d840d9a631d3 Jul 06 22:02:50.791652 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:02:50.791611 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm" event={"ID":"cf8f38e6-62c9-47f2-9010-c78540ae393d","Type":"ContainerStarted","Data":"95f9dc2189f2a70d31335a7afb8436cfc16c682dd316300d23b6d840d9a631d3"} Jul 06 22:02:52.801051 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:02:52.800958 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm" event={"ID":"cf8f38e6-62c9-47f2-9010-c78540ae393d","Type":"ContainerStarted","Data":"d9c5bfe95d1f18dc360a4b2886b2cee860351eacb18ce068d09cf498cedb3e18"} Jul 06 22:02:52.801423 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:02:52.801092 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm" Jul 06 22:02:52.822422 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:02:52.822364 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm" podStartSLOduration=1.125138277 podStartE2EDuration="2.822346517s" totalImagesPullingTime="1.69720824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:02:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:02:52.821066516 +0000 UTC m=+5275.238315947" watchObservedRunningTime="2026-07-06 22:02:52.822346517 +0000 UTC m=+5275.239595946" Jul 06 22:03:23.790128 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:23.790049 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm"] Jul 06 22:03:23.791730 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:23.791683 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm" podUID="cf8f38e6-62c9-47f2-9010-c78540ae393d" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Jul 06 22:03:23.799317 ip-10-0-142-77 kubenswrapper[2562]: E0706 22:03:23.799282 2562 log.go:32] "ExecSync cmd from runtime service failed" err=< Jul 06 22:03:23.799317 ip-10-0-142-77 kubenswrapper[2562]: rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory Jul 06 22:03:23.799317 ip-10-0-142-77 kubenswrapper[2562]: , stdout: , stderr: , exit code -1 Jul 06 22:03:23.799317 ip-10-0-142-77 kubenswrapper[2562]: > containerID="d9c5bfe95d1f18dc360a4b2886b2cee860351eacb18ce068d09cf498cedb3e18" cmd=["/bin/sleep","15"] Jul 06 22:03:23.799547 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:23.799332 2562 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm" message="" err=< Jul 06 22:03:23.799547 ip-10-0-142-77 kubenswrapper[2562]: rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory Jul 06 22:03:23.799547 ip-10-0-142-77 kubenswrapper[2562]: , stdout: , stderr: , exit code -1 Jul 06 22:03:23.799547 ip-10-0-142-77 kubenswrapper[2562]: > Jul 06 22:03:23.799547 ip-10-0-142-77 kubenswrapper[2562]: E0706 22:03:23.799345 2562 kuberuntime_container.go:754] "PreStop hook failed" err=< Jul 06 22:03:23.799547 ip-10-0-142-77 kubenswrapper[2562]: rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory Jul 06 22:03:23.799547 ip-10-0-142-77 kubenswrapper[2562]: , stdout: , stderr: , exit code -1 Jul 06 22:03:23.799547 ip-10-0-142-77 kubenswrapper[2562]: > pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm" podUID="cf8f38e6-62c9-47f2-9010-c78540ae393d" containerName="main" containerID="cri-o://d9c5bfe95d1f18dc360a4b2886b2cee860351eacb18ce068d09cf498cedb3e18" Jul 06 22:03:23.799547 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:23.799395 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm" podUID="cf8f38e6-62c9-47f2-9010-c78540ae393d" containerName="main" containerID="cri-o://d9c5bfe95d1f18dc360a4b2886b2cee860351eacb18ce068d09cf498cedb3e18" gracePeriod=60 Jul 06 22:03:23.935662 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:23.935624 2562 generic.go:356] "Generic (PLEG): container finished" podID="cf8f38e6-62c9-47f2-9010-c78540ae393d" containerID="d9c5bfe95d1f18dc360a4b2886b2cee860351eacb18ce068d09cf498cedb3e18" exitCode=0 Jul 06 22:03:23.935816 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:23.935672 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm" event={"ID":"cf8f38e6-62c9-47f2-9010-c78540ae393d","Type":"ContainerDied","Data":"d9c5bfe95d1f18dc360a4b2886b2cee860351eacb18ce068d09cf498cedb3e18"} Jul 06 22:03:24.048814 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:24.048746 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm" Jul 06 22:03:24.160299 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:24.160264 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hw8s\" (UniqueName: \"kubernetes.io/projected/cf8f38e6-62c9-47f2-9010-c78540ae393d-kube-api-access-8hw8s\") pod \"cf8f38e6-62c9-47f2-9010-c78540ae393d\" (UID: \"cf8f38e6-62c9-47f2-9010-c78540ae393d\") " Jul 06 22:03:24.160472 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:24.160326 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/cf8f38e6-62c9-47f2-9010-c78540ae393d-tokenizer-uds\") pod \"cf8f38e6-62c9-47f2-9010-c78540ae393d\" (UID: \"cf8f38e6-62c9-47f2-9010-c78540ae393d\") " Jul 06 22:03:24.160472 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:24.160427 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf8f38e6-62c9-47f2-9010-c78540ae393d-tls-certs\") pod \"cf8f38e6-62c9-47f2-9010-c78540ae393d\" (UID: \"cf8f38e6-62c9-47f2-9010-c78540ae393d\") " Jul 06 22:03:24.160614 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:24.160592 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf8f38e6-62c9-47f2-9010-c78540ae393d-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "cf8f38e6-62c9-47f2-9010-c78540ae393d" (UID: "cf8f38e6-62c9-47f2-9010-c78540ae393d"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:03:24.160690 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:24.160674 2562 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/cf8f38e6-62c9-47f2-9010-c78540ae393d-tokenizer-uds\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 22:03:24.162457 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:24.162420 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf8f38e6-62c9-47f2-9010-c78540ae393d-kube-api-access-8hw8s" (OuterVolumeSpecName: "kube-api-access-8hw8s") pod "cf8f38e6-62c9-47f2-9010-c78540ae393d" (UID: "cf8f38e6-62c9-47f2-9010-c78540ae393d"). InnerVolumeSpecName "kube-api-access-8hw8s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:03:24.162573 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:24.162465 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf8f38e6-62c9-47f2-9010-c78540ae393d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cf8f38e6-62c9-47f2-9010-c78540ae393d" (UID: "cf8f38e6-62c9-47f2-9010-c78540ae393d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:03:24.261221 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:24.261183 2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf8f38e6-62c9-47f2-9010-c78540ae393d-tls-certs\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 22:03:24.261221 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:24.261213 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hw8s\" (UniqueName: \"kubernetes.io/projected/cf8f38e6-62c9-47f2-9010-c78540ae393d-kube-api-access-8hw8s\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 22:03:24.941640 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:24.941595 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm" event={"ID":"cf8f38e6-62c9-47f2-9010-c78540ae393d","Type":"ContainerDied","Data":"95f9dc2189f2a70d31335a7afb8436cfc16c682dd316300d23b6d840d9a631d3"} Jul 06 22:03:24.942100 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:24.941653 2562 scope.go:117] "RemoveContainer" containerID="d9c5bfe95d1f18dc360a4b2886b2cee860351eacb18ce068d09cf498cedb3e18" Jul 06 22:03:24.942100 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:24.941609 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm" Jul 06 22:03:24.967137 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:24.967104 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm"] Jul 06 22:03:24.971633 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:24.971606 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dl5nhm"] Jul 06 22:03:26.098198 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:26.098166 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf8f38e6-62c9-47f2-9010-c78540ae393d" path="/var/lib/kubelet/pods/cf8f38e6-62c9-47f2-9010-c78540ae393d/volumes" Jul 06 22:03:55.877110 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:55.877067 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq"] Jul 06 22:03:55.877735 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:55.877361 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf8f38e6-62c9-47f2-9010-c78540ae393d" containerName="main" Jul 06 22:03:55.877735 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:55.877372 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf8f38e6-62c9-47f2-9010-c78540ae393d" containerName="main" Jul 06 22:03:55.877735 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:55.877423 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf8f38e6-62c9-47f2-9010-c78540ae393d" containerName="main" Jul 06 22:03:55.880567 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:55.880539 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" Jul 06 22:03:55.883780 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:55.883755 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 06 22:03:55.885188 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:55.884897 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Jul 06 22:03:55.885188 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:55.884945 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-v06-threshold-migration-test-kserve-dockercfg-c79tf\"" Jul 06 22:03:55.885188 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:55.884989 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-v06-threshold-migration-test-kserve-self-signed-certs\"" Jul 06 22:03:55.885188 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:55.885082 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-6qcsh\"" Jul 06 22:03:55.897685 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:55.897653 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq"] Jul 06 22:03:56.023111 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:56.023063 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39acd84f-94b9-431d-b725-ca9c21493b7a-home\") pod \"scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq\" (UID: \"39acd84f-94b9-431d-b725-ca9c21493b7a\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" Jul 06 22:03:56.023111 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:56.023130 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39acd84f-94b9-431d-b725-ca9c21493b7a-dshm\") pod \"scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq\" (UID: \"39acd84f-94b9-431d-b725-ca9c21493b7a\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" Jul 06 22:03:56.023461 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:56.023210 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62w6m\" (UniqueName: \"kubernetes.io/projected/39acd84f-94b9-431d-b725-ca9c21493b7a-kube-api-access-62w6m\") pod \"scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq\" (UID: \"39acd84f-94b9-431d-b725-ca9c21493b7a\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" Jul 06 22:03:56.023461 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:56.023278 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39acd84f-94b9-431d-b725-ca9c21493b7a-model-cache\") pod \"scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq\" (UID: \"39acd84f-94b9-431d-b725-ca9c21493b7a\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" Jul 06 22:03:56.023461 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:56.023316 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39acd84f-94b9-431d-b725-ca9c21493b7a-tls-certs\") pod \"scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq\" (UID: \"39acd84f-94b9-431d-b725-ca9c21493b7a\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" Jul 06 22:03:56.023461 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:56.023356 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39acd84f-94b9-431d-b725-ca9c21493b7a-tmp-dir\") pod \"scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq\" (UID: \"39acd84f-94b9-431d-b725-ca9c21493b7a\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" Jul 06 22:03:56.124314 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:56.124272 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39acd84f-94b9-431d-b725-ca9c21493b7a-tmp-dir\") pod \"scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq\" (UID: \"39acd84f-94b9-431d-b725-ca9c21493b7a\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" Jul 06 22:03:56.124314 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:56.124318 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39acd84f-94b9-431d-b725-ca9c21493b7a-home\") pod \"scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq\" (UID: \"39acd84f-94b9-431d-b725-ca9c21493b7a\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" Jul 06 22:03:56.124581 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:56.124451 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39acd84f-94b9-431d-b725-ca9c21493b7a-dshm\") pod \"scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq\" (UID: \"39acd84f-94b9-431d-b725-ca9c21493b7a\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" Jul 06 22:03:56.124581 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:56.124526 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62w6m\" (UniqueName: \"kubernetes.io/projected/39acd84f-94b9-431d-b725-ca9c21493b7a-kube-api-access-62w6m\") pod \"scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq\" (UID: \"39acd84f-94b9-431d-b725-ca9c21493b7a\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" Jul 06 22:03:56.124693 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:56.124578 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39acd84f-94b9-431d-b725-ca9c21493b7a-model-cache\") pod \"scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq\" (UID: \"39acd84f-94b9-431d-b725-ca9c21493b7a\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" Jul 06 22:03:56.124693 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:56.124614 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39acd84f-94b9-431d-b725-ca9c21493b7a-tls-certs\") pod \"scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq\" (UID: \"39acd84f-94b9-431d-b725-ca9c21493b7a\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" Jul 06 22:03:56.124693 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:56.124648 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39acd84f-94b9-431d-b725-ca9c21493b7a-home\") pod \"scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq\" (UID: \"39acd84f-94b9-431d-b725-ca9c21493b7a\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" Jul 06 22:03:56.124837 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:56.124688 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39acd84f-94b9-431d-b725-ca9c21493b7a-tmp-dir\") pod \"scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq\" (UID: \"39acd84f-94b9-431d-b725-ca9c21493b7a\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" Jul 06 22:03:56.124923 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:56.124857 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39acd84f-94b9-431d-b725-ca9c21493b7a-model-cache\") pod \"scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq\" (UID: \"39acd84f-94b9-431d-b725-ca9c21493b7a\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" Jul 06 22:03:56.126585 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:56.126567 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39acd84f-94b9-431d-b725-ca9c21493b7a-dshm\") pod \"scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq\" (UID: \"39acd84f-94b9-431d-b725-ca9c21493b7a\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" Jul 06 22:03:56.126969 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:56.126950 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39acd84f-94b9-431d-b725-ca9c21493b7a-tls-certs\") pod \"scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq\" (UID: \"39acd84f-94b9-431d-b725-ca9c21493b7a\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" Jul 06 22:03:56.135094 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:56.135033 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62w6m\" (UniqueName: \"kubernetes.io/projected/39acd84f-94b9-431d-b725-ca9c21493b7a-kube-api-access-62w6m\") pod \"scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq\" (UID: \"39acd84f-94b9-431d-b725-ca9c21493b7a\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" Jul 06 22:03:56.190834 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:56.190792 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" Jul 06 22:03:56.358282 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:56.358255 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq"] Jul 06 22:03:56.360873 ip-10-0-142-77 kubenswrapper[2562]: W0706 22:03:56.360843 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39acd84f_94b9_431d_b725_ca9c21493b7a.slice/crio-a123cb0efd40dba58a0a8b3efe2cdb9745948ea9626d9e29d168c675af5c7bdb WatchSource:0}: Error finding container a123cb0efd40dba58a0a8b3efe2cdb9745948ea9626d9e29d168c675af5c7bdb: Status 404 returned error can't find the container with id a123cb0efd40dba58a0a8b3efe2cdb9745948ea9626d9e29d168c675af5c7bdb Jul 06 22:03:57.074509 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:57.074475 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" event={"ID":"39acd84f-94b9-431d-b725-ca9c21493b7a","Type":"ContainerStarted","Data":"a123cb0efd40dba58a0a8b3efe2cdb9745948ea9626d9e29d168c675af5c7bdb"} Jul 06 22:03:58.080695 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:58.080654 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" event={"ID":"39acd84f-94b9-431d-b725-ca9c21493b7a","Type":"ContainerStarted","Data":"9573d65cfeb4e69ede04df23863cd9ec97514124098c89dc4fbff3e313c7a9a4"} Jul 06 22:03:58.081170 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:58.080781 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" Jul 06 22:03:59.086854 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:59.086820 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" event={"ID":"39acd84f-94b9-431d-b725-ca9c21493b7a","Type":"ContainerStarted","Data":"5219e92c9a849d5551a92b831edd753893111a8065af396c5890406582365b2c"} Jul 06 22:03:59.109217 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:59.109159 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" podStartSLOduration=3.428431355 podStartE2EDuration="4.109143778s" totalImagesPullingTime="680.712423ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:03:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:03:59.108372223 +0000 UTC m=+5341.525621645" watchObservedRunningTime="2026-07-06 22:03:59.109143778 +0000 UTC m=+5341.526393207" Jul 06 22:03:59.191767 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:03:59.191729 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" Jul 06 22:04:06.191767 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:06.191724 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" Jul 06 22:04:06.204225 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:06.204193 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" Jul 06 22:04:07.132904 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:07.132860 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" Jul 06 22:04:07.134198 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:07.134169 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" Jul 06 22:04:29.838242 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:29.838207 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq"] Jul 06 22:04:44.858578 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:44.858528 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" podUID="39acd84f-94b9-431d-b725-ca9c21493b7a" containerName="main" containerID="cri-o://5219e92c9a849d5551a92b831edd753893111a8065af396c5890406582365b2c" gracePeriod=45 Jul 06 22:04:44.975557 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:44.975519 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" podUID="39acd84f-94b9-431d-b725-ca9c21493b7a" containerName="llm-d-routing-sidecar" containerID="cri-o://9573d65cfeb4e69ede04df23863cd9ec97514124098c89dc4fbff3e313c7a9a4" gracePeriod=45 Jul 06 22:04:45.122289 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.122192 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" podUID="39acd84f-94b9-431d-b725-ca9c21493b7a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.28:8001/health\": dial tcp 10.133.0.28:8001: connect: connection refused" Jul 06 22:04:45.218700 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.218673 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" Jul 06 22:04:45.285927 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.285871 2562 generic.go:356] "Generic (PLEG): container finished" podID="39acd84f-94b9-431d-b725-ca9c21493b7a" containerID="5219e92c9a849d5551a92b831edd753893111a8065af396c5890406582365b2c" exitCode=0 Jul 06 22:04:45.285927 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.285920 2562 generic.go:356] "Generic (PLEG): container finished" podID="39acd84f-94b9-431d-b725-ca9c21493b7a" containerID="9573d65cfeb4e69ede04df23863cd9ec97514124098c89dc4fbff3e313c7a9a4" exitCode=0 Jul 06 22:04:45.286189 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.285952 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" event={"ID":"39acd84f-94b9-431d-b725-ca9c21493b7a","Type":"ContainerDied","Data":"5219e92c9a849d5551a92b831edd753893111a8065af396c5890406582365b2c"} Jul 06 22:04:45.286189 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.285955 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" Jul 06 22:04:45.286189 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.286003 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" event={"ID":"39acd84f-94b9-431d-b725-ca9c21493b7a","Type":"ContainerDied","Data":"9573d65cfeb4e69ede04df23863cd9ec97514124098c89dc4fbff3e313c7a9a4"} Jul 06 22:04:45.286189 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.286022 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq" event={"ID":"39acd84f-94b9-431d-b725-ca9c21493b7a","Type":"ContainerDied","Data":"a123cb0efd40dba58a0a8b3efe2cdb9745948ea9626d9e29d168c675af5c7bdb"} Jul 06 22:04:45.286189 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.286042 2562 scope.go:117] "RemoveContainer" containerID="5219e92c9a849d5551a92b831edd753893111a8065af396c5890406582365b2c" Jul 06 22:04:45.294242 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.294222 2562 scope.go:117] "RemoveContainer" containerID="9573d65cfeb4e69ede04df23863cd9ec97514124098c89dc4fbff3e313c7a9a4" Jul 06 22:04:45.302109 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.302088 2562 scope.go:117] "RemoveContainer" containerID="5219e92c9a849d5551a92b831edd753893111a8065af396c5890406582365b2c" Jul 06 22:04:45.302427 ip-10-0-142-77 kubenswrapper[2562]: E0706 22:04:45.302401 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5219e92c9a849d5551a92b831edd753893111a8065af396c5890406582365b2c\": container with ID starting with 5219e92c9a849d5551a92b831edd753893111a8065af396c5890406582365b2c not found: ID does not exist" containerID="5219e92c9a849d5551a92b831edd753893111a8065af396c5890406582365b2c" Jul 06 22:04:45.302543 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.302436 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5219e92c9a849d5551a92b831edd753893111a8065af396c5890406582365b2c"} err="failed to get container status \"5219e92c9a849d5551a92b831edd753893111a8065af396c5890406582365b2c\": rpc error: code = NotFound desc = could not find container \"5219e92c9a849d5551a92b831edd753893111a8065af396c5890406582365b2c\": container with ID starting with 5219e92c9a849d5551a92b831edd753893111a8065af396c5890406582365b2c not found: ID does not exist" Jul 06 22:04:45.302543 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.302455 2562 scope.go:117] "RemoveContainer" containerID="9573d65cfeb4e69ede04df23863cd9ec97514124098c89dc4fbff3e313c7a9a4" Jul 06 22:04:45.302711 ip-10-0-142-77 kubenswrapper[2562]: E0706 22:04:45.302691 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9573d65cfeb4e69ede04df23863cd9ec97514124098c89dc4fbff3e313c7a9a4\": container with ID starting with 9573d65cfeb4e69ede04df23863cd9ec97514124098c89dc4fbff3e313c7a9a4 not found: ID does not exist" containerID="9573d65cfeb4e69ede04df23863cd9ec97514124098c89dc4fbff3e313c7a9a4" Jul 06 22:04:45.302773 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.302720 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9573d65cfeb4e69ede04df23863cd9ec97514124098c89dc4fbff3e313c7a9a4"} err="failed to get container status \"9573d65cfeb4e69ede04df23863cd9ec97514124098c89dc4fbff3e313c7a9a4\": rpc error: code = NotFound desc = could not find container \"9573d65cfeb4e69ede04df23863cd9ec97514124098c89dc4fbff3e313c7a9a4\": container with ID starting with 9573d65cfeb4e69ede04df23863cd9ec97514124098c89dc4fbff3e313c7a9a4 not found: ID does not exist" Jul 06 22:04:45.302773 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.302745 2562 scope.go:117] "RemoveContainer" containerID="5219e92c9a849d5551a92b831edd753893111a8065af396c5890406582365b2c" Jul 06 22:04:45.303041 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.303020 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5219e92c9a849d5551a92b831edd753893111a8065af396c5890406582365b2c"} err="failed to get container status \"5219e92c9a849d5551a92b831edd753893111a8065af396c5890406582365b2c\": rpc error: code = NotFound desc = could not find container \"5219e92c9a849d5551a92b831edd753893111a8065af396c5890406582365b2c\": container with ID starting with 5219e92c9a849d5551a92b831edd753893111a8065af396c5890406582365b2c not found: ID does not exist" Jul 06 22:04:45.303109 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.303042 2562 scope.go:117] "RemoveContainer" containerID="9573d65cfeb4e69ede04df23863cd9ec97514124098c89dc4fbff3e313c7a9a4" Jul 06 22:04:45.303294 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.303276 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9573d65cfeb4e69ede04df23863cd9ec97514124098c89dc4fbff3e313c7a9a4"} err="failed to get container status \"9573d65cfeb4e69ede04df23863cd9ec97514124098c89dc4fbff3e313c7a9a4\": rpc error: code = NotFound desc = could not find container \"9573d65cfeb4e69ede04df23863cd9ec97514124098c89dc4fbff3e313c7a9a4\": container with ID starting with 9573d65cfeb4e69ede04df23863cd9ec97514124098c89dc4fbff3e313c7a9a4 not found: ID does not exist" Jul 06 22:04:45.317142 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.317108 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39acd84f-94b9-431d-b725-ca9c21493b7a-model-cache\") pod \"39acd84f-94b9-431d-b725-ca9c21493b7a\" (UID: \"39acd84f-94b9-431d-b725-ca9c21493b7a\") " Jul 06 22:04:45.317288 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.317160 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39acd84f-94b9-431d-b725-ca9c21493b7a-home\") pod \"39acd84f-94b9-431d-b725-ca9c21493b7a\" (UID: \"39acd84f-94b9-431d-b725-ca9c21493b7a\") " Jul 06 22:04:45.317288 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.317203 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39acd84f-94b9-431d-b725-ca9c21493b7a-dshm\") pod \"39acd84f-94b9-431d-b725-ca9c21493b7a\" (UID: \"39acd84f-94b9-431d-b725-ca9c21493b7a\") " Jul 06 22:04:45.317288 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.317230 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39acd84f-94b9-431d-b725-ca9c21493b7a-tmp-dir\") pod \"39acd84f-94b9-431d-b725-ca9c21493b7a\" (UID: \"39acd84f-94b9-431d-b725-ca9c21493b7a\") " Jul 06 22:04:45.317288 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.317280 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62w6m\" (UniqueName: \"kubernetes.io/projected/39acd84f-94b9-431d-b725-ca9c21493b7a-kube-api-access-62w6m\") pod \"39acd84f-94b9-431d-b725-ca9c21493b7a\" (UID: \"39acd84f-94b9-431d-b725-ca9c21493b7a\") " Jul 06 22:04:45.317430 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.317304 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39acd84f-94b9-431d-b725-ca9c21493b7a-tls-certs\") pod \"39acd84f-94b9-431d-b725-ca9c21493b7a\" (UID: \"39acd84f-94b9-431d-b725-ca9c21493b7a\") " Jul 06 22:04:45.317480 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.317436 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39acd84f-94b9-431d-b725-ca9c21493b7a-model-cache" (OuterVolumeSpecName: "model-cache") pod "39acd84f-94b9-431d-b725-ca9c21493b7a" (UID: "39acd84f-94b9-431d-b725-ca9c21493b7a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:04:45.317551 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.317520 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39acd84f-94b9-431d-b725-ca9c21493b7a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "39acd84f-94b9-431d-b725-ca9c21493b7a" (UID: "39acd84f-94b9-431d-b725-ca9c21493b7a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:04:45.317601 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.317529 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39acd84f-94b9-431d-b725-ca9c21493b7a-home" (OuterVolumeSpecName: "home") pod "39acd84f-94b9-431d-b725-ca9c21493b7a" (UID: "39acd84f-94b9-431d-b725-ca9c21493b7a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:04:45.317601 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.317563 2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39acd84f-94b9-431d-b725-ca9c21493b7a-model-cache\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 22:04:45.319378 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.319347 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39acd84f-94b9-431d-b725-ca9c21493b7a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "39acd84f-94b9-431d-b725-ca9c21493b7a" (UID: "39acd84f-94b9-431d-b725-ca9c21493b7a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:04:45.319519 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.319377 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39acd84f-94b9-431d-b725-ca9c21493b7a-dshm" (OuterVolumeSpecName: "dshm") pod "39acd84f-94b9-431d-b725-ca9c21493b7a" (UID: "39acd84f-94b9-431d-b725-ca9c21493b7a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:04:45.319519 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.319464 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39acd84f-94b9-431d-b725-ca9c21493b7a-kube-api-access-62w6m" (OuterVolumeSpecName: "kube-api-access-62w6m") pod "39acd84f-94b9-431d-b725-ca9c21493b7a" (UID: "39acd84f-94b9-431d-b725-ca9c21493b7a"). InnerVolumeSpecName "kube-api-access-62w6m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:04:45.418240 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.418196 2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39acd84f-94b9-431d-b725-ca9c21493b7a-dshm\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 22:04:45.418240 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.418240 2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39acd84f-94b9-431d-b725-ca9c21493b7a-tmp-dir\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 22:04:45.418240 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.418253 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62w6m\" (UniqueName: \"kubernetes.io/projected/39acd84f-94b9-431d-b725-ca9c21493b7a-kube-api-access-62w6m\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 22:04:45.418474 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.418265 2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39acd84f-94b9-431d-b725-ca9c21493b7a-tls-certs\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 22:04:45.418474 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.418274 2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39acd84f-94b9-431d-b725-ca9c21493b7a-home\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 22:04:45.607664 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.607626 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq"] Jul 06 22:04:45.611344 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:45.611316 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-f4slq"] Jul 06 22:04:46.098530 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:46.098489 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39acd84f-94b9-431d-b725-ca9c21493b7a" path="/var/lib/kubelet/pods/39acd84f-94b9-431d-b725-ca9c21493b7a/volumes" Jul 06 22:04:58.359866 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:58.359746 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 22:04:58.368747 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:04:58.368726 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 22:05:58.523420 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:05:58.523384 2562 scope.go:117] "RemoveContainer" containerID="656f1fc53c02905050176e3a4389289de9943ae18a3a6cf52a07db58cfc4bb1e" Jul 06 22:09:58.382054 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:09:58.382028 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 22:09:58.391492 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:09:58.391468 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 22:14:58.405596 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:14:58.405485 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 22:14:58.415068 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:14:58.415044 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 22:19:58.431552 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:19:58.431430 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 22:19:58.440958 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:19:58.440936 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82n9w_1dedccb7-cae9-4846-9304-7abe0812a0a2/ovn-acl-logging/0.log" Jul 06 22:22:49.112537 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:22:49.112502 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b5t69/must-gather-jb7l7"] Jul 06 22:22:49.113067 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:22:49.112783 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39acd84f-94b9-431d-b725-ca9c21493b7a" containerName="llm-d-routing-sidecar" Jul 06 22:22:49.113067 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:22:49.112793 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="39acd84f-94b9-431d-b725-ca9c21493b7a" containerName="llm-d-routing-sidecar" Jul 06 22:22:49.113067 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:22:49.112811 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39acd84f-94b9-431d-b725-ca9c21493b7a" containerName="main" Jul 06 22:22:49.113067 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:22:49.112817 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="39acd84f-94b9-431d-b725-ca9c21493b7a" containerName="main" Jul 06 22:22:49.113067 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:22:49.112863 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="39acd84f-94b9-431d-b725-ca9c21493b7a" containerName="main" Jul 06 22:22:49.113067 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:22:49.112872 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="39acd84f-94b9-431d-b725-ca9c21493b7a" containerName="llm-d-routing-sidecar" Jul 06 22:22:49.115736 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:22:49.115718 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b5t69/must-gather-jb7l7" Jul 06 22:22:49.118677 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:22:49.118652 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b5t69\"/\"kube-root-ca.crt\"" Jul 06 22:22:49.118677 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:22:49.118667 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b5t69\"/\"openshift-service-ca.crt\"" Jul 06 22:22:49.185597 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:22:49.185517 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b5t69/must-gather-jb7l7"] Jul 06 22:22:49.269195 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:22:49.269155 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtjrg\" (UniqueName: \"kubernetes.io/projected/69fc70fb-f638-4574-9d4e-5d9747cf6c6f-kube-api-access-wtjrg\") pod \"must-gather-jb7l7\" (UID: \"69fc70fb-f638-4574-9d4e-5d9747cf6c6f\") " pod="openshift-must-gather-b5t69/must-gather-jb7l7" Jul 06 22:22:49.269370 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:22:49.269219 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/69fc70fb-f638-4574-9d4e-5d9747cf6c6f-must-gather-output\") pod \"must-gather-jb7l7\" (UID: \"69fc70fb-f638-4574-9d4e-5d9747cf6c6f\") " pod="openshift-must-gather-b5t69/must-gather-jb7l7" Jul 06 22:22:49.370015 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:22:49.369914 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtjrg\" (UniqueName: \"kubernetes.io/projected/69fc70fb-f638-4574-9d4e-5d9747cf6c6f-kube-api-access-wtjrg\") pod \"must-gather-jb7l7\" (UID: \"69fc70fb-f638-4574-9d4e-5d9747cf6c6f\") " pod="openshift-must-gather-b5t69/must-gather-jb7l7" Jul 06 22:22:49.370015 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:22:49.369975 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/69fc70fb-f638-4574-9d4e-5d9747cf6c6f-must-gather-output\") pod \"must-gather-jb7l7\" (UID: \"69fc70fb-f638-4574-9d4e-5d9747cf6c6f\") " pod="openshift-must-gather-b5t69/must-gather-jb7l7" Jul 06 22:22:49.370353 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:22:49.370326 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/69fc70fb-f638-4574-9d4e-5d9747cf6c6f-must-gather-output\") pod \"must-gather-jb7l7\" (UID: \"69fc70fb-f638-4574-9d4e-5d9747cf6c6f\") " pod="openshift-must-gather-b5t69/must-gather-jb7l7" Jul 06 22:22:49.379690 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:22:49.379661 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtjrg\" (UniqueName: \"kubernetes.io/projected/69fc70fb-f638-4574-9d4e-5d9747cf6c6f-kube-api-access-wtjrg\") pod \"must-gather-jb7l7\" (UID: \"69fc70fb-f638-4574-9d4e-5d9747cf6c6f\") " pod="openshift-must-gather-b5t69/must-gather-jb7l7" Jul 06 22:22:49.425513 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:22:49.425475 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b5t69/must-gather-jb7l7" Jul 06 22:22:49.559130 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:22:49.559097 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b5t69/must-gather-jb7l7"] Jul 06 22:22:49.561750 ip-10-0-142-77 kubenswrapper[2562]: W0706 22:22:49.561719 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69fc70fb_f638_4574_9d4e_5d9747cf6c6f.slice/crio-5564c36cc7511336650add790cfd155dc2643300f28a5fbb4855c96d923438d2 WatchSource:0}: Error finding container 5564c36cc7511336650add790cfd155dc2643300f28a5fbb4855c96d923438d2: Status 404 returned error can't find the container with id 5564c36cc7511336650add790cfd155dc2643300f28a5fbb4855c96d923438d2 Jul 06 22:22:49.563330 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:22:49.563312 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 22:22:49.752466 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:22:49.752428 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b5t69/must-gather-jb7l7" event={"ID":"69fc70fb-f638-4574-9d4e-5d9747cf6c6f","Type":"ContainerStarted","Data":"5564c36cc7511336650add790cfd155dc2643300f28a5fbb4855c96d923438d2"} Jul 06 22:22:56.790475 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:22:56.790431 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b5t69/must-gather-jb7l7" event={"ID":"69fc70fb-f638-4574-9d4e-5d9747cf6c6f","Type":"ContainerStarted","Data":"c7e5e03f8e0339560d1ef71a6a365e6e59856c45b77eb6becbd5a156c2873911"} Jul 06 22:22:56.790940 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:22:56.790592 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b5t69/must-gather-jb7l7" event={"ID":"69fc70fb-f638-4574-9d4e-5d9747cf6c6f","Type":"ContainerStarted","Data":"9f013e788a3c3337f06d384ba9ac330d2c95b90eb10785ce7232407dc7bc000f"} Jul 06 22:22:56.814988 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:22:56.814917 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-b5t69/must-gather-jb7l7" podStartSLOduration=1.708985641 podStartE2EDuration="7.814871362s" totalImagesPullingTime="6.105885721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:22:56.812564311 +0000 UTC m=+6479.229813740" watchObservedRunningTime="2026-07-06 22:22:56.814871362 +0000 UTC m=+6479.232120793" Jul 06 22:23:31.516975 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:23:31.516935 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zmx9k_58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab/discovery/0.log" Jul 06 22:23:33.588396 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:23:33.588363 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zmx9k_58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab/discovery/0.log" Jul 06 22:23:35.703858 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:23:35.703824 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zmx9k_58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab/discovery/0.log" Jul 06 22:23:37.783652 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:23:37.783598 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zmx9k_58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab/discovery/0.log" Jul 06 22:23:54.060788 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:23:54.060743 2562 generic.go:356] "Generic (PLEG): container finished" podID="69fc70fb-f638-4574-9d4e-5d9747cf6c6f" containerID="c7e5e03f8e0339560d1ef71a6a365e6e59856c45b77eb6becbd5a156c2873911" exitCode=0 Jul 06 22:23:54.061222 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:23:54.060821 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b5t69/must-gather-jb7l7" event={"ID":"69fc70fb-f638-4574-9d4e-5d9747cf6c6f","Type":"ContainerDied","Data":"c7e5e03f8e0339560d1ef71a6a365e6e59856c45b77eb6becbd5a156c2873911"} Jul 06 22:23:54.061222 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:23:54.061192 2562 scope.go:117] "RemoveContainer" containerID="c7e5e03f8e0339560d1ef71a6a365e6e59856c45b77eb6becbd5a156c2873911" Jul 06 22:23:54.186369 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:23:54.186337 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-b5t69_must-gather-jb7l7_69fc70fb-f638-4574-9d4e-5d9747cf6c6f/gather/0.log" Jul 06 22:23:55.089493 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:23:55.089462 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8hm2m/must-gather-8t4g8"] Jul 06 22:23:55.094111 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:23:55.094090 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8hm2m/must-gather-8t4g8" Jul 06 22:23:55.098971 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:23:55.098947 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8hm2m\"/\"default-dockercfg-k7bqq\"" Jul 06 22:23:55.099128 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:23:55.098948 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8hm2m\"/\"kube-root-ca.crt\"" Jul 06 22:23:55.099854 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:23:55.099834 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8hm2m\"/\"openshift-service-ca.crt\"" Jul 06 22:23:55.106264 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:23:55.106236 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8hm2m/must-gather-8t4g8"] Jul 06 22:23:55.119104 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:23:55.119072 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3eda6f56-b6d8-47ef-b2ae-04621026665c-must-gather-output\") pod \"must-gather-8t4g8\" (UID: \"3eda6f56-b6d8-47ef-b2ae-04621026665c\") " pod="openshift-must-gather-8hm2m/must-gather-8t4g8" Jul 06 22:23:55.119104 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:23:55.119112 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn9sn\" (UniqueName: \"kubernetes.io/projected/3eda6f56-b6d8-47ef-b2ae-04621026665c-kube-api-access-jn9sn\") pod \"must-gather-8t4g8\" (UID: \"3eda6f56-b6d8-47ef-b2ae-04621026665c\") " pod="openshift-must-gather-8hm2m/must-gather-8t4g8" Jul 06 22:23:55.219667 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:23:55.219626 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3eda6f56-b6d8-47ef-b2ae-04621026665c-must-gather-output\") pod \"must-gather-8t4g8\" (UID: \"3eda6f56-b6d8-47ef-b2ae-04621026665c\") " pod="openshift-must-gather-8hm2m/must-gather-8t4g8" Jul 06 22:23:55.219667 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:23:55.219674 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn9sn\" (UniqueName: \"kubernetes.io/projected/3eda6f56-b6d8-47ef-b2ae-04621026665c-kube-api-access-jn9sn\") pod \"must-gather-8t4g8\" (UID: \"3eda6f56-b6d8-47ef-b2ae-04621026665c\") " pod="openshift-must-gather-8hm2m/must-gather-8t4g8" Jul 06 22:23:55.220041 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:23:55.220021 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3eda6f56-b6d8-47ef-b2ae-04621026665c-must-gather-output\") pod \"must-gather-8t4g8\" (UID: \"3eda6f56-b6d8-47ef-b2ae-04621026665c\") " pod="openshift-must-gather-8hm2m/must-gather-8t4g8" Jul 06 22:23:55.230955 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:23:55.230923 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn9sn\" (UniqueName: \"kubernetes.io/projected/3eda6f56-b6d8-47ef-b2ae-04621026665c-kube-api-access-jn9sn\") pod \"must-gather-8t4g8\" (UID: \"3eda6f56-b6d8-47ef-b2ae-04621026665c\") " pod="openshift-must-gather-8hm2m/must-gather-8t4g8" Jul 06 22:23:55.404070 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:23:55.404030 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8hm2m/must-gather-8t4g8" Jul 06 22:23:55.542841 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:23:55.542815 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8hm2m/must-gather-8t4g8"] Jul 06 22:23:55.544558 ip-10-0-142-77 kubenswrapper[2562]: W0706 22:23:55.544533 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3eda6f56_b6d8_47ef_b2ae_04621026665c.slice/crio-93fc40f33348194b48b55f6c523dddbd001810945c902ffb7b0ad703785dc410 WatchSource:0}: Error finding container 93fc40f33348194b48b55f6c523dddbd001810945c902ffb7b0ad703785dc410: Status 404 returned error can't find the container with id 93fc40f33348194b48b55f6c523dddbd001810945c902ffb7b0ad703785dc410 Jul 06 22:23:56.071110 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:23:56.071067 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8hm2m/must-gather-8t4g8" event={"ID":"3eda6f56-b6d8-47ef-b2ae-04621026665c","Type":"ContainerStarted","Data":"93fc40f33348194b48b55f6c523dddbd001810945c902ffb7b0ad703785dc410"} Jul 06 22:23:57.079059 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:23:57.078748 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8hm2m/must-gather-8t4g8" event={"ID":"3eda6f56-b6d8-47ef-b2ae-04621026665c","Type":"ContainerStarted","Data":"e04d79b4a3a121aaee8ac13df89423a450a5a3c6299f3f41a19945a22345196c"} Jul 06 22:23:57.079059 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:23:57.078805 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8hm2m/must-gather-8t4g8" event={"ID":"3eda6f56-b6d8-47ef-b2ae-04621026665c","Type":"ContainerStarted","Data":"1d411e4364961b4f94d0864c9c4354531f9a113e6d7ecdd65144319e37efab3a"} Jul 06 22:23:57.099552 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:23:57.099476 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8hm2m/must-gather-8t4g8" podStartSLOduration=1.198568428 podStartE2EDuration="2.099452021s" totalImagesPullingTime="900.883593ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:23:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:23:57.099302287 +0000 UTC m=+6539.516551717" watchObservedRunningTime="2026-07-06 22:23:57.099452021 +0000 UTC m=+6539.516701451" Jul 06 22:23:58.172664 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:23:58.172630 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4r7cf_872de884-2edf-4de9-8ad6-2bc963363808/global-pull-secret-syncer/0.log" Jul 06 22:23:58.354640 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:23:58.354591 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-n6892_691b55fa-75bc-4b9a-9e24-2df1c444470f/konnectivity-agent/0.log" Jul 06 22:23:58.485597 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:23:58.485493 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-77.ec2.internal_915ab3f22472460b3ca3a702c37324c2/haproxy/0.log" Jul 06 22:23:59.923592 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:23:59.923548 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-b5t69/must-gather-jb7l7"] Jul 06 22:23:59.924101 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:23:59.923852 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-b5t69/must-gather-jb7l7" podUID="69fc70fb-f638-4574-9d4e-5d9747cf6c6f" containerName="copy" containerID="cri-o://9f013e788a3c3337f06d384ba9ac330d2c95b90eb10785ce7232407dc7bc000f" gracePeriod=2 Jul 06 22:23:59.926467 ip-10-0-142-77 kubenswrapper[2562]: E0706 22:23:59.926414 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-jb7l7\" is forbidden: User \"system:node:ip-10-0-142-77.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-b5t69\": no relationship found between node 'ip-10-0-142-77.ec2.internal' and this object" podUID="69fc70fb-f638-4574-9d4e-5d9747cf6c6f" pod="openshift-must-gather-b5t69/must-gather-jb7l7" Jul 06 22:23:59.927104 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:23:59.927081 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-b5t69/must-gather-jb7l7"] Jul 06 22:24:00.109900 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:00.108951 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-b5t69_must-gather-jb7l7_69fc70fb-f638-4574-9d4e-5d9747cf6c6f/copy/0.log" Jul 06 22:24:00.109900 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:00.109461 2562 generic.go:356] "Generic (PLEG): container finished" podID="69fc70fb-f638-4574-9d4e-5d9747cf6c6f" containerID="9f013e788a3c3337f06d384ba9ac330d2c95b90eb10785ce7232407dc7bc000f" exitCode=143 Jul 06 22:24:00.314901 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:00.314548 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-b5t69_must-gather-jb7l7_69fc70fb-f638-4574-9d4e-5d9747cf6c6f/copy/0.log" Jul 06 22:24:00.318786 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:00.317786 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b5t69/must-gather-jb7l7" Jul 06 22:24:00.483397 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:00.483298 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtjrg\" (UniqueName: \"kubernetes.io/projected/69fc70fb-f638-4574-9d4e-5d9747cf6c6f-kube-api-access-wtjrg\") pod \"69fc70fb-f638-4574-9d4e-5d9747cf6c6f\" (UID: \"69fc70fb-f638-4574-9d4e-5d9747cf6c6f\") " Jul 06 22:24:00.483397 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:00.483369 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/69fc70fb-f638-4574-9d4e-5d9747cf6c6f-must-gather-output\") pod \"69fc70fb-f638-4574-9d4e-5d9747cf6c6f\" (UID: \"69fc70fb-f638-4574-9d4e-5d9747cf6c6f\") " Jul 06 22:24:00.501496 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:00.496538 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69fc70fb-f638-4574-9d4e-5d9747cf6c6f-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "69fc70fb-f638-4574-9d4e-5d9747cf6c6f" (UID: "69fc70fb-f638-4574-9d4e-5d9747cf6c6f"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:24:00.508530 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:00.508488 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69fc70fb-f638-4574-9d4e-5d9747cf6c6f-kube-api-access-wtjrg" (OuterVolumeSpecName: "kube-api-access-wtjrg") pod "69fc70fb-f638-4574-9d4e-5d9747cf6c6f" (UID: "69fc70fb-f638-4574-9d4e-5d9747cf6c6f"). InnerVolumeSpecName "kube-api-access-wtjrg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:24:00.585044 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:00.584979 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtjrg\" (UniqueName: \"kubernetes.io/projected/69fc70fb-f638-4574-9d4e-5d9747cf6c6f-kube-api-access-wtjrg\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 22:24:00.585044 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:00.585016 2562 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/69fc70fb-f638-4574-9d4e-5d9747cf6c6f-must-gather-output\") on node \"ip-10-0-142-77.ec2.internal\" DevicePath \"\"" Jul 06 22:24:01.125928 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:01.117733 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-b5t69_must-gather-jb7l7_69fc70fb-f638-4574-9d4e-5d9747cf6c6f/copy/0.log" Jul 06 22:24:01.125928 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:01.118265 2562 scope.go:117] "RemoveContainer" containerID="9f013e788a3c3337f06d384ba9ac330d2c95b90eb10785ce7232407dc7bc000f" Jul 06 22:24:01.125928 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:01.118460 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b5t69/must-gather-jb7l7" Jul 06 22:24:01.145605 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:01.145483 2562 scope.go:117] "RemoveContainer" containerID="c7e5e03f8e0339560d1ef71a6a365e6e59856c45b77eb6becbd5a156c2873911" Jul 06 22:24:02.102897 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:02.102844 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69fc70fb-f638-4574-9d4e-5d9747cf6c6f" path="/var/lib/kubelet/pods/69fc70fb-f638-4574-9d4e-5d9747cf6c6f/volumes" Jul 06 22:24:05.055580 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:05.055531 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-85sm8_50196b0e-a0bc-4f0b-a51d-8e789a9a890d/cluster-monitoring-operator/0.log" Jul 06 22:24:05.401487 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:05.401456 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zl5tf_73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9/node-exporter/0.log" Jul 06 22:24:05.438272 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:05.438236 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zl5tf_73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9/kube-rbac-proxy/0.log" Jul 06 22:24:05.467056 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:05.467021 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zl5tf_73ee17a0-7dd3-4a84-acd1-7f81a9dac5e9/init-textfile/0.log" Jul 06 22:24:07.507018 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:07.506972 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-k76n2_2b324f54-aad4-4f39-b915-ed85edd3a3fa/networking-console-plugin/0.log" Jul 06 22:24:08.346539 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:08.346497 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8hm2m/perf-node-gather-daemonset-6pk4k"] Jul 06 22:24:08.346988 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:08.346961 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69fc70fb-f638-4574-9d4e-5d9747cf6c6f" containerName="copy" Jul 06 22:24:08.346988 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:08.346990 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="69fc70fb-f638-4574-9d4e-5d9747cf6c6f" containerName="copy" Jul 06 22:24:08.347179 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:08.347008 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69fc70fb-f638-4574-9d4e-5d9747cf6c6f" containerName="gather" Jul 06 22:24:08.347179 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:08.347016 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="69fc70fb-f638-4574-9d4e-5d9747cf6c6f" containerName="gather" Jul 06 22:24:08.347179 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:08.347102 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="69fc70fb-f638-4574-9d4e-5d9747cf6c6f" containerName="copy" Jul 06 22:24:08.347179 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:08.347113 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="69fc70fb-f638-4574-9d4e-5d9747cf6c6f" containerName="gather" Jul 06 22:24:08.351273 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:08.351248 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8hm2m/perf-node-gather-daemonset-6pk4k" Jul 06 22:24:08.358083 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:08.358051 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8hm2m/perf-node-gather-daemonset-6pk4k"] Jul 06 22:24:08.360676 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:08.360648 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/228a09ac-0800-43e3-b09f-548a6f1e76ca-podres\") pod \"perf-node-gather-daemonset-6pk4k\" (UID: \"228a09ac-0800-43e3-b09f-548a6f1e76ca\") " pod="openshift-must-gather-8hm2m/perf-node-gather-daemonset-6pk4k" Jul 06 22:24:08.360808 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:08.360713 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/228a09ac-0800-43e3-b09f-548a6f1e76ca-lib-modules\") pod \"perf-node-gather-daemonset-6pk4k\" (UID: \"228a09ac-0800-43e3-b09f-548a6f1e76ca\") " pod="openshift-must-gather-8hm2m/perf-node-gather-daemonset-6pk4k" Jul 06 22:24:08.360808 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:08.360752 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/228a09ac-0800-43e3-b09f-548a6f1e76ca-proc\") pod \"perf-node-gather-daemonset-6pk4k\" (UID: \"228a09ac-0800-43e3-b09f-548a6f1e76ca\") " pod="openshift-must-gather-8hm2m/perf-node-gather-daemonset-6pk4k" Jul 06 22:24:08.360808 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:08.360787 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66m6k\" (UniqueName: \"kubernetes.io/projected/228a09ac-0800-43e3-b09f-548a6f1e76ca-kube-api-access-66m6k\") pod \"perf-node-gather-daemonset-6pk4k\" (UID: \"228a09ac-0800-43e3-b09f-548a6f1e76ca\") " pod="openshift-must-gather-8hm2m/perf-node-gather-daemonset-6pk4k" Jul 06 22:24:08.361002 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:08.360821 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/228a09ac-0800-43e3-b09f-548a6f1e76ca-sys\") pod \"perf-node-gather-daemonset-6pk4k\" (UID: \"228a09ac-0800-43e3-b09f-548a6f1e76ca\") " pod="openshift-must-gather-8hm2m/perf-node-gather-daemonset-6pk4k" Jul 06 22:24:08.462429 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:08.462380 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/228a09ac-0800-43e3-b09f-548a6f1e76ca-podres\") pod \"perf-node-gather-daemonset-6pk4k\" (UID: \"228a09ac-0800-43e3-b09f-548a6f1e76ca\") " pod="openshift-must-gather-8hm2m/perf-node-gather-daemonset-6pk4k" Jul 06 22:24:08.462625 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:08.462455 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/228a09ac-0800-43e3-b09f-548a6f1e76ca-lib-modules\") pod \"perf-node-gather-daemonset-6pk4k\" (UID: \"228a09ac-0800-43e3-b09f-548a6f1e76ca\") " pod="openshift-must-gather-8hm2m/perf-node-gather-daemonset-6pk4k" Jul 06 22:24:08.462625 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:08.462493 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/228a09ac-0800-43e3-b09f-548a6f1e76ca-proc\") pod \"perf-node-gather-daemonset-6pk4k\" (UID: \"228a09ac-0800-43e3-b09f-548a6f1e76ca\") " pod="openshift-must-gather-8hm2m/perf-node-gather-daemonset-6pk4k" Jul 06 22:24:08.462625 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:08.462530 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66m6k\" (UniqueName: \"kubernetes.io/projected/228a09ac-0800-43e3-b09f-548a6f1e76ca-kube-api-access-66m6k\") pod \"perf-node-gather-daemonset-6pk4k\" (UID: \"228a09ac-0800-43e3-b09f-548a6f1e76ca\") " pod="openshift-must-gather-8hm2m/perf-node-gather-daemonset-6pk4k" Jul 06 22:24:08.462625 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:08.462557 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/228a09ac-0800-43e3-b09f-548a6f1e76ca-sys\") pod \"perf-node-gather-daemonset-6pk4k\" (UID: \"228a09ac-0800-43e3-b09f-548a6f1e76ca\") " pod="openshift-must-gather-8hm2m/perf-node-gather-daemonset-6pk4k" Jul 06 22:24:08.462625 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:08.462587 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/228a09ac-0800-43e3-b09f-548a6f1e76ca-podres\") pod \"perf-node-gather-daemonset-6pk4k\" (UID: \"228a09ac-0800-43e3-b09f-548a6f1e76ca\") " pod="openshift-must-gather-8hm2m/perf-node-gather-daemonset-6pk4k" Jul 06 22:24:08.463018 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:08.462665 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/228a09ac-0800-43e3-b09f-548a6f1e76ca-proc\") pod \"perf-node-gather-daemonset-6pk4k\" (UID: \"228a09ac-0800-43e3-b09f-548a6f1e76ca\") " pod="openshift-must-gather-8hm2m/perf-node-gather-daemonset-6pk4k" Jul 06 22:24:08.463018 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:08.462677 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/228a09ac-0800-43e3-b09f-548a6f1e76ca-sys\") pod \"perf-node-gather-daemonset-6pk4k\" (UID: \"228a09ac-0800-43e3-b09f-548a6f1e76ca\") " pod="openshift-must-gather-8hm2m/perf-node-gather-daemonset-6pk4k" Jul 06 22:24:08.463018 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:08.462753 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/228a09ac-0800-43e3-b09f-548a6f1e76ca-lib-modules\") pod \"perf-node-gather-daemonset-6pk4k\" (UID: \"228a09ac-0800-43e3-b09f-548a6f1e76ca\") " pod="openshift-must-gather-8hm2m/perf-node-gather-daemonset-6pk4k" Jul 06 22:24:08.472202 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:08.472166 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66m6k\" (UniqueName: \"kubernetes.io/projected/228a09ac-0800-43e3-b09f-548a6f1e76ca-kube-api-access-66m6k\") pod \"perf-node-gather-daemonset-6pk4k\" (UID: \"228a09ac-0800-43e3-b09f-548a6f1e76ca\") " pod="openshift-must-gather-8hm2m/perf-node-gather-daemonset-6pk4k" Jul 06 22:24:08.664590 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:08.664542 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8hm2m/perf-node-gather-daemonset-6pk4k" Jul 06 22:24:08.826755 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:08.826520 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8hm2m/perf-node-gather-daemonset-6pk4k"] Jul 06 22:24:08.829637 ip-10-0-142-77 kubenswrapper[2562]: W0706 22:24:08.829603 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod228a09ac_0800_43e3_b09f_548a6f1e76ca.slice/crio-a6c129669c29781ac06d7ad3229fbcd6263895df02741ab841bbbb46d520687f WatchSource:0}: Error finding container a6c129669c29781ac06d7ad3229fbcd6263895df02741ab841bbbb46d520687f: Status 404 returned error can't find the container with id a6c129669c29781ac06d7ad3229fbcd6263895df02741ab841bbbb46d520687f Jul 06 22:24:09.168990 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:09.168939 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8hm2m/perf-node-gather-daemonset-6pk4k" event={"ID":"228a09ac-0800-43e3-b09f-548a6f1e76ca","Type":"ContainerStarted","Data":"d0f9c63fd1b512ab3f74e7614fde6616bf9dc7899d0f2b48d4937f16e2aa01fd"} Jul 06 22:24:09.169206 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:09.169023 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8hm2m/perf-node-gather-daemonset-6pk4k" event={"ID":"228a09ac-0800-43e3-b09f-548a6f1e76ca","Type":"ContainerStarted","Data":"a6c129669c29781ac06d7ad3229fbcd6263895df02741ab841bbbb46d520687f"} Jul 06 22:24:09.169206 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:09.169088 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8hm2m/perf-node-gather-daemonset-6pk4k" Jul 06 22:24:09.188460 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:09.188400 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8hm2m/perf-node-gather-daemonset-6pk4k" podStartSLOduration=1.188379284 podStartE2EDuration="1.188379284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:24:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:24:09.186313483 +0000 UTC m=+6551.603562914" watchObservedRunningTime="2026-07-06 22:24:09.188379284 +0000 UTC m=+6551.605628713" Jul 06 22:24:10.184092 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:10.184061 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2p2vp_778034a9-e32b-4305-bdc7-885c6393fcba/dns/0.log" Jul 06 22:24:10.208312 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:10.208272 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2p2vp_778034a9-e32b-4305-bdc7-885c6393fcba/kube-rbac-proxy/0.log" Jul 06 22:24:10.338237 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:10.338198 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-228pr_37d7b196-af22-4df9-bb34-5b739bc05578/dns-node-resolver/0.log" Jul 06 22:24:11.083865 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:11.083833 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9627c_482c8ffc-6942-4433-988b-71ab836d0c4a/node-ca/0.log" Jul 06 22:24:13.192681 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:13.192626 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zmx9k_58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab/discovery/0.log" Jul 06 22:24:13.793062 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:13.793019 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lk74h_737b46c8-48bb-4732-858d-bec540223122/serve-healthcheck-canary/0.log" Jul 06 22:24:14.315253 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:14.315210 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-kjjpn_0f6cd921-5c67-4016-90a5-98c2ad891aa8/insights-operator/0.log" Jul 06 22:24:14.316951 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:14.316927 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-kjjpn_0f6cd921-5c67-4016-90a5-98c2ad891aa8/insights-operator/1.log" Jul 06 22:24:14.418533 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:14.418502 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cmkcf_e827580a-4554-4fca-88c6-91eacf3fe7e8/kube-rbac-proxy/0.log" Jul 06 22:24:14.441943 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:14.441915 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cmkcf_e827580a-4554-4fca-88c6-91eacf3fe7e8/exporter/0.log" Jul 06 22:24:14.465215 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:14.465183 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cmkcf_e827580a-4554-4fca-88c6-91eacf3fe7e8/extractor/0.log" Jul 06 22:24:15.184646 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:15.184618 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8hm2m/perf-node-gather-daemonset-6pk4k" Jul 06 22:24:17.748416 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:17.748329 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7845fd6587-tgmtj_d91ddef4-fcea-4a6c-afbb-7cb8e2faa4f1/manager/0.log" Jul 06 22:24:19.061667 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:19.061624 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-28mhv_8ace2ca9-3026-4fd7-b526-115fd975302c/seaweedfs/0.log" Jul 06 22:24:21.100298 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:21.100258 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zmx9k_58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab/discovery/0.log" Jul 06 22:24:23.198320 ip-10-0-142-77 kubenswrapper[2562]: I0706 22:24:23.198287 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zmx9k_58c5f93d-bb5c-4b9a-9fa9-56cb83e17cab/discovery/0.log"