Jul 02 13:43:04.254197 ip-10-0-136-90 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 02 13:43:04.254209 ip-10-0-136-90 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 02 13:43:04.254215 ip-10-0-136-90 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 02 13:43:04.254455 ip-10-0-136-90 systemd[1]: Failed to start Kubernetes Kubelet. Jul 02 13:43:14.412567 ip-10-0-136-90 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 02 13:43:14.412616 ip-10-0-136-90 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot cf7b30ae6acc4a88b47f0d871150ef4d -- Jul 02 13:44:49.706818 ip-10-0-136-90 systemd[1]: Starting Kubernetes Kubelet... Jul 02 13:44:50.081173 ip-10-0-136-90 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 13:44:50.081173 ip-10-0-136-90 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 13:44:50.081173 ip-10-0-136-90 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 13:44:50.081173 ip-10-0-136-90 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 13:44:50.081173 ip-10-0-136-90 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 13:44:50.081876 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.081270 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 13:44:50.085938 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.085922 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 02 13:44:50.085938 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.085938 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 13:44:50.086010 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.085943 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 13:44:50.086010 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.085946 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 13:44:50.086010 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.085948 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 13:44:50.086010 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.085951 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 13:44:50.086010 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.085954 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 13:44:50.086010 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.085956 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 13:44:50.086010 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.085959 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 13:44:50.086010 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.085961 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 13:44:50.086010 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.085965 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 13:44:50.086010 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.085969 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 13:44:50.086010 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.085972 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 13:44:50.086010 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.085975 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 13:44:50.086010 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.085977 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 13:44:50.086010 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.085979 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 13:44:50.086010 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.085982 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 13:44:50.086010 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.085985 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 13:44:50.086010 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.085987 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 13:44:50.086010 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.085990 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 13:44:50.086010 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.085993 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 13:44:50.086522 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.085995 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 13:44:50.086522 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.085998 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 13:44:50.086522 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086000 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 13:44:50.086522 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086006 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 13:44:50.086522 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086008 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 13:44:50.086522 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086011 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 13:44:50.086522 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086014 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 13:44:50.086522 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086016 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 13:44:50.086522 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086019 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 13:44:50.086522 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086023 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 13:44:50.086522 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086026 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 13:44:50.086522 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086028 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 13:44:50.086522 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086031 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 13:44:50.086522 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086033 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 13:44:50.086522 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086036 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 13:44:50.086522 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086038 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 13:44:50.086522 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086041 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 13:44:50.086522 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086043 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 13:44:50.086522 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086045 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 13:44:50.086522 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086048 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 13:44:50.087011 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086050 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 13:44:50.087011 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086053 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 13:44:50.087011 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086055 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 13:44:50.087011 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086059 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 13:44:50.087011 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086062 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 13:44:50.087011 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086065 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 13:44:50.087011 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086068 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 13:44:50.087011 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086071 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 13:44:50.087011 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086074 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 13:44:50.087011 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086077 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 13:44:50.087011 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086080 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 13:44:50.087011 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086082 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 13:44:50.087011 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086084 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 13:44:50.087011 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086087 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 13:44:50.087011 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086090 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 13:44:50.087011 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086094 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 13:44:50.087011 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086096 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 13:44:50.087011 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086099 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 13:44:50.087011 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086101 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 13:44:50.087490 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086103 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 13:44:50.087490 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086105 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 13:44:50.087490 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086108 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 13:44:50.087490 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086110 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 13:44:50.087490 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086113 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 13:44:50.087490 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086115 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 13:44:50.087490 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086118 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 13:44:50.087490 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086120 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 13:44:50.087490 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086123 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 13:44:50.087490 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086126 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 13:44:50.087490 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086128 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 13:44:50.087490 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086130 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 13:44:50.087490 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086133 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 13:44:50.087490 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086135 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 13:44:50.087490 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086138 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 13:44:50.087490 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086140 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 13:44:50.087490 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086142 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 13:44:50.087490 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086144 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 13:44:50.087490 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086147 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 13:44:50.087490 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086149 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 13:44:50.087990 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086152 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 13:44:50.087990 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086154 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 13:44:50.087990 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086157 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 13:44:50.087990 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086159 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 13:44:50.087990 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086161 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 13:44:50.087990 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086163 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 13:44:50.087990 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086167 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 13:44:50.087990 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086169 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 13:44:50.087990 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086172 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 13:44:50.087990 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086175 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 13:44:50.087990 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086177 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 13:44:50.087990 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086179 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 13:44:50.087990 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086182 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 13:44:50.087990 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086184 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 13:44:50.087990 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086186 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 13:44:50.087990 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086189 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 13:44:50.087990 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086191 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 13:44:50.087990 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086195 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 13:44:50.087990 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.086198 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 13:44:50.088454 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087679 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 13:44:50.088454 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087687 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 13:44:50.088454 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087691 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 13:44:50.088454 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087694 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 13:44:50.088454 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087697 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 13:44:50.088454 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087700 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 13:44:50.088454 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087703 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 13:44:50.088454 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087705 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 13:44:50.088454 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087708 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 13:44:50.088454 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087710 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 13:44:50.088454 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087713 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 13:44:50.088454 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087715 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 13:44:50.088454 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087718 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 13:44:50.088454 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087720 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 13:44:50.088454 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087723 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 13:44:50.088454 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087726 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 13:44:50.088454 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087729 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 13:44:50.088454 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087732 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 13:44:50.088454 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087735 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 13:44:50.088956 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087737 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 13:44:50.088956 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087740 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 13:44:50.088956 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087743 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 13:44:50.088956 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087746 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 13:44:50.088956 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087748 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 13:44:50.088956 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087751 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 13:44:50.088956 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087753 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 13:44:50.088956 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087755 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 13:44:50.088956 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087758 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 13:44:50.088956 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087760 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 13:44:50.088956 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087762 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 13:44:50.088956 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087765 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 13:44:50.088956 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087768 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 13:44:50.088956 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087770 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 13:44:50.088956 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087773 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 13:44:50.088956 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087775 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 13:44:50.088956 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087777 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 13:44:50.088956 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087780 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 13:44:50.088956 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087782 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 13:44:50.088956 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087785 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 13:44:50.089430 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087789 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 13:44:50.089430 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087792 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 13:44:50.089430 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087795 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 13:44:50.089430 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087798 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 13:44:50.089430 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087800 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 13:44:50.089430 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087803 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 13:44:50.089430 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087805 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 13:44:50.089430 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087807 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 13:44:50.089430 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087810 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 13:44:50.089430 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087815 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 13:44:50.089430 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087818 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 13:44:50.089430 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087822 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 13:44:50.089430 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087825 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 13:44:50.089430 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087828 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 13:44:50.089430 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087830 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 13:44:50.089430 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087833 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 13:44:50.089430 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087835 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 13:44:50.089430 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087838 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 13:44:50.089430 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087840 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 13:44:50.089894 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087843 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 13:44:50.089894 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087847 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 13:44:50.089894 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087850 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 13:44:50.089894 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087854 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 02 13:44:50.089894 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087856 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 13:44:50.089894 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087859 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 13:44:50.089894 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087862 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 13:44:50.089894 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087864 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 13:44:50.089894 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087867 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 13:44:50.089894 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087869 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 13:44:50.089894 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087871 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 13:44:50.089894 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087874 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 13:44:50.089894 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087876 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 13:44:50.089894 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087878 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 13:44:50.089894 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087881 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 13:44:50.089894 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087883 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 13:44:50.089894 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087885 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 13:44:50.089894 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087888 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 13:44:50.089894 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087890 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 13:44:50.089894 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087892 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 13:44:50.090362 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087895 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 13:44:50.090362 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087897 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 13:44:50.090362 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087902 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 13:44:50.090362 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087905 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 13:44:50.090362 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087907 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 13:44:50.090362 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087910 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 13:44:50.090362 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087912 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 13:44:50.090362 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087915 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 13:44:50.090362 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087917 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 13:44:50.090362 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087920 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 13:44:50.090362 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087922 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 13:44:50.090362 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087925 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 13:44:50.090362 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087927 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 13:44:50.090362 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087930 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 13:44:50.090362 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087932 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 13:44:50.090362 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087935 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 13:44:50.090362 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087937 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 13:44:50.090362 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087940 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 13:44:50.090362 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087942 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 13:44:50.090362 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087944 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 13:44:50.090845 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.087947 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 13:44:50.090845 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088324 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 13:44:50.090845 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088329 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 13:44:50.090845 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088332 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 13:44:50.090845 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088334 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 13:44:50.090845 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088337 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 13:44:50.090845 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088340 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 13:44:50.090845 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088342 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 13:44:50.090845 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088345 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 13:44:50.090845 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088351 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 13:44:50.090845 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088354 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 13:44:50.090845 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088370 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 13:44:50.090845 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088373 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 13:44:50.090845 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088376 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 13:44:50.090845 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088380 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 13:44:50.090845 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088382 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 13:44:50.090845 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088385 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 13:44:50.090845 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088388 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 13:44:50.090845 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088390 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 13:44:50.091317 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088392 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 13:44:50.091317 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088395 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 13:44:50.091317 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088397 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 13:44:50.091317 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088399 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 13:44:50.091317 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088402 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 13:44:50.091317 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088404 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 13:44:50.091317 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088407 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 13:44:50.091317 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088409 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 13:44:50.091317 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088411 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 13:44:50.091317 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088414 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 13:44:50.091317 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088416 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 13:44:50.091317 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088419 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 13:44:50.091317 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088421 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 13:44:50.091317 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088423 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 13:44:50.091317 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088426 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 13:44:50.091317 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088428 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 13:44:50.091317 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088431 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 13:44:50.091317 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088433 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 13:44:50.091317 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088435 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 13:44:50.091317 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088438 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 13:44:50.091821 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088440 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 13:44:50.091821 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088443 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 13:44:50.091821 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088446 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 13:44:50.091821 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088449 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 13:44:50.091821 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088451 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 13:44:50.091821 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088453 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 13:44:50.091821 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088456 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 13:44:50.091821 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088459 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 13:44:50.091821 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088462 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 13:44:50.091821 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088465 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 13:44:50.091821 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088467 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 13:44:50.091821 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088470 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 13:44:50.091821 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088472 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 13:44:50.091821 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088475 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 13:44:50.091821 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088478 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 13:44:50.091821 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088482 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 13:44:50.091821 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088484 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 13:44:50.091821 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088488 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 13:44:50.091821 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088491 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 13:44:50.092282 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088494 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 13:44:50.092282 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088496 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 13:44:50.092282 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088499 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 13:44:50.092282 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088501 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 13:44:50.092282 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088504 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 13:44:50.092282 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088506 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 13:44:50.092282 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088509 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 13:44:50.092282 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088511 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 13:44:50.092282 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088513 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 13:44:50.092282 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088516 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 13:44:50.092282 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088518 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 13:44:50.092282 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088521 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 02 13:44:50.092282 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088523 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 13:44:50.092282 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088525 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 13:44:50.092282 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088527 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 13:44:50.092282 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088531 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 13:44:50.092282 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088533 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 13:44:50.092282 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088536 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 13:44:50.092282 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088538 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 13:44:50.092282 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088554 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 13:44:50.092282 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088557 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 13:44:50.092809 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088570 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 13:44:50.092809 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088573 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 13:44:50.092809 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088576 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 13:44:50.092809 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088578 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 13:44:50.092809 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088581 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 13:44:50.092809 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088583 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 13:44:50.092809 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088585 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 13:44:50.092809 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088588 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 13:44:50.092809 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088590 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 13:44:50.092809 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088592 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 13:44:50.092809 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088594 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 13:44:50.092809 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088597 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 13:44:50.092809 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088599 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 13:44:50.092809 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088601 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 13:44:50.092809 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088603 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 13:44:50.092809 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088606 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 13:44:50.092809 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088608 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 13:44:50.092809 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088610 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 13:44:50.092809 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088613 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 13:44:50.092809 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088615 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 13:44:50.093272 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.088617 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 13:44:50.093272 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088684 2563 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 13:44:50.093272 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088692 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 13:44:50.093272 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088697 2563 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 13:44:50.093272 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088701 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 13:44:50.093272 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088705 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 13:44:50.093272 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088708 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 13:44:50.093272 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088713 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 13:44:50.093272 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088717 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 13:44:50.093272 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088720 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 13:44:50.093272 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088723 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 13:44:50.093272 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088726 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 13:44:50.093272 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088729 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 13:44:50.093272 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088732 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 13:44:50.093272 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088735 2563 flags.go:64] FLAG: --cgroup-root="" Jul 02 13:44:50.093272 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088738 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 13:44:50.093272 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088741 2563 flags.go:64] FLAG: --client-ca-file="" Jul 02 13:44:50.093272 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088744 2563 flags.go:64] FLAG: --cloud-provider="external" Jul 02 13:44:50.093272 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088746 2563 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 13:44:50.093272 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088751 2563 flags.go:64] FLAG: --cluster-domain="" Jul 02 13:44:50.093272 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088754 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 13:44:50.093272 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088757 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 13:44:50.093272 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088760 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 13:44:50.093272 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088763 2563 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 13:44:50.093844 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088771 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 13:44:50.093844 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088773 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 13:44:50.093844 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088776 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 13:44:50.093844 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088779 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 13:44:50.093844 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088782 2563 flags.go:64] FLAG: --contention-profiling="false" Jul 02 13:44:50.093844 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088785 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 13:44:50.093844 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088787 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 13:44:50.093844 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088790 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 13:44:50.093844 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088793 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 13:44:50.093844 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088797 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 13:44:50.093844 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088800 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 13:44:50.093844 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088803 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 13:44:50.093844 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088805 2563 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 13:44:50.093844 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088808 2563 flags.go:64] FLAG: --enable-server="true" Jul 02 13:44:50.093844 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088811 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 13:44:50.093844 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088815 2563 flags.go:64] FLAG: --event-burst="100" Jul 02 13:44:50.093844 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088818 2563 flags.go:64] FLAG: --event-qps="50" Jul 02 13:44:50.093844 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088821 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 13:44:50.093844 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088823 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 13:44:50.093844 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088826 2563 flags.go:64] FLAG: --eviction-hard="" Jul 02 13:44:50.093844 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088830 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 13:44:50.093844 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088832 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 13:44:50.093844 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088835 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 13:44:50.093844 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088838 2563 flags.go:64] FLAG: --eviction-soft="" Jul 02 13:44:50.093844 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088841 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 13:44:50.094456 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088843 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 13:44:50.094456 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088846 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 13:44:50.094456 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088849 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 13:44:50.094456 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088851 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 13:44:50.094456 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088854 2563 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 13:44:50.094456 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088856 2563 flags.go:64] FLAG: --feature-gates="" Jul 02 13:44:50.094456 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088859 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 13:44:50.094456 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088862 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 13:44:50.094456 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088865 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 13:44:50.094456 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088868 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 13:44:50.094456 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088871 2563 flags.go:64] FLAG: --healthz-port="10248" Jul 02 13:44:50.094456 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088873 2563 flags.go:64] FLAG: --help="false" Jul 02 13:44:50.094456 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088876 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-136-90.ec2.internal" Jul 02 13:44:50.094456 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088879 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 13:44:50.094456 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088881 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 13:44:50.094456 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088884 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 13:44:50.094456 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088887 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 13:44:50.094456 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088890 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 13:44:50.094456 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088893 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 13:44:50.094456 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088895 2563 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 13:44:50.094456 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088898 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 13:44:50.094456 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088901 2563 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 13:44:50.094456 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088904 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 13:44:50.095036 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088907 2563 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 13:44:50.095036 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088909 2563 flags.go:64] FLAG: --kube-reserved="" Jul 02 13:44:50.095036 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088912 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 13:44:50.095036 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088914 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 13:44:50.095036 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088917 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 13:44:50.095036 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088920 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 13:44:50.095036 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088922 2563 flags.go:64] FLAG: --lock-file="" Jul 02 13:44:50.095036 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088925 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 13:44:50.095036 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088928 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 13:44:50.095036 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088931 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 13:44:50.095036 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088936 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 13:44:50.095036 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088938 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 13:44:50.095036 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088941 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 13:44:50.095036 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088943 2563 flags.go:64] FLAG: --logging-format="text" Jul 02 13:44:50.095036 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088946 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 13:44:50.095036 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088949 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 13:44:50.095036 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088951 2563 flags.go:64] FLAG: --manifest-url="" Jul 02 13:44:50.095036 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088954 2563 flags.go:64] FLAG: --manifest-url-header="" Jul 02 13:44:50.095036 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088958 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 13:44:50.095036 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088963 2563 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 13:44:50.095036 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088967 2563 flags.go:64] FLAG: --max-pods="110" Jul 02 13:44:50.095036 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088970 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 13:44:50.095036 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088977 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 13:44:50.095036 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088980 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 13:44:50.095036 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088983 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 13:44:50.095693 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088985 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 13:44:50.095693 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088989 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 13:44:50.095693 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088991 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 13:44:50.095693 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.088998 2563 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 13:44:50.095693 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089001 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 13:44:50.095693 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089005 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 13:44:50.095693 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089009 2563 flags.go:64] FLAG: --pod-cidr="" Jul 02 13:44:50.095693 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089011 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 02 13:44:50.095693 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089017 2563 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 13:44:50.095693 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089020 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 13:44:50.095693 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089023 2563 flags.go:64] FLAG: --pods-per-core="0" Jul 02 13:44:50.095693 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089025 2563 flags.go:64] FLAG: --port="10250" Jul 02 13:44:50.095693 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089028 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 13:44:50.095693 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089031 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06f58e821f25fd470" Jul 02 13:44:50.095693 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089034 2563 flags.go:64] FLAG: --qos-reserved="" Jul 02 13:44:50.095693 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089037 2563 flags.go:64] FLAG: --read-only-port="10255" Jul 02 13:44:50.095693 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089040 2563 flags.go:64] FLAG: --register-node="true" Jul 02 13:44:50.095693 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089043 2563 flags.go:64] FLAG: --register-with-taints="" Jul 02 13:44:50.095693 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089046 2563 flags.go:64] FLAG: --registry-burst="10" Jul 02 13:44:50.095693 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089049 2563 flags.go:64] FLAG: --registry-qps="5" Jul 02 13:44:50.095693 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089052 2563 flags.go:64] FLAG: --reserved-cpus="" Jul 02 13:44:50.095693 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089054 2563 flags.go:64] FLAG: --reserved-memory="" Jul 02 13:44:50.095693 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089058 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 13:44:50.095693 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089060 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 13:44:50.095693 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089063 2563 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 13:44:50.096321 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089065 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 13:44:50.096321 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089068 2563 flags.go:64] FLAG: --runonce="false" Jul 02 13:44:50.096321 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089072 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 13:44:50.096321 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089075 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 13:44:50.096321 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089077 2563 flags.go:64] FLAG: --seccomp-default="false" Jul 02 13:44:50.096321 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089080 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 13:44:50.096321 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089083 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 13:44:50.096321 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089086 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 13:44:50.096321 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089088 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 13:44:50.096321 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089091 2563 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 13:44:50.096321 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089094 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 13:44:50.096321 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089097 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 13:44:50.096321 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089102 2563 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 13:44:50.096321 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089104 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 13:44:50.096321 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089107 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 13:44:50.096321 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089110 2563 flags.go:64] FLAG: --system-cgroups="" Jul 02 13:44:50.096321 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089112 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 13:44:50.096321 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089118 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 13:44:50.096321 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089120 2563 flags.go:64] FLAG: --tls-cert-file="" Jul 02 13:44:50.096321 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089123 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 13:44:50.096321 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089128 2563 flags.go:64] FLAG: --tls-min-version="" Jul 02 13:44:50.096321 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089130 2563 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 13:44:50.096321 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089133 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 13:44:50.096321 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089135 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 13:44:50.096321 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089139 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 13:44:50.096938 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089142 2563 flags.go:64] FLAG: --v="2" Jul 02 13:44:50.096938 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089146 2563 flags.go:64] FLAG: --version="false" Jul 02 13:44:50.096938 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089149 2563 flags.go:64] FLAG: --vmodule="" Jul 02 13:44:50.096938 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089153 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 13:44:50.096938 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.089156 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 13:44:50.096938 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089267 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 13:44:50.096938 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089271 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 13:44:50.096938 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089273 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 13:44:50.096938 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089276 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 13:44:50.096938 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089279 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 13:44:50.096938 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089282 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 13:44:50.096938 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089284 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 13:44:50.096938 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089287 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 13:44:50.096938 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089289 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 13:44:50.096938 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089292 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 13:44:50.096938 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089294 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 13:44:50.096938 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089297 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 13:44:50.096938 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089299 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 02 13:44:50.096938 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089302 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 13:44:50.096938 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089306 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 13:44:50.096938 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089309 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 13:44:50.097440 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089311 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 13:44:50.097440 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089313 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 13:44:50.097440 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089316 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 13:44:50.097440 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089318 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 13:44:50.097440 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089321 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 13:44:50.097440 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089323 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 13:44:50.097440 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089326 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 13:44:50.097440 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089328 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 13:44:50.097440 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089331 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 13:44:50.097440 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089333 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 13:44:50.097440 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089335 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 13:44:50.097440 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089338 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 13:44:50.097440 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089341 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 13:44:50.097440 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089343 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 13:44:50.097440 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089345 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 13:44:50.097440 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089347 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 13:44:50.097440 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089350 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 13:44:50.097440 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089352 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 13:44:50.097440 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089354 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 13:44:50.097943 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089357 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 13:44:50.097943 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089361 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 13:44:50.097943 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089363 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 13:44:50.097943 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089366 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 13:44:50.097943 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089368 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 13:44:50.097943 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089372 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 13:44:50.097943 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089375 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 13:44:50.097943 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089378 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 13:44:50.097943 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089380 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 13:44:50.097943 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089383 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 13:44:50.097943 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089385 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 13:44:50.097943 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089389 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 13:44:50.097943 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089391 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 13:44:50.097943 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089394 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 13:44:50.097943 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089396 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 13:44:50.097943 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089399 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 13:44:50.097943 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089402 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 13:44:50.097943 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089405 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 13:44:50.097943 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089408 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 13:44:50.098403 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089412 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 13:44:50.098403 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089414 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 13:44:50.098403 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089418 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 13:44:50.098403 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089420 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 13:44:50.098403 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089423 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 13:44:50.098403 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089425 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 13:44:50.098403 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089428 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 13:44:50.098403 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089430 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 13:44:50.098403 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089433 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 13:44:50.098403 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089435 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 13:44:50.098403 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089438 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 13:44:50.098403 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089440 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 13:44:50.098403 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089443 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 13:44:50.098403 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089445 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 13:44:50.098403 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089449 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 13:44:50.098403 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089451 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 13:44:50.098403 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089454 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 13:44:50.098403 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089456 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 13:44:50.098403 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089458 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 13:44:50.098403 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089461 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 13:44:50.098920 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089463 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 13:44:50.098920 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089465 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 13:44:50.098920 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089468 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 13:44:50.098920 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089470 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 13:44:50.098920 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089474 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 13:44:50.098920 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089477 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 13:44:50.098920 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089479 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 13:44:50.098920 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089482 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 13:44:50.098920 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089484 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 13:44:50.098920 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089486 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 13:44:50.098920 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089490 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 13:44:50.098920 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089493 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 13:44:50.098920 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089496 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 13:44:50.098920 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089498 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 13:44:50.098920 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089501 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 13:44:50.098920 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089503 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 13:44:50.098920 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089506 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 13:44:50.098920 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089508 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 13:44:50.098920 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089510 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 13:44:50.098920 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089513 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 13:44:50.099424 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089516 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 13:44:50.099424 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089518 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 13:44:50.099424 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089521 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 13:44:50.099424 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089523 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 13:44:50.099424 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.089525 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 13:44:50.099424 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.090122 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 13:44:50.099424 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.096824 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 13:44:50.099424 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.096840 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 13:44:50.099424 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.096863 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 13:44:50.099424 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.096871 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 13:44:50.099424 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.096925 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 13:44:50.099424 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.096930 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 13:44:50.099424 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.096933 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 13:44:50.099424 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.096936 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 13:44:50.099424 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.096939 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 13:44:50.099872 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.096942 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 13:44:50.099872 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.096944 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 13:44:50.099872 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.096947 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 13:44:50.099872 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.096950 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 13:44:50.099872 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.096953 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 13:44:50.099872 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.096955 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 13:44:50.099872 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.096958 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 13:44:50.099872 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.096960 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 13:44:50.099872 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.096962 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 13:44:50.099872 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.096965 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 13:44:50.099872 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.096967 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 13:44:50.099872 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.096969 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 13:44:50.099872 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.096972 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 13:44:50.099872 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.096974 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 13:44:50.099872 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.096977 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 13:44:50.099872 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.096979 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 13:44:50.099872 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.096981 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 13:44:50.099872 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.096984 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 13:44:50.099872 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.096986 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 13:44:50.099872 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.096989 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 13:44:50.100346 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.096991 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 13:44:50.100346 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.096995 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 13:44:50.100346 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.096998 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 13:44:50.100346 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097001 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 13:44:50.100346 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097005 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 13:44:50.100346 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097009 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 13:44:50.100346 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097012 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 13:44:50.100346 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097015 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 13:44:50.100346 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097018 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 13:44:50.100346 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097021 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 13:44:50.100346 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097024 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 13:44:50.100346 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097026 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 13:44:50.100346 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097029 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 13:44:50.100346 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097031 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 13:44:50.100346 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097034 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 13:44:50.100346 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097036 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 13:44:50.100346 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097038 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 13:44:50.100346 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097041 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 13:44:50.100346 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097043 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 13:44:50.100810 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097046 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 13:44:50.100810 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097048 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 13:44:50.100810 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097051 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 13:44:50.100810 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097053 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 13:44:50.100810 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097055 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 13:44:50.100810 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097058 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 13:44:50.100810 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097060 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 13:44:50.100810 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097063 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 13:44:50.100810 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097065 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 13:44:50.100810 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097068 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 13:44:50.100810 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097070 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 13:44:50.100810 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097073 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 13:44:50.100810 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097075 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 13:44:50.100810 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097078 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 13:44:50.100810 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097080 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 13:44:50.100810 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097082 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 13:44:50.100810 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097085 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 13:44:50.100810 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097088 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 13:44:50.100810 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097091 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 02 13:44:50.100810 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097093 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 13:44:50.101339 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097095 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 13:44:50.101339 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097097 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 13:44:50.101339 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097100 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 13:44:50.101339 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097102 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 13:44:50.101339 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097104 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 13:44:50.101339 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097107 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 13:44:50.101339 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097109 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 13:44:50.101339 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097111 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 13:44:50.101339 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097113 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 13:44:50.101339 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097116 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 13:44:50.101339 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097118 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 13:44:50.101339 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097120 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 13:44:50.101339 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097123 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 13:44:50.101339 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097126 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 13:44:50.101339 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097128 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 13:44:50.101339 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097131 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 13:44:50.101339 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097133 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 13:44:50.101339 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097135 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 13:44:50.101339 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097138 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 13:44:50.101339 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097140 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 13:44:50.101825 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097142 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 13:44:50.101825 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097145 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 13:44:50.101825 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097147 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 13:44:50.101825 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097149 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 13:44:50.101825 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097151 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 13:44:50.101825 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097155 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 13:44:50.101825 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097158 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 13:44:50.101825 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097161 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 13:44:50.101825 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097163 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 13:44:50.101825 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097166 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 13:44:50.101825 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097169 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 13:44:50.101825 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097172 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 13:44:50.101825 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097174 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 13:44:50.101825 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097177 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 13:44:50.101825 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097179 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 13:44:50.102171 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.097184 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 13:44:50.102171 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097312 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 13:44:50.102171 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097317 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 13:44:50.102171 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097320 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 13:44:50.102171 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097322 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 13:44:50.102171 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097325 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 13:44:50.102171 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097328 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 13:44:50.102171 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097330 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 13:44:50.102171 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097333 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 13:44:50.102171 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097335 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 13:44:50.102171 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097337 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 13:44:50.102171 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097340 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 13:44:50.102171 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097342 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 13:44:50.102171 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097345 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 13:44:50.102533 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097347 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 13:44:50.102533 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097349 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 13:44:50.102533 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097352 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 13:44:50.102533 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097354 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 13:44:50.102533 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097357 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 13:44:50.102533 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097359 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 13:44:50.102533 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097361 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 13:44:50.102533 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097363 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 13:44:50.102533 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097366 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 13:44:50.102533 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097368 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 13:44:50.102533 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097370 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 13:44:50.102533 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097373 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 13:44:50.102533 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097375 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 13:44:50.102533 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097377 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 13:44:50.102533 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097380 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 13:44:50.102533 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097383 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 13:44:50.102533 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097385 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 13:44:50.102533 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097388 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 13:44:50.102533 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097390 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 13:44:50.102533 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097392 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 13:44:50.103127 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097395 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 13:44:50.103127 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097397 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 13:44:50.103127 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097399 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 13:44:50.103127 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097402 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 13:44:50.103127 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097404 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 13:44:50.103127 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097407 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 13:44:50.103127 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097411 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 13:44:50.103127 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097414 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 13:44:50.103127 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097416 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 13:44:50.103127 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097419 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 13:44:50.103127 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097421 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 13:44:50.103127 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097424 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 13:44:50.103127 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097426 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 13:44:50.103127 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097429 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 13:44:50.103127 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097431 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 13:44:50.103127 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097434 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 13:44:50.103127 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097436 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 13:44:50.103127 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097438 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 13:44:50.103127 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097440 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 13:44:50.103615 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097443 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 13:44:50.103615 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097445 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 13:44:50.103615 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097448 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 13:44:50.103615 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097450 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 13:44:50.103615 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097453 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 13:44:50.103615 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097455 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 13:44:50.103615 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097458 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 13:44:50.103615 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097460 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 13:44:50.103615 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097463 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 13:44:50.103615 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097467 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 13:44:50.103615 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097469 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 13:44:50.103615 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097471 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 13:44:50.103615 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097474 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 02 13:44:50.103615 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097476 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 13:44:50.103615 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097478 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 13:44:50.103615 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097481 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 13:44:50.103615 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097483 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 13:44:50.103615 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097485 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 13:44:50.103615 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097487 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 13:44:50.103615 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097489 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 13:44:50.104124 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097492 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 13:44:50.104124 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097494 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 13:44:50.104124 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097497 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 13:44:50.104124 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097499 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 13:44:50.104124 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097502 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 13:44:50.104124 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097504 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 13:44:50.104124 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097507 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 13:44:50.104124 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097509 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 13:44:50.104124 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097511 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 13:44:50.104124 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097513 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 13:44:50.104124 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097516 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 13:44:50.104124 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097518 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 13:44:50.104124 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097520 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 13:44:50.104124 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097523 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 13:44:50.104124 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097526 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 13:44:50.104124 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097530 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 13:44:50.104124 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097534 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 13:44:50.104124 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097537 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 13:44:50.104124 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097556 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 13:44:50.104594 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097560 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 13:44:50.104594 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097562 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 13:44:50.104594 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097565 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 13:44:50.104594 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097568 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 13:44:50.104594 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097571 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 13:44:50.104594 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097574 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 13:44:50.104594 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097576 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 13:44:50.104594 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:50.097578 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 13:44:50.104594 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.097583 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 13:44:50.104594 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.097699 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 13:44:50.104594 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.099612 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 13:44:50.104594 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.101127 2563 server.go:1019] "Starting client certificate rotation" Jul 02 13:44:50.104594 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.101227 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 13:44:50.104594 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.101259 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 13:44:50.105110 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.103766 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 13:44:50.107478 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.107439 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 13:44:50.116179 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.116163 2563 log.go:25] "Validated CRI v1 runtime API" Jul 02 13:44:50.118785 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.118772 2563 log.go:25] "Validated CRI v1 image API" Jul 02 13:44:50.119644 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.119623 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 13:44:50.122186 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.122170 2563 fs.go:135] Filesystem UUIDs: map[17030e54-81ee-46ef-b871-144e715ba359:/dev/nvme0n1p4 42a35102-e602-4afb-8f8e-3ee1c59e9a5e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 02 13:44:50.122240 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.122187 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 13:44:50.127075 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.126970 2563 manager.go:216] Machine: {Timestamp:2026-07-02 13:44:50.125761334 +0000 UTC m=+0.305401593 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3200988 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28caaf29047bc766e41b374b2c748b SystemUUID:ec28caaf-2904-7bc7-66e4-1b374b2c748b BootID:cf7b30ae-6acc-4a88-b47f-0d871150ef4d Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:89:79:d5:2f:fd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:89:79:d5:2f:fd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:65:41:64:a1:f0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 13:44:50.127075 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.127075 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 13:44:50.127182 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.127155 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 13:44:50.130672 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.130650 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 13:44:50.130801 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.130677 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-90.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 13:44:50.131311 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.131300 2563 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 13:44:50.131347 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.131314 2563 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 13:44:50.131347 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.131322 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 13:44:50.131913 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.131901 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 13:44:50.132752 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.132743 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 13:44:50.133810 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.133795 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 13:44:50.135782 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.135767 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 02 13:44:50.136080 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.136067 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 13:44:50.136155 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.136107 2563 kubelet.go:486] "Attempting to sync node with API server" Jul 02 13:44:50.136155 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.136121 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 13:44:50.136155 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.136141 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 13:44:50.136155 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.136153 2563 kubelet.go:398] "Adding apiserver pod source" Jul 02 13:44:50.136326 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.136164 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 13:44:50.136667 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.136654 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 13:44:50.136730 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.136676 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 13:44:50.143736 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.143715 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 13:44:50.145119 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.145106 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 13:44:50.145170 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.145137 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 13:44:50.145839 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.145824 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 13:44:50.145874 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.145851 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 13:44:50.145874 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.145863 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 13:44:50.145935 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.145885 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 13:44:50.145935 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.145902 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 13:44:50.145935 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.145913 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 13:44:50.145935 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.145927 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 13:44:50.146029 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.145936 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 13:44:50.146029 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.145949 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 13:44:50.146029 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.145961 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 13:44:50.146029 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.145987 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 13:44:50.146029 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.145998 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 13:44:50.147729 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.147714 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 13:44:50.147769 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.147733 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 13:44:50.150730 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.150702 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-90.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 02 13:44:50.151254 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.151231 2563 server.go:1268] "Started kubelet" Jul 02 13:44:50.151909 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.151878 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 13:44:50.152140 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:50.152115 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-90.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 02 13:44:50.152272 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:50.152187 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 02 13:44:50.152377 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.152249 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 13:44:50.152377 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.152360 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 13:44:50.152377 ip-10-0-136-90 systemd[1]: Started Kubernetes Kubelet. Jul 02 13:44:50.153691 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.153674 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 13:44:50.154911 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.154895 2563 server.go:310] "Adding debug handlers to kubelet server" Jul 02 13:44:50.157602 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:50.157582 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 13:44:50.160457 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.160443 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 13:44:50.160571 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.160445 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 13:44:50.160571 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:50.160531 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-90.ec2.internal\" not found" Jul 02 13:44:50.161154 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.161110 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 13:44:50.161154 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.161125 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 13:44:50.161154 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.161140 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 13:44:50.161154 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.161155 2563 factory.go:55] Registering systemd factory Jul 02 13:44:50.161439 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.161169 2563 factory.go:223] Registration of the systemd container factory successfully Jul 02 13:44:50.161439 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.161245 2563 reconstruct.go:97] "Volume reconstruction finished" Jul 02 13:44:50.161439 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.161256 2563 reconciler.go:29] "Reconciler: start to sync state" Jul 02 13:44:50.161439 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.161430 2563 factory.go:153] Registering CRI-O factory Jul 02 13:44:50.161639 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.161444 2563 factory.go:223] Registration of the crio container factory successfully Jul 02 13:44:50.161639 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.161496 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 13:44:50.161639 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.161519 2563 factory.go:103] Registering Raw factory Jul 02 13:44:50.161639 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.161533 2563 manager.go:1196] Started watching for new ooms in manager Jul 02 13:44:50.161817 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:50.160742 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-90.ec2.internal.18be7cf40f059d4b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-90.ec2.internal,UID:ip-10-0-136-90.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-90.ec2.internal,},FirstTimestamp:2026-07-02 13:44:50.151185739 +0000 UTC m=+0.330825986,LastTimestamp:2026-07-02 13:44:50.151185739 +0000 UTC m=+0.330825986,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-90.ec2.internal,}" Jul 02 13:44:50.161959 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.161945 2563 manager.go:349] Starting recovery of all containers Jul 02 13:44:50.170028 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:50.169907 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-90.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 02 13:44:50.170028 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:50.169962 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 02 13:44:50.171654 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.171597 2563 manager.go:354] Recovery completed Jul 02 13:44:50.175951 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.175938 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 13:44:50.177916 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.177895 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-90.ec2.internal" event="NodeHasSufficientMemory" Jul 02 13:44:50.177967 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.177929 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-90.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 13:44:50.177967 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.177939 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-90.ec2.internal" event="NodeHasSufficientPID" Jul 02 13:44:50.178397 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.178384 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 13:44:50.178397 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.178397 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 13:44:50.178518 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.178414 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 02 13:44:50.178518 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.178429 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 13:44:50.179117 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.179106 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-90.ec2.internal" event="NodeHasSufficientMemory" Jul 02 13:44:50.179164 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.179128 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-90.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 13:44:50.179164 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.179142 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-90.ec2.internal" event="NodeHasSufficientPID" Jul 02 13:44:50.179528 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.179516 2563 policy_none.go:49] "None policy: Start" Jul 02 13:44:50.179613 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.179535 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 13:44:50.179613 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.179578 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 13:44:50.180593 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.180581 2563 policy_none.go:47] "Start" Jul 02 13:44:50.187098 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.187081 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qsxbt" Jul 02 13:44:50.188933 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:50.188872 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-90.ec2.internal.18be7cf4109d8042 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-90.ec2.internal,UID:ip-10-0-136-90.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-90.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-90.ec2.internal,},FirstTimestamp:2026-07-02 13:44:50.177916994 +0000 UTC m=+0.357557240,LastTimestamp:2026-07-02 13:44:50.177916994 +0000 UTC m=+0.357557240,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-90.ec2.internal,}" Jul 02 13:44:50.195143 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.195127 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qsxbt" Jul 02 13:44:50.196876 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:50.196816 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-90.ec2.internal.18be7cf4109dc1c6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-90.ec2.internal,UID:ip-10-0-136-90.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-90.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-90.ec2.internal,},FirstTimestamp:2026-07-02 13:44:50.177933766 +0000 UTC m=+0.357574009,LastTimestamp:2026-07-02 13:44:50.177933766 +0000 UTC m=+0.357574009,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-90.ec2.internal,}" Jul 02 13:44:50.233758 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.223918 2563 manager.go:337] "Starting Device Plugin manager" Jul 02 13:44:50.233758 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:50.223948 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 13:44:50.233758 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.223962 2563 server.go:87] "Starting device plugin registration server" Jul 02 13:44:50.233758 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.224225 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 13:44:50.233758 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.224239 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 13:44:50.233758 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.224300 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 13:44:50.233758 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.224381 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 13:44:50.233758 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.224390 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 13:44:50.233758 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:50.224957 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 13:44:50.233758 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:50.225011 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-90.ec2.internal\" not found" Jul 02 13:44:50.233758 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.231199 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 13:44:50.233758 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.232453 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 13:44:50.233758 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.232484 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 13:44:50.233758 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.232502 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 13:44:50.233758 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:50.232529 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 02 13:44:50.234708 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.234693 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 13:44:50.325242 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.325213 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 13:44:50.326236 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.326211 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-90.ec2.internal" event="NodeHasSufficientMemory" Jul 02 13:44:50.326328 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.326241 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-90.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 13:44:50.326328 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.326252 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-90.ec2.internal" event="NodeHasSufficientPID" Jul 02 13:44:50.326328 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.326275 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-90.ec2.internal" Jul 02 13:44:50.332924 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.332882 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-90.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-90.ec2.internal"] Jul 02 13:44:50.332987 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.332935 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 13:44:50.334258 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.334241 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-90.ec2.internal" event="NodeHasSufficientMemory" Jul 02 13:44:50.334363 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.334271 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-90.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 13:44:50.334363 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.334281 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-90.ec2.internal" event="NodeHasSufficientPID" Jul 02 13:44:50.335434 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.335421 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 13:44:50.335579 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.335565 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-90.ec2.internal" Jul 02 13:44:50.335637 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.335594 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 13:44:50.335637 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.335597 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-90.ec2.internal" Jul 02 13:44:50.335637 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:50.335614 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-90.ec2.internal\": node \"ip-10-0-136-90.ec2.internal\" not found" Jul 02 13:44:50.336185 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.336165 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-90.ec2.internal" event="NodeHasSufficientMemory" Jul 02 13:44:50.336185 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.336187 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-90.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 13:44:50.336320 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.336189 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-90.ec2.internal" event="NodeHasSufficientMemory" Jul 02 13:44:50.336320 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.336198 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-90.ec2.internal" event="NodeHasSufficientPID" Jul 02 13:44:50.336320 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.336217 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-90.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 13:44:50.336320 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.336230 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-90.ec2.internal" event="NodeHasSufficientPID" Jul 02 13:44:50.337372 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.337358 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-90.ec2.internal" Jul 02 13:44:50.337429 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.337381 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 13:44:50.338015 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.337999 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-90.ec2.internal" event="NodeHasSufficientMemory" Jul 02 13:44:50.338100 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.338030 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-90.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 13:44:50.338100 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.338044 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-90.ec2.internal" event="NodeHasSufficientPID" Jul 02 13:44:50.348819 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:50.348805 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-90.ec2.internal\" not found" Jul 02 13:44:50.362811 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.362788 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f1b59b21137513387443ed9e348d0900-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-90.ec2.internal\" (UID: \"f1b59b21137513387443ed9e348d0900\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-90.ec2.internal" Jul 02 13:44:50.362895 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.362821 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1b59b21137513387443ed9e348d0900-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-90.ec2.internal\" (UID: \"f1b59b21137513387443ed9e348d0900\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-90.ec2.internal" Jul 02 13:44:50.362895 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.362842 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/beb4cae7aa98a7b51e62919b1f06ca53-config\") pod \"kube-apiserver-proxy-ip-10-0-136-90.ec2.internal\" (UID: \"beb4cae7aa98a7b51e62919b1f06ca53\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-90.ec2.internal" Jul 02 13:44:50.367043 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:50.367027 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-90.ec2.internal\" not found" node="ip-10-0-136-90.ec2.internal" Jul 02 13:44:50.371317 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:50.371286 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-90.ec2.internal\" not found" node="ip-10-0-136-90.ec2.internal" Jul 02 13:44:50.449684 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:50.449663 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-90.ec2.internal\" not found" Jul 02 13:44:50.463011 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.462992 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/beb4cae7aa98a7b51e62919b1f06ca53-config\") pod \"kube-apiserver-proxy-ip-10-0-136-90.ec2.internal\" (UID: \"beb4cae7aa98a7b51e62919b1f06ca53\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-90.ec2.internal" Jul 02 13:44:50.463063 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.463014 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f1b59b21137513387443ed9e348d0900-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-90.ec2.internal\" (UID: \"f1b59b21137513387443ed9e348d0900\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-90.ec2.internal" Jul 02 13:44:50.463063 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.463030 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1b59b21137513387443ed9e348d0900-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-90.ec2.internal\" (UID: \"f1b59b21137513387443ed9e348d0900\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-90.ec2.internal" Jul 02 13:44:50.463137 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.463066 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1b59b21137513387443ed9e348d0900-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-90.ec2.internal\" (UID: \"f1b59b21137513387443ed9e348d0900\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-90.ec2.internal" Jul 02 13:44:50.463137 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.463104 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f1b59b21137513387443ed9e348d0900-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-90.ec2.internal\" (UID: \"f1b59b21137513387443ed9e348d0900\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-90.ec2.internal" Jul 02 13:44:50.463137 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.463104 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/beb4cae7aa98a7b51e62919b1f06ca53-config\") pod \"kube-apiserver-proxy-ip-10-0-136-90.ec2.internal\" (UID: \"beb4cae7aa98a7b51e62919b1f06ca53\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-90.ec2.internal" Jul 02 13:44:50.550197 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:50.550163 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-90.ec2.internal\" not found" Jul 02 13:44:50.650958 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:50.650895 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-90.ec2.internal\" not found" Jul 02 13:44:50.670381 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.670363 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-90.ec2.internal" Jul 02 13:44:50.674459 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:50.674440 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-90.ec2.internal" Jul 02 13:44:50.751709 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:50.751678 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-90.ec2.internal\" not found" Jul 02 13:44:50.852252 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:50.852220 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-90.ec2.internal\" not found" Jul 02 13:44:52.852101 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:52.852080 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-90.ec2.internal\" not found" Jul 02 13:44:52.885385 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:52.885365 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 13:44:52.952625 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:52.952597 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-90.ec2.internal\" not found" Jul 02 13:44:53.000065 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:53.000043 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 13:44:53.000606 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:53.000173 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 13:44:53.000606 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:53.000191 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 13:44:53.053466 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:53.053448 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-90.ec2.internal\" not found" Jul 02 13:44:53.078650 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:53.078585 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 13:44:53.097896 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:53.097865 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 13:39:52 +0000 UTC" deadline="2028-02-10 13:10:12.290982594 +0000 UTC" Jul 02 13:44:53.097896 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:53.097896 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14111h25m19.193090115s" Jul 02 13:44:53.140836 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:53.140812 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeb4cae7aa98a7b51e62919b1f06ca53.slice/crio-fbdb06ee02221081e0ff1ee075e2c18b931a8bc4eacecdf3441bffe06a7f2fe4 WatchSource:0}: Error finding container fbdb06ee02221081e0ff1ee075e2c18b931a8bc4eacecdf3441bffe06a7f2fe4: Status 404 returned error can't find the container with id fbdb06ee02221081e0ff1ee075e2c18b931a8bc4eacecdf3441bffe06a7f2fe4 Jul 02 13:44:53.141216 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:53.141198 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1b59b21137513387443ed9e348d0900.slice/crio-83b5534f10bcc9538b8fdf87026a5e90d42aaa3bec5926fc7029942459abd300 WatchSource:0}: Error finding container 83b5534f10bcc9538b8fdf87026a5e90d42aaa3bec5926fc7029942459abd300: Status 404 returned error can't find the container with id 83b5534f10bcc9538b8fdf87026a5e90d42aaa3bec5926fc7029942459abd300 Jul 02 13:44:53.145270 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:53.145254 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 13:44:53.160721 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:53.160699 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-90.ec2.internal" Jul 02 13:44:53.175511 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:53.173847 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 13:44:53.176403 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:53.176377 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-90.ec2.internal" Jul 02 13:44:53.185820 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:53.185806 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 13:44:53.336597 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:53.336535 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 13:44:54.036654 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.036624 2563 apiserver.go:52] "Watching apiserver" Jul 02 13:44:54.046699 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.045799 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 13:44:54.046699 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.046264 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-cww8g","openshift-multus/network-metrics-daemon-5wdg2","kube-system/global-pull-secret-syncer-pvpks","kube-system/konnectivity-agent-msksl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmhfl","openshift-network-diagnostics/network-check-target-cmpgv","openshift-network-operator/iptables-alerter-q47w9","openshift-ovn-kubernetes/ovnkube-node-lwl25","kube-system/kube-apiserver-proxy-ip-10-0-136-90.ec2.internal","openshift-cluster-node-tuning-operator/tuned-j4xlq","openshift-dns/node-resolver-ct2sf","openshift-image-registry/node-ca-w222x","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-90.ec2.internal","openshift-multus/multus-additional-cni-plugins-z97rv"] Jul 02 13:44:54.048041 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.048011 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q47w9" Jul 02 13:44:54.049233 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.049214 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ct2sf" Jul 02 13:44:54.051055 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.050584 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvpks" Jul 02 13:44:54.051055 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:54.050707 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvpks" podUID="6b2943b8-7b87-46b4-8141-cfe5464bc8ad" Jul 02 13:44:54.051249 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.051172 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 13:44:54.051407 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.051387 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 13:44:54.051681 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.051498 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tf7js\"" Jul 02 13:44:54.051681 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.051588 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 13:44:54.051853 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.051722 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-msksl" Jul 02 13:44:54.052309 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.052290 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-66zx7\"" Jul 02 13:44:54.052309 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.052307 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 13:44:54.052470 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.052454 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 13:44:54.052956 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.052920 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmhfl" Jul 02 13:44:54.054141 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.054088 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmpgv" Jul 02 13:44:54.054243 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:54.054157 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmpgv" podUID="43b79ed9-acd0-4973-828a-6b97b5ea8e0e" Jul 02 13:44:54.054620 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.054596 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kx89g\"" Jul 02 13:44:54.054725 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.054620 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 13:44:54.055689 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.055122 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 13:44:54.055689 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.055612 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 13:44:54.055689 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.055627 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z97rv" Jul 02 13:44:54.056019 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.055898 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 13:44:54.058900 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.058876 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 13:44:54.059161 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.059143 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-76s8s\"" Jul 02 13:44:54.059521 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.059505 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 13:44:54.059728 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.059713 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 13:44:54.060477 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.060464 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 13:44:54.061716 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.061696 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 13:44:54.061975 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.061959 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 13:44:54.062531 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.062507 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.064791 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.064771 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wdg2" Jul 02 13:44:54.064886 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:54.064846 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wdg2" podUID="74ca80fe-9892-41a5-9066-89f77be19c4c" Jul 02 13:44:54.065001 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.064984 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nhxgh\"" Jul 02 13:44:54.065079 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.065060 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 13:44:54.065458 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.065443 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dhs4w\"" Jul 02 13:44:54.066488 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.066098 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 13:44:54.066488 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.066314 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 13:44:54.066642 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.066582 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.067747 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.067729 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.070038 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.068992 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w222x" Jul 02 13:44:54.070038 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.069513 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 13:44:54.070038 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.069773 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 13:44:54.070913 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.070467 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 13:44:54.070913 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.070482 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 13:44:54.070913 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.070742 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 13:44:54.070913 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.070754 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6bc72\"" Jul 02 13:44:54.070913 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.070767 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzv9s\" (UniqueName: \"kubernetes.io/projected/e6707af2-c281-4e04-b547-eb1157b8db6a-kube-api-access-kzv9s\") pod \"aws-ebs-csi-driver-node-lmhfl\" (UID: \"e6707af2-c281-4e04-b547-eb1157b8db6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmhfl" Jul 02 13:44:54.070913 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.070787 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzngk\" (UniqueName: \"kubernetes.io/projected/43b79ed9-acd0-4973-828a-6b97b5ea8e0e-kube-api-access-tzngk\") pod \"network-check-target-cmpgv\" (UID: \"43b79ed9-acd0-4973-828a-6b97b5ea8e0e\") " pod="openshift-network-diagnostics/network-check-target-cmpgv" Jul 02 13:44:54.070913 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.070841 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx4gs\" (UniqueName: \"kubernetes.io/projected/3bea862f-27c7-4c10-aa1f-6324199447b4-kube-api-access-tx4gs\") pod \"multus-additional-cni-plugins-z97rv\" (UID: \"3bea862f-27c7-4c10-aa1f-6324199447b4\") " pod="openshift-multus/multus-additional-cni-plugins-z97rv" Jul 02 13:44:54.070913 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.070874 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-host-cni-bin\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.070913 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.070907 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ec310ba1-2060-44e4-afc5-0d8689c0879d-agent-certs\") pod \"konnectivity-agent-msksl\" (UID: \"ec310ba1-2060-44e4-afc5-0d8689c0879d\") " pod="kube-system/konnectivity-agent-msksl" Jul 02 13:44:54.071359 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.070951 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng525\" (UniqueName: \"kubernetes.io/projected/edf38c8b-844c-4ac9-983b-e9395bb86adc-kube-api-access-ng525\") pod \"node-resolver-ct2sf\" (UID: \"edf38c8b-844c-4ac9-983b-e9395bb86adc\") " pod="openshift-dns/node-resolver-ct2sf" Jul 02 13:44:54.071359 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.070974 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b2943b8-7b87-46b4-8141-cfe5464bc8ad-dbus\") pod \"global-pull-secret-syncer-pvpks\" (UID: \"6b2943b8-7b87-46b4-8141-cfe5464bc8ad\") " pod="kube-system/global-pull-secret-syncer-pvpks" Jul 02 13:44:54.071359 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.071001 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e6707af2-c281-4e04-b547-eb1157b8db6a-socket-dir\") pod \"aws-ebs-csi-driver-node-lmhfl\" (UID: \"e6707af2-c281-4e04-b547-eb1157b8db6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmhfl" Jul 02 13:44:54.071359 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.071036 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74ca80fe-9892-41a5-9066-89f77be19c4c-metrics-certs\") pod \"network-metrics-daemon-5wdg2\" (UID: \"74ca80fe-9892-41a5-9066-89f77be19c4c\") " pod="openshift-multus/network-metrics-daemon-5wdg2" Jul 02 13:44:54.071359 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.071072 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ec310ba1-2060-44e4-afc5-0d8689c0879d-konnectivity-ca\") pod \"konnectivity-agent-msksl\" (UID: \"ec310ba1-2060-44e4-afc5-0d8689c0879d\") " pod="kube-system/konnectivity-agent-msksl" Jul 02 13:44:54.071359 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.071101 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/edf38c8b-844c-4ac9-983b-e9395bb86adc-hosts-file\") pod \"node-resolver-ct2sf\" (UID: \"edf38c8b-844c-4ac9-983b-e9395bb86adc\") " pod="openshift-dns/node-resolver-ct2sf" Jul 02 13:44:54.071359 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.071126 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edf38c8b-844c-4ac9-983b-e9395bb86adc-tmp-dir\") pod \"node-resolver-ct2sf\" (UID: \"edf38c8b-844c-4ac9-983b-e9395bb86adc\") " pod="openshift-dns/node-resolver-ct2sf" Jul 02 13:44:54.071359 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.071148 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b2943b8-7b87-46b4-8141-cfe5464bc8ad-kubelet-config\") pod \"global-pull-secret-syncer-pvpks\" (UID: \"6b2943b8-7b87-46b4-8141-cfe5464bc8ad\") " pod="kube-system/global-pull-secret-syncer-pvpks" Jul 02 13:44:54.071359 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.071174 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3bea862f-27c7-4c10-aa1f-6324199447b4-cnibin\") pod \"multus-additional-cni-plugins-z97rv\" (UID: \"3bea862f-27c7-4c10-aa1f-6324199447b4\") " pod="openshift-multus/multus-additional-cni-plugins-z97rv" Jul 02 13:44:54.071359 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.071197 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-systemd-units\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.071359 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.071218 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-node-log\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.071359 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.071240 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-log-socket\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.071359 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.071262 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n9kq\" (UniqueName: \"kubernetes.io/projected/74ca80fe-9892-41a5-9066-89f77be19c4c-kube-api-access-5n9kq\") pod \"network-metrics-daemon-5wdg2\" (UID: \"74ca80fe-9892-41a5-9066-89f77be19c4c\") " pod="openshift-multus/network-metrics-daemon-5wdg2" Jul 02 13:44:54.071359 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.071285 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3bea862f-27c7-4c10-aa1f-6324199447b4-os-release\") pod \"multus-additional-cni-plugins-z97rv\" (UID: \"3bea862f-27c7-4c10-aa1f-6324199447b4\") " pod="openshift-multus/multus-additional-cni-plugins-z97rv" Jul 02 13:44:54.071359 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.071308 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e6707af2-c281-4e04-b547-eb1157b8db6a-device-dir\") pod \"aws-ebs-csi-driver-node-lmhfl\" (UID: \"e6707af2-c281-4e04-b547-eb1157b8db6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmhfl" Jul 02 13:44:54.071359 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.071330 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e6707af2-c281-4e04-b547-eb1157b8db6a-etc-selinux\") pod \"aws-ebs-csi-driver-node-lmhfl\" (UID: \"e6707af2-c281-4e04-b547-eb1157b8db6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmhfl" Jul 02 13:44:54.071921 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.071352 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e6707af2-c281-4e04-b547-eb1157b8db6a-sys-fs\") pod \"aws-ebs-csi-driver-node-lmhfl\" (UID: \"e6707af2-c281-4e04-b547-eb1157b8db6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmhfl" Jul 02 13:44:54.071921 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.071376 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3bea862f-27c7-4c10-aa1f-6324199447b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z97rv\" (UID: \"3bea862f-27c7-4c10-aa1f-6324199447b4\") " pod="openshift-multus/multus-additional-cni-plugins-z97rv" Jul 02 13:44:54.071921 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.071401 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-host-slash\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.071921 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.071422 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-host-cni-netd\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.071921 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.071444 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-ovn-node-metrics-cert\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.071921 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.071479 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3bea862f-27c7-4c10-aa1f-6324199447b4-system-cni-dir\") pod \"multus-additional-cni-plugins-z97rv\" (UID: \"3bea862f-27c7-4c10-aa1f-6324199447b4\") " pod="openshift-multus/multus-additional-cni-plugins-z97rv" Jul 02 13:44:54.071921 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.071516 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3bea862f-27c7-4c10-aa1f-6324199447b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-z97rv\" (UID: \"3bea862f-27c7-4c10-aa1f-6324199447b4\") " pod="openshift-multus/multus-additional-cni-plugins-z97rv" Jul 02 13:44:54.071921 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.071559 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-host-run-ovn-kubernetes\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.071921 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.071584 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glgxg\" (UniqueName: \"kubernetes.io/projected/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-kube-api-access-glgxg\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.071921 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.071610 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/531d4bde-e94d-4141-99d9-661b3b40d081-iptables-alerter-script\") pod \"iptables-alerter-q47w9\" (UID: \"531d4bde-e94d-4141-99d9-661b3b40d081\") " pod="openshift-network-operator/iptables-alerter-q47w9" Jul 02 13:44:54.071921 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.071634 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmsd7\" (UniqueName: \"kubernetes.io/projected/531d4bde-e94d-4141-99d9-661b3b40d081-kube-api-access-zmsd7\") pod \"iptables-alerter-q47w9\" (UID: \"531d4bde-e94d-4141-99d9-661b3b40d081\") " pod="openshift-network-operator/iptables-alerter-q47w9" Jul 02 13:44:54.071921 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.071698 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b2943b8-7b87-46b4-8141-cfe5464bc8ad-original-pull-secret\") pod \"global-pull-secret-syncer-pvpks\" (UID: \"6b2943b8-7b87-46b4-8141-cfe5464bc8ad\") " pod="kube-system/global-pull-secret-syncer-pvpks" Jul 02 13:44:54.071921 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.071727 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-run-systemd\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.071921 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.071788 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-etc-openvswitch\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.071921 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.071828 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e6707af2-c281-4e04-b547-eb1157b8db6a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lmhfl\" (UID: \"e6707af2-c281-4e04-b547-eb1157b8db6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmhfl" Jul 02 13:44:54.071921 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.071863 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3bea862f-27c7-4c10-aa1f-6324199447b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z97rv\" (UID: \"3bea862f-27c7-4c10-aa1f-6324199447b4\") " pod="openshift-multus/multus-additional-cni-plugins-z97rv" Jul 02 13:44:54.072501 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.071891 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3bea862f-27c7-4c10-aa1f-6324199447b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z97rv\" (UID: \"3bea862f-27c7-4c10-aa1f-6324199447b4\") " pod="openshift-multus/multus-additional-cni-plugins-z97rv" Jul 02 13:44:54.072501 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.071920 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-host-run-netns\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.072501 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.071966 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e6707af2-c281-4e04-b547-eb1157b8db6a-registration-dir\") pod \"aws-ebs-csi-driver-node-lmhfl\" (UID: \"e6707af2-c281-4e04-b547-eb1157b8db6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmhfl" Jul 02 13:44:54.072501 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.072000 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-var-lib-openvswitch\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.072501 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.072024 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-run-openvswitch\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.072501 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.072063 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-run-ovn\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.072501 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.072088 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.072501 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.072127 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-env-overrides\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.072501 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.072151 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-ovnkube-script-lib\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.072501 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.072164 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 13:44:54.072501 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.072187 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/531d4bde-e94d-4141-99d9-661b3b40d081-host-slash\") pod \"iptables-alerter-q47w9\" (UID: \"531d4bde-e94d-4141-99d9-661b3b40d081\") " pod="openshift-network-operator/iptables-alerter-q47w9" Jul 02 13:44:54.072501 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.072226 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-host-kubelet\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.072501 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.072247 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-ovnkube-config\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.072501 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.072357 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 13:44:54.073010 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.072531 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 13:44:54.073010 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.072548 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-v77np\"" Jul 02 13:44:54.073010 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.072668 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6dxrd\"" Jul 02 13:44:54.073173 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.073156 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 13:44:54.073230 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.073169 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 13:44:54.082531 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.082513 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 13:44:54.101027 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.101010 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2qtbh" Jul 02 13:44:54.109905 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.109886 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2qtbh" Jul 02 13:44:54.137796 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.137751 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-90.ec2.internal" event={"ID":"f1b59b21137513387443ed9e348d0900","Type":"ContainerStarted","Data":"83b5534f10bcc9538b8fdf87026a5e90d42aaa3bec5926fc7029942459abd300"} Jul 02 13:44:54.138840 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.138819 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-90.ec2.internal" event={"ID":"beb4cae7aa98a7b51e62919b1f06ca53","Type":"ContainerStarted","Data":"fbdb06ee02221081e0ff1ee075e2c18b931a8bc4eacecdf3441bffe06a7f2fe4"} Jul 02 13:44:54.161467 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.161446 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 13:44:54.172481 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.172455 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng525\" (UniqueName: \"kubernetes.io/projected/edf38c8b-844c-4ac9-983b-e9395bb86adc-kube-api-access-ng525\") pod \"node-resolver-ct2sf\" (UID: \"edf38c8b-844c-4ac9-983b-e9395bb86adc\") " pod="openshift-dns/node-resolver-ct2sf" Jul 02 13:44:54.172594 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.172493 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-run-systemd\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.172594 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.172521 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3bea862f-27c7-4c10-aa1f-6324199447b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z97rv\" (UID: \"3bea862f-27c7-4c10-aa1f-6324199447b4\") " pod="openshift-multus/multus-additional-cni-plugins-z97rv" Jul 02 13:44:54.172594 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.172545 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-host-run-netns\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.172594 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.172579 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-etc-kubernetes\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.172594 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.172579 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-run-systemd\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.172780 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.172600 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-host-run-netns\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.172780 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.172604 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e6707af2-c281-4e04-b547-eb1157b8db6a-registration-dir\") pod \"aws-ebs-csi-driver-node-lmhfl\" (UID: \"e6707af2-c281-4e04-b547-eb1157b8db6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmhfl" Jul 02 13:44:54.172780 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.172661 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e6707af2-c281-4e04-b547-eb1157b8db6a-registration-dir\") pod \"aws-ebs-csi-driver-node-lmhfl\" (UID: \"e6707af2-c281-4e04-b547-eb1157b8db6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmhfl" Jul 02 13:44:54.172780 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.172673 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-run-openvswitch\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.172780 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.172708 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-run-ovn\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.172780 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.172716 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-run-openvswitch\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.172780 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.172731 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-env-overrides\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.172780 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.172756 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1473d738-b887-415e-916f-93c9b845d73a-etc-sysctl-d\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.172780 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.172760 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-run-ovn\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.172780 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.172772 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1473d738-b887-415e-916f-93c9b845d73a-var-lib-kubelet\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.173306 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.172795 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-host-kubelet\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.173306 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.172821 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-ovnkube-config\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.173306 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.172846 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzv9s\" (UniqueName: \"kubernetes.io/projected/e6707af2-c281-4e04-b547-eb1157b8db6a-kube-api-access-kzv9s\") pod \"aws-ebs-csi-driver-node-lmhfl\" (UID: \"e6707af2-c281-4e04-b547-eb1157b8db6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmhfl" Jul 02 13:44:54.173306 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.172856 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-host-kubelet\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.173306 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.172871 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzngk\" (UniqueName: \"kubernetes.io/projected/43b79ed9-acd0-4973-828a-6b97b5ea8e0e-kube-api-access-tzngk\") pod \"network-check-target-cmpgv\" (UID: \"43b79ed9-acd0-4973-828a-6b97b5ea8e0e\") " pod="openshift-network-diagnostics/network-check-target-cmpgv" Jul 02 13:44:54.173306 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.172889 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-host-cni-bin\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.173306 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.172902 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1473d738-b887-415e-916f-93c9b845d73a-host\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.173306 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.172916 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-system-cni-dir\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.173306 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.172956 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74ca80fe-9892-41a5-9066-89f77be19c4c-metrics-certs\") pod \"network-metrics-daemon-5wdg2\" (UID: \"74ca80fe-9892-41a5-9066-89f77be19c4c\") " pod="openshift-multus/network-metrics-daemon-5wdg2" Jul 02 13:44:54.173306 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.172979 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/edf38c8b-844c-4ac9-983b-e9395bb86adc-hosts-file\") pod \"node-resolver-ct2sf\" (UID: \"edf38c8b-844c-4ac9-983b-e9395bb86adc\") " pod="openshift-dns/node-resolver-ct2sf" Jul 02 13:44:54.173306 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.172995 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-host-cni-bin\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.173306 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173002 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edf38c8b-844c-4ac9-983b-e9395bb86adc-tmp-dir\") pod \"node-resolver-ct2sf\" (UID: \"edf38c8b-844c-4ac9-983b-e9395bb86adc\") " pod="openshift-dns/node-resolver-ct2sf" Jul 02 13:44:54.173306 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173051 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b2943b8-7b87-46b4-8141-cfe5464bc8ad-kubelet-config\") pod \"global-pull-secret-syncer-pvpks\" (UID: \"6b2943b8-7b87-46b4-8141-cfe5464bc8ad\") " pod="kube-system/global-pull-secret-syncer-pvpks" Jul 02 13:44:54.173306 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173078 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3bea862f-27c7-4c10-aa1f-6324199447b4-cnibin\") pod \"multus-additional-cni-plugins-z97rv\" (UID: \"3bea862f-27c7-4c10-aa1f-6324199447b4\") " pod="openshift-multus/multus-additional-cni-plugins-z97rv" Jul 02 13:44:54.173306 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173099 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-systemd-units\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.173306 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173119 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-log-socket\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.173306 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173144 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n9kq\" (UniqueName: \"kubernetes.io/projected/74ca80fe-9892-41a5-9066-89f77be19c4c-kube-api-access-5n9kq\") pod \"network-metrics-daemon-5wdg2\" (UID: \"74ca80fe-9892-41a5-9066-89f77be19c4c\") " pod="openshift-multus/network-metrics-daemon-5wdg2" Jul 02 13:44:54.174090 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173168 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1473d738-b887-415e-916f-93c9b845d73a-etc-modprobe-d\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.174090 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:54.173172 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:44:54.174090 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173186 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3bea862f-27c7-4c10-aa1f-6324199447b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z97rv\" (UID: \"3bea862f-27c7-4c10-aa1f-6324199447b4\") " pod="openshift-multus/multus-additional-cni-plugins-z97rv" Jul 02 13:44:54.174090 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173196 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7qvl\" (UniqueName: \"kubernetes.io/projected/76001f3c-96f1-4e94-a8cd-0b7d575b2c4a-kube-api-access-v7qvl\") pod \"node-ca-w222x\" (UID: \"76001f3c-96f1-4e94-a8cd-0b7d575b2c4a\") " pod="openshift-image-registry/node-ca-w222x" Jul 02 13:44:54.174090 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173226 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e6707af2-c281-4e04-b547-eb1157b8db6a-device-dir\") pod \"aws-ebs-csi-driver-node-lmhfl\" (UID: \"e6707af2-c281-4e04-b547-eb1157b8db6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmhfl" Jul 02 13:44:54.174090 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:54.173247 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74ca80fe-9892-41a5-9066-89f77be19c4c-metrics-certs podName:74ca80fe-9892-41a5-9066-89f77be19c4c nodeName:}" failed. No retries permitted until 2026-07-02 13:44:54.673221953 +0000 UTC m=+2.953476485 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74ca80fe-9892-41a5-9066-89f77be19c4c-metrics-certs") pod "network-metrics-daemon-5wdg2" (UID: "74ca80fe-9892-41a5-9066-89f77be19c4c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:44:54.174090 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173275 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e6707af2-c281-4e04-b547-eb1157b8db6a-device-dir\") pod \"aws-ebs-csi-driver-node-lmhfl\" (UID: \"e6707af2-c281-4e04-b547-eb1157b8db6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmhfl" Jul 02 13:44:54.174090 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173282 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b2943b8-7b87-46b4-8141-cfe5464bc8ad-kubelet-config\") pod \"global-pull-secret-syncer-pvpks\" (UID: \"6b2943b8-7b87-46b4-8141-cfe5464bc8ad\") " pod="kube-system/global-pull-secret-syncer-pvpks" Jul 02 13:44:54.174090 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173286 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edf38c8b-844c-4ac9-983b-e9395bb86adc-tmp-dir\") pod \"node-resolver-ct2sf\" (UID: \"edf38c8b-844c-4ac9-983b-e9395bb86adc\") " pod="openshift-dns/node-resolver-ct2sf" Jul 02 13:44:54.174090 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173329 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-log-socket\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.174090 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173349 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3bea862f-27c7-4c10-aa1f-6324199447b4-cnibin\") pod \"multus-additional-cni-plugins-z97rv\" (UID: \"3bea862f-27c7-4c10-aa1f-6324199447b4\") " pod="openshift-multus/multus-additional-cni-plugins-z97rv" Jul 02 13:44:54.174090 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173361 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/edf38c8b-844c-4ac9-983b-e9395bb86adc-hosts-file\") pod \"node-resolver-ct2sf\" (UID: \"edf38c8b-844c-4ac9-983b-e9395bb86adc\") " pod="openshift-dns/node-resolver-ct2sf" Jul 02 13:44:54.174090 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173171 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-env-overrides\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.174090 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173376 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e6707af2-c281-4e04-b547-eb1157b8db6a-etc-selinux\") pod \"aws-ebs-csi-driver-node-lmhfl\" (UID: \"e6707af2-c281-4e04-b547-eb1157b8db6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmhfl" Jul 02 13:44:54.174090 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173397 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-systemd-units\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.174090 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173407 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e6707af2-c281-4e04-b547-eb1157b8db6a-sys-fs\") pod \"aws-ebs-csi-driver-node-lmhfl\" (UID: \"e6707af2-c281-4e04-b547-eb1157b8db6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmhfl" Jul 02 13:44:54.174090 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173423 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-host-cni-netd\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.174888 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173438 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/531d4bde-e94d-4141-99d9-661b3b40d081-iptables-alerter-script\") pod \"iptables-alerter-q47w9\" (UID: \"531d4bde-e94d-4141-99d9-661b3b40d081\") " pod="openshift-network-operator/iptables-alerter-q47w9" Jul 02 13:44:54.174888 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173446 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e6707af2-c281-4e04-b547-eb1157b8db6a-sys-fs\") pod \"aws-ebs-csi-driver-node-lmhfl\" (UID: \"e6707af2-c281-4e04-b547-eb1157b8db6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmhfl" Jul 02 13:44:54.174888 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173396 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-ovnkube-config\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.174888 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173457 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1473d738-b887-415e-916f-93c9b845d73a-lib-modules\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.174888 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173486 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-host-cni-netd\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.174888 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173489 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1473d738-b887-415e-916f-93c9b845d73a-etc-tuned\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.174888 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173497 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e6707af2-c281-4e04-b547-eb1157b8db6a-etc-selinux\") pod \"aws-ebs-csi-driver-node-lmhfl\" (UID: \"e6707af2-c281-4e04-b547-eb1157b8db6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmhfl" Jul 02 13:44:54.174888 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173516 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-host-run-k8s-cni-cncf-io\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.174888 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173544 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3bea862f-27c7-4c10-aa1f-6324199447b4-system-cni-dir\") pod \"multus-additional-cni-plugins-z97rv\" (UID: \"3bea862f-27c7-4c10-aa1f-6324199447b4\") " pod="openshift-multus/multus-additional-cni-plugins-z97rv" Jul 02 13:44:54.174888 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173567 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3bea862f-27c7-4c10-aa1f-6324199447b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-z97rv\" (UID: \"3bea862f-27c7-4c10-aa1f-6324199447b4\") " pod="openshift-multus/multus-additional-cni-plugins-z97rv" Jul 02 13:44:54.174888 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173591 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmsd7\" (UniqueName: \"kubernetes.io/projected/531d4bde-e94d-4141-99d9-661b3b40d081-kube-api-access-zmsd7\") pod \"iptables-alerter-q47w9\" (UID: \"531d4bde-e94d-4141-99d9-661b3b40d081\") " pod="openshift-network-operator/iptables-alerter-q47w9" Jul 02 13:44:54.174888 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173625 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3bea862f-27c7-4c10-aa1f-6324199447b4-system-cni-dir\") pod \"multus-additional-cni-plugins-z97rv\" (UID: \"3bea862f-27c7-4c10-aa1f-6324199447b4\") " pod="openshift-multus/multus-additional-cni-plugins-z97rv" Jul 02 13:44:54.174888 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173635 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1473d738-b887-415e-916f-93c9b845d73a-run\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.174888 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173661 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-multus-cni-dir\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.174888 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173684 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-host-var-lib-kubelet\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.174888 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173706 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qvvk\" (UniqueName: \"kubernetes.io/projected/225d1975-2316-4234-aca6-24f98acf4484-kube-api-access-6qvvk\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.174888 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173733 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-ovnkube-script-lib\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.175607 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173764 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/531d4bde-e94d-4141-99d9-661b3b40d081-host-slash\") pod \"iptables-alerter-q47w9\" (UID: \"531d4bde-e94d-4141-99d9-661b3b40d081\") " pod="openshift-network-operator/iptables-alerter-q47w9" Jul 02 13:44:54.175607 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173786 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b2943b8-7b87-46b4-8141-cfe5464bc8ad-dbus\") pod \"global-pull-secret-syncer-pvpks\" (UID: \"6b2943b8-7b87-46b4-8141-cfe5464bc8ad\") " pod="kube-system/global-pull-secret-syncer-pvpks" Jul 02 13:44:54.175607 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173793 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/531d4bde-e94d-4141-99d9-661b3b40d081-host-slash\") pod \"iptables-alerter-q47w9\" (UID: \"531d4bde-e94d-4141-99d9-661b3b40d081\") " pod="openshift-network-operator/iptables-alerter-q47w9" Jul 02 13:44:54.175607 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173808 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-etc-openvswitch\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.175607 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173841 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e6707af2-c281-4e04-b547-eb1157b8db6a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lmhfl\" (UID: \"e6707af2-c281-4e04-b547-eb1157b8db6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmhfl" Jul 02 13:44:54.175607 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173865 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3bea862f-27c7-4c10-aa1f-6324199447b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z97rv\" (UID: \"3bea862f-27c7-4c10-aa1f-6324199447b4\") " pod="openshift-multus/multus-additional-cni-plugins-z97rv" Jul 02 13:44:54.175607 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173889 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-var-lib-openvswitch\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.175607 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173894 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/531d4bde-e94d-4141-99d9-661b3b40d081-iptables-alerter-script\") pod \"iptables-alerter-q47w9\" (UID: \"531d4bde-e94d-4141-99d9-661b3b40d081\") " pod="openshift-network-operator/iptables-alerter-q47w9" Jul 02 13:44:54.175607 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173905 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b2943b8-7b87-46b4-8141-cfe5464bc8ad-dbus\") pod \"global-pull-secret-syncer-pvpks\" (UID: \"6b2943b8-7b87-46b4-8141-cfe5464bc8ad\") " pod="kube-system/global-pull-secret-syncer-pvpks" Jul 02 13:44:54.175607 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173913 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.175607 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173961 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1473d738-b887-415e-916f-93c9b845d73a-etc-sysconfig\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.175607 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173968 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.175607 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173973 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e6707af2-c281-4e04-b547-eb1157b8db6a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lmhfl\" (UID: \"e6707af2-c281-4e04-b547-eb1157b8db6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmhfl" Jul 02 13:44:54.175607 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173915 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-etc-openvswitch\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.175607 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.173975 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-var-lib-openvswitch\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.175607 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174013 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1473d738-b887-415e-916f-93c9b845d73a-tmp\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.175607 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174037 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-cnibin\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.176299 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174056 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3bea862f-27c7-4c10-aa1f-6324199447b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-z97rv\" (UID: \"3bea862f-27c7-4c10-aa1f-6324199447b4\") " pod="openshift-multus/multus-additional-cni-plugins-z97rv" Jul 02 13:44:54.176299 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174059 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-multus-socket-dir-parent\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.176299 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174083 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-host-var-lib-cni-bin\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.176299 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174106 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-hostroot\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.176299 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174131 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx4gs\" (UniqueName: \"kubernetes.io/projected/3bea862f-27c7-4c10-aa1f-6324199447b4-kube-api-access-tx4gs\") pod \"multus-additional-cni-plugins-z97rv\" (UID: \"3bea862f-27c7-4c10-aa1f-6324199447b4\") " pod="openshift-multus/multus-additional-cni-plugins-z97rv" Jul 02 13:44:54.176299 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174160 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ec310ba1-2060-44e4-afc5-0d8689c0879d-agent-certs\") pod \"konnectivity-agent-msksl\" (UID: \"ec310ba1-2060-44e4-afc5-0d8689c0879d\") " pod="kube-system/konnectivity-agent-msksl" Jul 02 13:44:54.176299 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174181 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/225d1975-2316-4234-aca6-24f98acf4484-cni-binary-copy\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.176299 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174202 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e6707af2-c281-4e04-b547-eb1157b8db6a-socket-dir\") pod \"aws-ebs-csi-driver-node-lmhfl\" (UID: \"e6707af2-c281-4e04-b547-eb1157b8db6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmhfl" Jul 02 13:44:54.176299 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174230 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ec310ba1-2060-44e4-afc5-0d8689c0879d-konnectivity-ca\") pod \"konnectivity-agent-msksl\" (UID: \"ec310ba1-2060-44e4-afc5-0d8689c0879d\") " pod="kube-system/konnectivity-agent-msksl" Jul 02 13:44:54.176299 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174245 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1473d738-b887-415e-916f-93c9b845d73a-etc-kubernetes\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.176299 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174262 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1473d738-b887-415e-916f-93c9b845d73a-etc-sysctl-conf\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.176299 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174280 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1473d738-b887-415e-916f-93c9b845d73a-sys\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.176299 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174300 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-os-release\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.176299 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174367 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-multus-conf-dir\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.176299 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174365 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e6707af2-c281-4e04-b547-eb1157b8db6a-socket-dir\") pod \"aws-ebs-csi-driver-node-lmhfl\" (UID: \"e6707af2-c281-4e04-b547-eb1157b8db6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmhfl" Jul 02 13:44:54.176299 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174380 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3bea862f-27c7-4c10-aa1f-6324199447b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z97rv\" (UID: \"3bea862f-27c7-4c10-aa1f-6324199447b4\") " pod="openshift-multus/multus-additional-cni-plugins-z97rv" Jul 02 13:44:54.176299 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174420 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/76001f3c-96f1-4e94-a8cd-0b7d575b2c4a-serviceca\") pod \"node-ca-w222x\" (UID: \"76001f3c-96f1-4e94-a8cd-0b7d575b2c4a\") " pod="openshift-image-registry/node-ca-w222x" Jul 02 13:44:54.176877 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174455 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-node-log\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.176877 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174510 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1473d738-b887-415e-916f-93c9b845d73a-etc-systemd\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.176877 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174526 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-node-log\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.176877 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174536 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhp95\" (UniqueName: \"kubernetes.io/projected/1473d738-b887-415e-916f-93c9b845d73a-kube-api-access-zhp95\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.176877 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174576 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-host-run-multus-certs\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.176877 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174604 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3bea862f-27c7-4c10-aa1f-6324199447b4-os-release\") pod \"multus-additional-cni-plugins-z97rv\" (UID: \"3bea862f-27c7-4c10-aa1f-6324199447b4\") " pod="openshift-multus/multus-additional-cni-plugins-z97rv" Jul 02 13:44:54.176877 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174673 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 13:44:54.176877 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174714 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3bea862f-27c7-4c10-aa1f-6324199447b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z97rv\" (UID: \"3bea862f-27c7-4c10-aa1f-6324199447b4\") " pod="openshift-multus/multus-additional-cni-plugins-z97rv" Jul 02 13:44:54.176877 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174740 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-host-slash\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.176877 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174711 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3bea862f-27c7-4c10-aa1f-6324199447b4-os-release\") pod \"multus-additional-cni-plugins-z97rv\" (UID: \"3bea862f-27c7-4c10-aa1f-6324199447b4\") " pod="openshift-multus/multus-additional-cni-plugins-z97rv" Jul 02 13:44:54.176877 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174771 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-ovn-node-metrics-cert\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.176877 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174793 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-host-slash\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.176877 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174799 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-host-run-netns\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.176877 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174831 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-host-var-lib-cni-multus\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.176877 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174869 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/225d1975-2316-4234-aca6-24f98acf4484-multus-daemon-config\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.176877 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174874 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ec310ba1-2060-44e4-afc5-0d8689c0879d-konnectivity-ca\") pod \"konnectivity-agent-msksl\" (UID: \"ec310ba1-2060-44e4-afc5-0d8689c0879d\") " pod="kube-system/konnectivity-agent-msksl" Jul 02 13:44:54.176877 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174890 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-ovnkube-script-lib\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.177465 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174891 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/76001f3c-96f1-4e94-a8cd-0b7d575b2c4a-host\") pod \"node-ca-w222x\" (UID: \"76001f3c-96f1-4e94-a8cd-0b7d575b2c4a\") " pod="openshift-image-registry/node-ca-w222x" Jul 02 13:44:54.177465 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174910 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3bea862f-27c7-4c10-aa1f-6324199447b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z97rv\" (UID: \"3bea862f-27c7-4c10-aa1f-6324199447b4\") " pod="openshift-multus/multus-additional-cni-plugins-z97rv" Jul 02 13:44:54.177465 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174960 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-host-run-ovn-kubernetes\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.177465 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174986 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glgxg\" (UniqueName: \"kubernetes.io/projected/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-kube-api-access-glgxg\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.177465 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.174987 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-host-run-ovn-kubernetes\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.177465 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.175002 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b2943b8-7b87-46b4-8141-cfe5464bc8ad-original-pull-secret\") pod \"global-pull-secret-syncer-pvpks\" (UID: \"6b2943b8-7b87-46b4-8141-cfe5464bc8ad\") " pod="kube-system/global-pull-secret-syncer-pvpks" Jul 02 13:44:54.177465 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:54.175080 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 13:44:54.177465 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:54.175128 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b2943b8-7b87-46b4-8141-cfe5464bc8ad-original-pull-secret podName:6b2943b8-7b87-46b4-8141-cfe5464bc8ad nodeName:}" failed. No retries permitted until 2026-07-02 13:44:54.675111488 +0000 UTC m=+2.955365997 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b2943b8-7b87-46b4-8141-cfe5464bc8ad-original-pull-secret") pod "global-pull-secret-syncer-pvpks" (UID: "6b2943b8-7b87-46b4-8141-cfe5464bc8ad") : object "kube-system"/"original-pull-secret" not registered Jul 02 13:44:54.178156 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.178137 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ec310ba1-2060-44e4-afc5-0d8689c0879d-agent-certs\") pod \"konnectivity-agent-msksl\" (UID: \"ec310ba1-2060-44e4-afc5-0d8689c0879d\") " pod="kube-system/konnectivity-agent-msksl" Jul 02 13:44:54.179358 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.179339 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-ovn-node-metrics-cert\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.184640 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.184618 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzv9s\" (UniqueName: \"kubernetes.io/projected/e6707af2-c281-4e04-b547-eb1157b8db6a-kube-api-access-kzv9s\") pod \"aws-ebs-csi-driver-node-lmhfl\" (UID: \"e6707af2-c281-4e04-b547-eb1157b8db6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmhfl" Jul 02 13:44:54.185566 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.185547 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng525\" (UniqueName: \"kubernetes.io/projected/edf38c8b-844c-4ac9-983b-e9395bb86adc-kube-api-access-ng525\") pod \"node-resolver-ct2sf\" (UID: \"edf38c8b-844c-4ac9-983b-e9395bb86adc\") " pod="openshift-dns/node-resolver-ct2sf" Jul 02 13:44:54.185666 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:54.185649 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 13:44:54.185708 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:54.185676 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 13:44:54.185708 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:54.185687 2563 projected.go:196] Error preparing data for projected volume kube-api-access-tzngk for pod openshift-network-diagnostics/network-check-target-cmpgv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:44:54.185776 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:54.185735 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/43b79ed9-acd0-4973-828a-6b97b5ea8e0e-kube-api-access-tzngk podName:43b79ed9-acd0-4973-828a-6b97b5ea8e0e nodeName:}" failed. No retries permitted until 2026-07-02 13:44:54.685725891 +0000 UTC m=+2.965980411 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tzngk" (UniqueName: "kubernetes.io/projected/43b79ed9-acd0-4973-828a-6b97b5ea8e0e-kube-api-access-tzngk") pod "network-check-target-cmpgv" (UID: "43b79ed9-acd0-4973-828a-6b97b5ea8e0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:44:54.189323 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.189295 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n9kq\" (UniqueName: \"kubernetes.io/projected/74ca80fe-9892-41a5-9066-89f77be19c4c-kube-api-access-5n9kq\") pod \"network-metrics-daemon-5wdg2\" (UID: \"74ca80fe-9892-41a5-9066-89f77be19c4c\") " pod="openshift-multus/network-metrics-daemon-5wdg2" Jul 02 13:44:54.190072 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.190045 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx4gs\" (UniqueName: \"kubernetes.io/projected/3bea862f-27c7-4c10-aa1f-6324199447b4-kube-api-access-tx4gs\") pod \"multus-additional-cni-plugins-z97rv\" (UID: \"3bea862f-27c7-4c10-aa1f-6324199447b4\") " pod="openshift-multus/multus-additional-cni-plugins-z97rv" Jul 02 13:44:54.190147 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.190116 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmsd7\" (UniqueName: \"kubernetes.io/projected/531d4bde-e94d-4141-99d9-661b3b40d081-kube-api-access-zmsd7\") pod \"iptables-alerter-q47w9\" (UID: \"531d4bde-e94d-4141-99d9-661b3b40d081\") " pod="openshift-network-operator/iptables-alerter-q47w9" Jul 02 13:44:54.190425 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.190406 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glgxg\" (UniqueName: \"kubernetes.io/projected/5e965a2b-30ed-4337-aaa5-c3dd9744cafc-kube-api-access-glgxg\") pod \"ovnkube-node-lwl25\" (UID: \"5e965a2b-30ed-4337-aaa5-c3dd9744cafc\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.275279 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.275251 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1473d738-b887-415e-916f-93c9b845d73a-etc-modprobe-d\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.275390 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.275289 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7qvl\" (UniqueName: \"kubernetes.io/projected/76001f3c-96f1-4e94-a8cd-0b7d575b2c4a-kube-api-access-v7qvl\") pod \"node-ca-w222x\" (UID: \"76001f3c-96f1-4e94-a8cd-0b7d575b2c4a\") " pod="openshift-image-registry/node-ca-w222x" Jul 02 13:44:54.275390 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.275317 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1473d738-b887-415e-916f-93c9b845d73a-lib-modules\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.275759 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.275723 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1473d738-b887-415e-916f-93c9b845d73a-etc-modprobe-d\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.275917 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.275883 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1473d738-b887-415e-916f-93c9b845d73a-etc-tuned\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.276025 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.275970 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-host-run-k8s-cni-cncf-io\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.276087 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.276060 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1473d738-b887-415e-916f-93c9b845d73a-lib-modules\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.276136 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.276092 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1473d738-b887-415e-916f-93c9b845d73a-run\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.276136 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.276122 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-host-run-k8s-cni-cncf-io\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.276238 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.276218 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1473d738-b887-415e-916f-93c9b845d73a-run\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.276307 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.276291 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-multus-cni-dir\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.276353 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.276328 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-host-var-lib-kubelet\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.276397 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.276358 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qvvk\" (UniqueName: \"kubernetes.io/projected/225d1975-2316-4234-aca6-24f98acf4484-kube-api-access-6qvvk\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.276397 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.276391 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1473d738-b887-415e-916f-93c9b845d73a-etc-sysconfig\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.276484 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.276419 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1473d738-b887-415e-916f-93c9b845d73a-tmp\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.276484 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.276448 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-cnibin\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.276484 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.276478 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-multus-socket-dir-parent\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.276609 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.276507 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-host-var-lib-cni-bin\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.276609 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.276530 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-hostroot\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.276609 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.276559 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/225d1975-2316-4234-aca6-24f98acf4484-cni-binary-copy\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.276609 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.276591 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1473d738-b887-415e-916f-93c9b845d73a-etc-kubernetes\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.276852 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.276619 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1473d738-b887-415e-916f-93c9b845d73a-etc-sysctl-conf\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.276852 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.276652 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1473d738-b887-415e-916f-93c9b845d73a-sys\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.276852 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.276677 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-os-release\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.276852 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.276707 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-multus-conf-dir\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.276852 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.276737 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/76001f3c-96f1-4e94-a8cd-0b7d575b2c4a-serviceca\") pod \"node-ca-w222x\" (UID: \"76001f3c-96f1-4e94-a8cd-0b7d575b2c4a\") " pod="openshift-image-registry/node-ca-w222x" Jul 02 13:44:54.276852 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.276768 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1473d738-b887-415e-916f-93c9b845d73a-etc-systemd\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.276852 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.276798 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhp95\" (UniqueName: \"kubernetes.io/projected/1473d738-b887-415e-916f-93c9b845d73a-kube-api-access-zhp95\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.276852 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.276824 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-host-run-multus-certs\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.277202 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.276858 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-host-run-netns\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.277202 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.276913 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-host-var-lib-cni-multus\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.277202 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.276963 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/225d1975-2316-4234-aca6-24f98acf4484-multus-daemon-config\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.277202 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.276993 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/76001f3c-96f1-4e94-a8cd-0b7d575b2c4a-host\") pod \"node-ca-w222x\" (UID: \"76001f3c-96f1-4e94-a8cd-0b7d575b2c4a\") " pod="openshift-image-registry/node-ca-w222x" Jul 02 13:44:54.277202 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.277047 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-etc-kubernetes\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.277202 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.277081 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1473d738-b887-415e-916f-93c9b845d73a-etc-sysctl-d\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.277202 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.277111 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1473d738-b887-415e-916f-93c9b845d73a-var-lib-kubelet\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.277202 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.277162 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1473d738-b887-415e-916f-93c9b845d73a-host\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.277202 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.277193 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-system-cni-dir\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.277567 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.277314 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-system-cni-dir\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.277567 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.277385 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-multus-cni-dir\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.277567 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.277439 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-host-var-lib-kubelet\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.277567 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.277468 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-multus-conf-dir\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.277567 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.277521 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1473d738-b887-415e-916f-93c9b845d73a-etc-systemd\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.277813 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.277792 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-host-run-multus-certs\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.277869 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.277853 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-host-run-netns\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.277941 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.277911 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-host-var-lib-cni-multus\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.277984 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.277950 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/76001f3c-96f1-4e94-a8cd-0b7d575b2c4a-serviceca\") pod \"node-ca-w222x\" (UID: \"76001f3c-96f1-4e94-a8cd-0b7d575b2c4a\") " pod="openshift-image-registry/node-ca-w222x" Jul 02 13:44:54.278035 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.278007 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-etc-kubernetes\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.278151 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.278136 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1473d738-b887-415e-916f-93c9b845d73a-etc-sysctl-d\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.278212 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.278197 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1473d738-b887-415e-916f-93c9b845d73a-var-lib-kubelet\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.278269 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.278256 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1473d738-b887-415e-916f-93c9b845d73a-host\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.278323 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.278309 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-host-var-lib-cni-bin\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.278477 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.278460 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/225d1975-2316-4234-aca6-24f98acf4484-multus-daemon-config\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.278535 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.278494 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1473d738-b887-415e-916f-93c9b845d73a-etc-tuned\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.278535 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.278523 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/76001f3c-96f1-4e94-a8cd-0b7d575b2c4a-host\") pod \"node-ca-w222x\" (UID: \"76001f3c-96f1-4e94-a8cd-0b7d575b2c4a\") " pod="openshift-image-registry/node-ca-w222x" Jul 02 13:44:54.278632 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.278584 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-hostroot\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.278632 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.278619 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1473d738-b887-415e-916f-93c9b845d73a-etc-sysconfig\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.278632 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.278624 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-multus-socket-dir-parent\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.278779 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.278698 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-cnibin\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.278779 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.278760 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1473d738-b887-415e-916f-93c9b845d73a-sys\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.278779 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.278766 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1473d738-b887-415e-916f-93c9b845d73a-etc-sysctl-conf\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.278908 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.278825 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/225d1975-2316-4234-aca6-24f98acf4484-os-release\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.278908 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.278884 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1473d738-b887-415e-916f-93c9b845d73a-etc-kubernetes\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.279230 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.279211 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/225d1975-2316-4234-aca6-24f98acf4484-cni-binary-copy\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.280726 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.280703 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1473d738-b887-415e-916f-93c9b845d73a-tmp\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.286306 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.286287 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7qvl\" (UniqueName: \"kubernetes.io/projected/76001f3c-96f1-4e94-a8cd-0b7d575b2c4a-kube-api-access-v7qvl\") pod \"node-ca-w222x\" (UID: \"76001f3c-96f1-4e94-a8cd-0b7d575b2c4a\") " pod="openshift-image-registry/node-ca-w222x" Jul 02 13:44:54.287528 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.287470 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhp95\" (UniqueName: \"kubernetes.io/projected/1473d738-b887-415e-916f-93c9b845d73a-kube-api-access-zhp95\") pod \"tuned-j4xlq\" (UID: \"1473d738-b887-415e-916f-93c9b845d73a\") " pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.288652 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.288635 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qvvk\" (UniqueName: \"kubernetes.io/projected/225d1975-2316-4234-aca6-24f98acf4484-kube-api-access-6qvvk\") pod \"multus-cww8g\" (UID: \"225d1975-2316-4234-aca6-24f98acf4484\") " pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.364760 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.364730 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q47w9" Jul 02 13:44:54.374684 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.374645 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ct2sf" Jul 02 13:44:54.383490 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.383473 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-msksl" Jul 02 13:44:54.388981 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.388965 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmhfl" Jul 02 13:44:54.394398 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.394381 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z97rv" Jul 02 13:44:54.401062 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.401043 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:44:54.406682 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.406646 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" Jul 02 13:44:54.414300 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.414283 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cww8g" Jul 02 13:44:54.417951 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.417922 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w222x" Jul 02 13:44:54.514300 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.514278 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 13:44:54.679868 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.679805 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74ca80fe-9892-41a5-9066-89f77be19c4c-metrics-certs\") pod \"network-metrics-daemon-5wdg2\" (UID: \"74ca80fe-9892-41a5-9066-89f77be19c4c\") " pod="openshift-multus/network-metrics-daemon-5wdg2" Jul 02 13:44:54.679868 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.679851 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b2943b8-7b87-46b4-8141-cfe5464bc8ad-original-pull-secret\") pod \"global-pull-secret-syncer-pvpks\" (UID: \"6b2943b8-7b87-46b4-8141-cfe5464bc8ad\") " pod="kube-system/global-pull-secret-syncer-pvpks" Jul 02 13:44:54.680049 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:54.679959 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 13:44:54.680049 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:54.679965 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:44:54.680049 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:54.680007 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b2943b8-7b87-46b4-8141-cfe5464bc8ad-original-pull-secret podName:6b2943b8-7b87-46b4-8141-cfe5464bc8ad nodeName:}" failed. No retries permitted until 2026-07-02 13:44:55.679993892 +0000 UTC m=+3.960248400 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b2943b8-7b87-46b4-8141-cfe5464bc8ad-original-pull-secret") pod "global-pull-secret-syncer-pvpks" (UID: "6b2943b8-7b87-46b4-8141-cfe5464bc8ad") : object "kube-system"/"original-pull-secret" not registered Jul 02 13:44:54.680049 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:54.680021 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74ca80fe-9892-41a5-9066-89f77be19c4c-metrics-certs podName:74ca80fe-9892-41a5-9066-89f77be19c4c nodeName:}" failed. No retries permitted until 2026-07-02 13:44:55.680014205 +0000 UTC m=+3.960268713 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74ca80fe-9892-41a5-9066-89f77be19c4c-metrics-certs") pod "network-metrics-daemon-5wdg2" (UID: "74ca80fe-9892-41a5-9066-89f77be19c4c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:44:54.780963 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:54.780916 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzngk\" (UniqueName: \"kubernetes.io/projected/43b79ed9-acd0-4973-828a-6b97b5ea8e0e-kube-api-access-tzngk\") pod \"network-check-target-cmpgv\" (UID: \"43b79ed9-acd0-4973-828a-6b97b5ea8e0e\") " pod="openshift-network-diagnostics/network-check-target-cmpgv" Jul 02 13:44:54.781112 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:54.781068 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 13:44:54.781112 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:54.781088 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 13:44:54.781112 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:54.781097 2563 projected.go:196] Error preparing data for projected volume kube-api-access-tzngk for pod openshift-network-diagnostics/network-check-target-cmpgv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:44:54.781230 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:54.781154 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/43b79ed9-acd0-4973-828a-6b97b5ea8e0e-kube-api-access-tzngk podName:43b79ed9-acd0-4973-828a-6b97b5ea8e0e nodeName:}" failed. No retries permitted until 2026-07-02 13:44:55.781133925 +0000 UTC m=+4.061388434 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tzngk" (UniqueName: "kubernetes.io/projected/43b79ed9-acd0-4973-828a-6b97b5ea8e0e-kube-api-access-tzngk") pod "network-check-target-cmpgv" (UID: "43b79ed9-acd0-4973-828a-6b97b5ea8e0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:44:55.030010 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:55.029918 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod225d1975_2316_4234_aca6_24f98acf4484.slice/crio-d4e358869b16523dd83aad8b05ab0c8edc023be5c97a333d45d4925fe6b787ca WatchSource:0}: Error finding container d4e358869b16523dd83aad8b05ab0c8edc023be5c97a333d45d4925fe6b787ca: Status 404 returned error can't find the container with id d4e358869b16523dd83aad8b05ab0c8edc023be5c97a333d45d4925fe6b787ca Jul 02 13:44:55.031442 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:55.031230 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76001f3c_96f1_4e94_a8cd_0b7d575b2c4a.slice/crio-f8d5c4a4a530a8a5d1ced3ae6f1a69f847941731839ee53dcfb7dc36a5014110 WatchSource:0}: Error finding container f8d5c4a4a530a8a5d1ced3ae6f1a69f847941731839ee53dcfb7dc36a5014110: Status 404 returned error can't find the container with id f8d5c4a4a530a8a5d1ced3ae6f1a69f847941731839ee53dcfb7dc36a5014110 Jul 02 13:44:55.032178 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:55.032156 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod531d4bde_e94d_4141_99d9_661b3b40d081.slice/crio-662634307c418a637df93042342b79c0ee6472427bd0c2f61e544ca640ce7462 WatchSource:0}: Error finding container 662634307c418a637df93042342b79c0ee6472427bd0c2f61e544ca640ce7462: Status 404 returned error can't find the container with id 662634307c418a637df93042342b79c0ee6472427bd0c2f61e544ca640ce7462 Jul 02 13:44:55.033828 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:55.033804 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e965a2b_30ed_4337_aaa5_c3dd9744cafc.slice/crio-67282862f0b568151cfb6a459d3e2e707b43933b42b253808cf9162eaad559f3 WatchSource:0}: Error finding container 67282862f0b568151cfb6a459d3e2e707b43933b42b253808cf9162eaad559f3: Status 404 returned error can't find the container with id 67282862f0b568151cfb6a459d3e2e707b43933b42b253808cf9162eaad559f3 Jul 02 13:44:55.035187 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:55.035155 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1473d738_b887_415e_916f_93c9b845d73a.slice/crio-fc8347866361573d752cb61cc0c903c37dd5bad5f23aa1334bc9855c4471682c WatchSource:0}: Error finding container fc8347866361573d752cb61cc0c903c37dd5bad5f23aa1334bc9855c4471682c: Status 404 returned error can't find the container with id fc8347866361573d752cb61cc0c903c37dd5bad5f23aa1334bc9855c4471682c Jul 02 13:44:55.036221 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:44:55.036195 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec310ba1_2060_44e4_afc5_0d8689c0879d.slice/crio-99d9628f862d0a4a5391652e0066f3c31739fa33fd5c6c329f08c2e69cc8183f WatchSource:0}: Error finding container 99d9628f862d0a4a5391652e0066f3c31739fa33fd5c6c329f08c2e69cc8183f: Status 404 returned error can't find the container with id 99d9628f862d0a4a5391652e0066f3c31739fa33fd5c6c329f08c2e69cc8183f Jul 02 13:44:55.112331 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:55.112291 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 13:39:54 +0000 UTC" deadline="2028-01-12 17:25:22.111949823 +0000 UTC" Jul 02 13:44:55.112652 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:55.112332 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13419h40m26.999621346s" Jul 02 13:44:55.144388 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:55.144358 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-90.ec2.internal" event={"ID":"beb4cae7aa98a7b51e62919b1f06ca53","Type":"ContainerStarted","Data":"9c6c96e4262fe7c5ee5ec083a9fb7e654dfe8b65c3a39fef8af891a0ea8d5e0f"} Jul 02 13:44:55.148215 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:55.148189 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z97rv" event={"ID":"3bea862f-27c7-4c10-aa1f-6324199447b4","Type":"ContainerStarted","Data":"a98b4f883cd21d795a4bbe09f0c857ccfe5d715133e31fbd9051219f6400ebbb"} Jul 02 13:44:55.150068 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:55.150042 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ct2sf" event={"ID":"edf38c8b-844c-4ac9-983b-e9395bb86adc","Type":"ContainerStarted","Data":"f37433140f1c7f8996f02fa3377458b13d3349d729fa60009405418f9b8f0a1d"} Jul 02 13:44:55.151092 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:55.151073 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" event={"ID":"1473d738-b887-415e-916f-93c9b845d73a","Type":"ContainerStarted","Data":"fc8347866361573d752cb61cc0c903c37dd5bad5f23aa1334bc9855c4471682c"} Jul 02 13:44:55.152981 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:55.152960 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cww8g" event={"ID":"225d1975-2316-4234-aca6-24f98acf4484","Type":"ContainerStarted","Data":"d4e358869b16523dd83aad8b05ab0c8edc023be5c97a333d45d4925fe6b787ca"} Jul 02 13:44:55.158479 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:55.158460 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w222x" event={"ID":"76001f3c-96f1-4e94-a8cd-0b7d575b2c4a","Type":"ContainerStarted","Data":"f8d5c4a4a530a8a5d1ced3ae6f1a69f847941731839ee53dcfb7dc36a5014110"} Jul 02 13:44:55.159279 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:55.159241 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-90.ec2.internal" podStartSLOduration=2.159228061 podStartE2EDuration="2.159228061s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:44:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:44:55.159198005 +0000 UTC m=+3.439452551" watchObservedRunningTime="2026-07-02 13:44:55.159228061 +0000 UTC m=+3.439482592" Jul 02 13:44:55.160612 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:55.160591 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" event={"ID":"5e965a2b-30ed-4337-aaa5-c3dd9744cafc","Type":"ContainerStarted","Data":"67282862f0b568151cfb6a459d3e2e707b43933b42b253808cf9162eaad559f3"} Jul 02 13:44:55.161710 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:55.161692 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmhfl" event={"ID":"e6707af2-c281-4e04-b547-eb1157b8db6a","Type":"ContainerStarted","Data":"56e611b286083cc88b74614f831d7e64fb4339ab39f0210d2de8a58057ca811d"} Jul 02 13:44:55.163801 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:55.163776 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-msksl" event={"ID":"ec310ba1-2060-44e4-afc5-0d8689c0879d","Type":"ContainerStarted","Data":"99d9628f862d0a4a5391652e0066f3c31739fa33fd5c6c329f08c2e69cc8183f"} Jul 02 13:44:55.164655 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:55.164634 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q47w9" event={"ID":"531d4bde-e94d-4141-99d9-661b3b40d081","Type":"ContainerStarted","Data":"662634307c418a637df93042342b79c0ee6472427bd0c2f61e544ca640ce7462"} Jul 02 13:44:55.468066 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:55.467839 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 13:44:55.688765 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:55.687722 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b2943b8-7b87-46b4-8141-cfe5464bc8ad-original-pull-secret\") pod \"global-pull-secret-syncer-pvpks\" (UID: \"6b2943b8-7b87-46b4-8141-cfe5464bc8ad\") " pod="kube-system/global-pull-secret-syncer-pvpks" Jul 02 13:44:55.688765 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:55.687856 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74ca80fe-9892-41a5-9066-89f77be19c4c-metrics-certs\") pod \"network-metrics-daemon-5wdg2\" (UID: \"74ca80fe-9892-41a5-9066-89f77be19c4c\") " pod="openshift-multus/network-metrics-daemon-5wdg2" Jul 02 13:44:55.688765 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:55.688002 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:44:55.688765 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:55.688205 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74ca80fe-9892-41a5-9066-89f77be19c4c-metrics-certs podName:74ca80fe-9892-41a5-9066-89f77be19c4c nodeName:}" failed. No retries permitted until 2026-07-02 13:44:57.688186373 +0000 UTC m=+5.968440888 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74ca80fe-9892-41a5-9066-89f77be19c4c-metrics-certs") pod "network-metrics-daemon-5wdg2" (UID: "74ca80fe-9892-41a5-9066-89f77be19c4c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:44:55.688765 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:55.688640 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 13:44:55.688765 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:55.688685 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b2943b8-7b87-46b4-8141-cfe5464bc8ad-original-pull-secret podName:6b2943b8-7b87-46b4-8141-cfe5464bc8ad nodeName:}" failed. No retries permitted until 2026-07-02 13:44:57.688671538 +0000 UTC m=+5.968926050 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b2943b8-7b87-46b4-8141-cfe5464bc8ad-original-pull-secret") pod "global-pull-secret-syncer-pvpks" (UID: "6b2943b8-7b87-46b4-8141-cfe5464bc8ad") : object "kube-system"/"original-pull-secret" not registered Jul 02 13:44:55.788976 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:55.788230 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzngk\" (UniqueName: \"kubernetes.io/projected/43b79ed9-acd0-4973-828a-6b97b5ea8e0e-kube-api-access-tzngk\") pod \"network-check-target-cmpgv\" (UID: \"43b79ed9-acd0-4973-828a-6b97b5ea8e0e\") " pod="openshift-network-diagnostics/network-check-target-cmpgv" Jul 02 13:44:55.788976 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:55.788416 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 13:44:55.788976 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:55.788505 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 13:44:55.788976 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:55.788520 2563 projected.go:196] Error preparing data for projected volume kube-api-access-tzngk for pod openshift-network-diagnostics/network-check-target-cmpgv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:44:55.788976 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:55.788592 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/43b79ed9-acd0-4973-828a-6b97b5ea8e0e-kube-api-access-tzngk podName:43b79ed9-acd0-4973-828a-6b97b5ea8e0e nodeName:}" failed. No retries permitted until 2026-07-02 13:44:57.788559484 +0000 UTC m=+6.068813993 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tzngk" (UniqueName: "kubernetes.io/projected/43b79ed9-acd0-4973-828a-6b97b5ea8e0e-kube-api-access-tzngk") pod "network-check-target-cmpgv" (UID: "43b79ed9-acd0-4973-828a-6b97b5ea8e0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:44:56.113405 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:56.113311 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 13:39:54 +0000 UTC" deadline="2028-01-31 17:41:43.586528707 +0000 UTC" Jul 02 13:44:56.113405 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:56.113356 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13875h56m47.473177841s" Jul 02 13:44:56.133489 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:56.133041 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvpks" Jul 02 13:44:56.133489 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:56.133149 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wdg2" Jul 02 13:44:56.133489 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:56.133159 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvpks" podUID="6b2943b8-7b87-46b4-8141-cfe5464bc8ad" Jul 02 13:44:56.133489 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:56.133263 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wdg2" podUID="74ca80fe-9892-41a5-9066-89f77be19c4c" Jul 02 13:44:56.133489 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:56.133328 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmpgv" Jul 02 13:44:56.133489 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:56.133392 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmpgv" podUID="43b79ed9-acd0-4973-828a-6b97b5ea8e0e" Jul 02 13:44:56.183349 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:56.182684 2563 generic.go:356] "Generic (PLEG): container finished" podID="f1b59b21137513387443ed9e348d0900" containerID="7303ec87cbfbadaf84896f749433021871378a47b6ba00b04fb14a8fd2ba5a50" exitCode=0 Jul 02 13:44:56.183349 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:56.182753 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-90.ec2.internal" event={"ID":"f1b59b21137513387443ed9e348d0900","Type":"ContainerDied","Data":"7303ec87cbfbadaf84896f749433021871378a47b6ba00b04fb14a8fd2ba5a50"} Jul 02 13:44:57.198708 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:57.198668 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-90.ec2.internal" event={"ID":"f1b59b21137513387443ed9e348d0900","Type":"ContainerStarted","Data":"c1cc7dcbccf9e05ccc081278816b94f92cb95efe790225bd7f21ff8ddb5f40dd"} Jul 02 13:44:57.709389 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:57.709353 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b2943b8-7b87-46b4-8141-cfe5464bc8ad-original-pull-secret\") pod \"global-pull-secret-syncer-pvpks\" (UID: \"6b2943b8-7b87-46b4-8141-cfe5464bc8ad\") " pod="kube-system/global-pull-secret-syncer-pvpks" Jul 02 13:44:57.709568 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:57.709424 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74ca80fe-9892-41a5-9066-89f77be19c4c-metrics-certs\") pod \"network-metrics-daemon-5wdg2\" (UID: \"74ca80fe-9892-41a5-9066-89f77be19c4c\") " pod="openshift-multus/network-metrics-daemon-5wdg2" Jul 02 13:44:57.709641 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:57.709626 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:44:57.709699 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:57.709687 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74ca80fe-9892-41a5-9066-89f77be19c4c-metrics-certs podName:74ca80fe-9892-41a5-9066-89f77be19c4c nodeName:}" failed. No retries permitted until 2026-07-02 13:45:01.709669631 +0000 UTC m=+9.989924156 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74ca80fe-9892-41a5-9066-89f77be19c4c-metrics-certs") pod "network-metrics-daemon-5wdg2" (UID: "74ca80fe-9892-41a5-9066-89f77be19c4c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:44:57.710162 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:57.710132 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 13:44:57.710261 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:57.710183 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b2943b8-7b87-46b4-8141-cfe5464bc8ad-original-pull-secret podName:6b2943b8-7b87-46b4-8141-cfe5464bc8ad nodeName:}" failed. No retries permitted until 2026-07-02 13:45:01.710168752 +0000 UTC m=+9.990423277 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b2943b8-7b87-46b4-8141-cfe5464bc8ad-original-pull-secret") pod "global-pull-secret-syncer-pvpks" (UID: "6b2943b8-7b87-46b4-8141-cfe5464bc8ad") : object "kube-system"/"original-pull-secret" not registered Jul 02 13:44:57.811107 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:57.810415 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzngk\" (UniqueName: \"kubernetes.io/projected/43b79ed9-acd0-4973-828a-6b97b5ea8e0e-kube-api-access-tzngk\") pod \"network-check-target-cmpgv\" (UID: \"43b79ed9-acd0-4973-828a-6b97b5ea8e0e\") " pod="openshift-network-diagnostics/network-check-target-cmpgv" Jul 02 13:44:57.811107 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:57.810596 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 13:44:57.811107 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:57.810630 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 13:44:57.811107 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:57.810661 2563 projected.go:196] Error preparing data for projected volume kube-api-access-tzngk for pod openshift-network-diagnostics/network-check-target-cmpgv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:44:57.811107 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:57.810731 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/43b79ed9-acd0-4973-828a-6b97b5ea8e0e-kube-api-access-tzngk podName:43b79ed9-acd0-4973-828a-6b97b5ea8e0e nodeName:}" failed. No retries permitted until 2026-07-02 13:45:01.810712516 +0000 UTC m=+10.090967031 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tzngk" (UniqueName: "kubernetes.io/projected/43b79ed9-acd0-4973-828a-6b97b5ea8e0e-kube-api-access-tzngk") pod "network-check-target-cmpgv" (UID: "43b79ed9-acd0-4973-828a-6b97b5ea8e0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:44:58.135004 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:58.134875 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvpks" Jul 02 13:44:58.135160 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:58.135003 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvpks" podUID="6b2943b8-7b87-46b4-8141-cfe5464bc8ad" Jul 02 13:44:58.135160 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:58.135018 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmpgv" Jul 02 13:44:58.135160 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:58.135083 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmpgv" podUID="43b79ed9-acd0-4973-828a-6b97b5ea8e0e" Jul 02 13:44:58.135160 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:44:58.135136 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wdg2" Jul 02 13:44:58.135368 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:44:58.135206 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wdg2" podUID="74ca80fe-9892-41a5-9066-89f77be19c4c" Jul 02 13:45:00.133908 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:00.133182 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvpks" Jul 02 13:45:00.133908 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:00.133306 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvpks" podUID="6b2943b8-7b87-46b4-8141-cfe5464bc8ad" Jul 02 13:45:00.133908 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:00.133658 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmpgv" Jul 02 13:45:00.133908 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:00.133744 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmpgv" podUID="43b79ed9-acd0-4973-828a-6b97b5ea8e0e" Jul 02 13:45:00.133908 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:00.133792 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wdg2" Jul 02 13:45:00.133908 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:00.133865 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wdg2" podUID="74ca80fe-9892-41a5-9066-89f77be19c4c" Jul 02 13:45:01.743149 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:01.743114 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b2943b8-7b87-46b4-8141-cfe5464bc8ad-original-pull-secret\") pod \"global-pull-secret-syncer-pvpks\" (UID: \"6b2943b8-7b87-46b4-8141-cfe5464bc8ad\") " pod="kube-system/global-pull-secret-syncer-pvpks" Jul 02 13:45:01.743593 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:01.743176 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74ca80fe-9892-41a5-9066-89f77be19c4c-metrics-certs\") pod \"network-metrics-daemon-5wdg2\" (UID: \"74ca80fe-9892-41a5-9066-89f77be19c4c\") " pod="openshift-multus/network-metrics-daemon-5wdg2" Jul 02 13:45:01.743593 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:01.743328 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:45:01.743593 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:01.743388 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74ca80fe-9892-41a5-9066-89f77be19c4c-metrics-certs podName:74ca80fe-9892-41a5-9066-89f77be19c4c nodeName:}" failed. No retries permitted until 2026-07-02 13:45:09.743369089 +0000 UTC m=+18.023623617 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74ca80fe-9892-41a5-9066-89f77be19c4c-metrics-certs") pod "network-metrics-daemon-5wdg2" (UID: "74ca80fe-9892-41a5-9066-89f77be19c4c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:45:01.743808 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:01.743771 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 13:45:01.743956 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:01.743846 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b2943b8-7b87-46b4-8141-cfe5464bc8ad-original-pull-secret podName:6b2943b8-7b87-46b4-8141-cfe5464bc8ad nodeName:}" failed. No retries permitted until 2026-07-02 13:45:09.74382943 +0000 UTC m=+18.024083939 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b2943b8-7b87-46b4-8141-cfe5464bc8ad-original-pull-secret") pod "global-pull-secret-syncer-pvpks" (UID: "6b2943b8-7b87-46b4-8141-cfe5464bc8ad") : object "kube-system"/"original-pull-secret" not registered Jul 02 13:45:01.843969 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:01.843917 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzngk\" (UniqueName: \"kubernetes.io/projected/43b79ed9-acd0-4973-828a-6b97b5ea8e0e-kube-api-access-tzngk\") pod \"network-check-target-cmpgv\" (UID: \"43b79ed9-acd0-4973-828a-6b97b5ea8e0e\") " pod="openshift-network-diagnostics/network-check-target-cmpgv" Jul 02 13:45:01.844147 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:01.844109 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 13:45:01.844147 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:01.844129 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 13:45:01.844147 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:01.844142 2563 projected.go:196] Error preparing data for projected volume kube-api-access-tzngk for pod openshift-network-diagnostics/network-check-target-cmpgv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:45:01.844296 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:01.844195 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/43b79ed9-acd0-4973-828a-6b97b5ea8e0e-kube-api-access-tzngk podName:43b79ed9-acd0-4973-828a-6b97b5ea8e0e nodeName:}" failed. No retries permitted until 2026-07-02 13:45:09.844181468 +0000 UTC m=+18.124435976 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tzngk" (UniqueName: "kubernetes.io/projected/43b79ed9-acd0-4973-828a-6b97b5ea8e0e-kube-api-access-tzngk") pod "network-check-target-cmpgv" (UID: "43b79ed9-acd0-4973-828a-6b97b5ea8e0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:45:02.135682 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:02.135601 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvpks" Jul 02 13:45:02.135845 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:02.135736 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvpks" podUID="6b2943b8-7b87-46b4-8141-cfe5464bc8ad" Jul 02 13:45:02.136172 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:02.136151 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmpgv" Jul 02 13:45:02.136272 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:02.136248 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmpgv" podUID="43b79ed9-acd0-4973-828a-6b97b5ea8e0e" Jul 02 13:45:02.136330 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:02.136310 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wdg2" Jul 02 13:45:02.136434 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:02.136401 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wdg2" podUID="74ca80fe-9892-41a5-9066-89f77be19c4c" Jul 02 13:45:04.135822 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:04.135145 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wdg2" Jul 02 13:45:04.135822 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:04.135278 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wdg2" podUID="74ca80fe-9892-41a5-9066-89f77be19c4c" Jul 02 13:45:04.135822 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:04.135331 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvpks" Jul 02 13:45:04.135822 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:04.135394 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvpks" podUID="6b2943b8-7b87-46b4-8141-cfe5464bc8ad" Jul 02 13:45:04.135822 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:04.135432 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmpgv" Jul 02 13:45:04.135822 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:04.135489 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmpgv" podUID="43b79ed9-acd0-4973-828a-6b97b5ea8e0e" Jul 02 13:45:06.132846 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:06.132806 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmpgv" Jul 02 13:45:06.133232 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:06.132958 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmpgv" podUID="43b79ed9-acd0-4973-828a-6b97b5ea8e0e" Jul 02 13:45:06.133310 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:06.133287 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wdg2" Jul 02 13:45:06.133442 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:06.133381 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wdg2" podUID="74ca80fe-9892-41a5-9066-89f77be19c4c" Jul 02 13:45:06.133568 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:06.133518 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvpks" Jul 02 13:45:06.133638 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:06.133606 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvpks" podUID="6b2943b8-7b87-46b4-8141-cfe5464bc8ad" Jul 02 13:45:08.132774 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:08.132744 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmpgv" Jul 02 13:45:08.133233 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:08.132802 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wdg2" Jul 02 13:45:08.133233 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:08.132803 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvpks" Jul 02 13:45:08.133233 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:08.132888 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wdg2" podUID="74ca80fe-9892-41a5-9066-89f77be19c4c" Jul 02 13:45:08.133233 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:08.132999 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmpgv" podUID="43b79ed9-acd0-4973-828a-6b97b5ea8e0e" Jul 02 13:45:08.133233 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:08.133128 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvpks" podUID="6b2943b8-7b87-46b4-8141-cfe5464bc8ad" Jul 02 13:45:09.804612 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:09.804583 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b2943b8-7b87-46b4-8141-cfe5464bc8ad-original-pull-secret\") pod \"global-pull-secret-syncer-pvpks\" (UID: \"6b2943b8-7b87-46b4-8141-cfe5464bc8ad\") " pod="kube-system/global-pull-secret-syncer-pvpks" Jul 02 13:45:09.805083 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:09.804635 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74ca80fe-9892-41a5-9066-89f77be19c4c-metrics-certs\") pod \"network-metrics-daemon-5wdg2\" (UID: \"74ca80fe-9892-41a5-9066-89f77be19c4c\") " pod="openshift-multus/network-metrics-daemon-5wdg2" Jul 02 13:45:09.805083 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:09.804717 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 13:45:09.805083 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:09.804756 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:45:09.805083 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:09.804773 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b2943b8-7b87-46b4-8141-cfe5464bc8ad-original-pull-secret podName:6b2943b8-7b87-46b4-8141-cfe5464bc8ad nodeName:}" failed. No retries permitted until 2026-07-02 13:45:25.804758992 +0000 UTC m=+34.085013501 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b2943b8-7b87-46b4-8141-cfe5464bc8ad-original-pull-secret") pod "global-pull-secret-syncer-pvpks" (UID: "6b2943b8-7b87-46b4-8141-cfe5464bc8ad") : object "kube-system"/"original-pull-secret" not registered Jul 02 13:45:09.805083 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:09.804807 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74ca80fe-9892-41a5-9066-89f77be19c4c-metrics-certs podName:74ca80fe-9892-41a5-9066-89f77be19c4c nodeName:}" failed. No retries permitted until 2026-07-02 13:45:25.804789054 +0000 UTC m=+34.085043562 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74ca80fe-9892-41a5-9066-89f77be19c4c-metrics-certs") pod "network-metrics-daemon-5wdg2" (UID: "74ca80fe-9892-41a5-9066-89f77be19c4c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:45:09.905556 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:09.905527 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzngk\" (UniqueName: \"kubernetes.io/projected/43b79ed9-acd0-4973-828a-6b97b5ea8e0e-kube-api-access-tzngk\") pod \"network-check-target-cmpgv\" (UID: \"43b79ed9-acd0-4973-828a-6b97b5ea8e0e\") " pod="openshift-network-diagnostics/network-check-target-cmpgv" Jul 02 13:45:09.905684 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:09.905669 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 13:45:09.905720 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:09.905689 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 13:45:09.905720 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:09.905698 2563 projected.go:196] Error preparing data for projected volume kube-api-access-tzngk for pod openshift-network-diagnostics/network-check-target-cmpgv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:45:09.905803 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:09.905741 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/43b79ed9-acd0-4973-828a-6b97b5ea8e0e-kube-api-access-tzngk podName:43b79ed9-acd0-4973-828a-6b97b5ea8e0e nodeName:}" failed. No retries permitted until 2026-07-02 13:45:25.905728693 +0000 UTC m=+34.185983201 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tzngk" (UniqueName: "kubernetes.io/projected/43b79ed9-acd0-4973-828a-6b97b5ea8e0e-kube-api-access-tzngk") pod "network-check-target-cmpgv" (UID: "43b79ed9-acd0-4973-828a-6b97b5ea8e0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:45:10.132673 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:10.132642 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wdg2" Jul 02 13:45:10.132673 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:10.132673 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvpks" Jul 02 13:45:10.132836 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:10.132641 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmpgv" Jul 02 13:45:10.132836 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:10.132751 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wdg2" podUID="74ca80fe-9892-41a5-9066-89f77be19c4c" Jul 02 13:45:10.132836 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:10.132802 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmpgv" podUID="43b79ed9-acd0-4973-828a-6b97b5ea8e0e" Jul 02 13:45:10.132966 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:10.132870 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvpks" podUID="6b2943b8-7b87-46b4-8141-cfe5464bc8ad" Jul 02 13:45:12.135725 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:12.135413 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmpgv" Jul 02 13:45:12.135725 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:12.135518 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wdg2" Jul 02 13:45:12.135725 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:12.135531 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmpgv" podUID="43b79ed9-acd0-4973-828a-6b97b5ea8e0e" Jul 02 13:45:12.135725 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:12.135542 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvpks" Jul 02 13:45:12.135725 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:12.135616 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wdg2" podUID="74ca80fe-9892-41a5-9066-89f77be19c4c" Jul 02 13:45:12.135725 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:12.135690 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvpks" podUID="6b2943b8-7b87-46b4-8141-cfe5464bc8ad" Jul 02 13:45:14.135676 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:14.135500 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wdg2" Jul 02 13:45:14.136254 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:14.135567 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmpgv" Jul 02 13:45:14.136254 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:14.135763 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wdg2" podUID="74ca80fe-9892-41a5-9066-89f77be19c4c" Jul 02 13:45:14.136254 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:14.135871 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmpgv" podUID="43b79ed9-acd0-4973-828a-6b97b5ea8e0e" Jul 02 13:45:14.136254 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:14.135572 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvpks" Jul 02 13:45:14.136254 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:14.136008 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvpks" podUID="6b2943b8-7b87-46b4-8141-cfe5464bc8ad" Jul 02 13:45:14.253015 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:14.252977 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmhfl" event={"ID":"e6707af2-c281-4e04-b547-eb1157b8db6a","Type":"ContainerStarted","Data":"eabd60f6ecf643958b52d4dc736572fc8dea70c3f814583b81f9216dec8d2e73"} Jul 02 13:45:14.254367 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:14.254339 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-msksl" event={"ID":"ec310ba1-2060-44e4-afc5-0d8689c0879d","Type":"ContainerStarted","Data":"7442ea9f355a3275690acebe72adc0331b4ba9aac8e9fcd14fb9e30081d5a977"} Jul 02 13:45:14.256485 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:14.256332 2563 generic.go:356] "Generic (PLEG): container finished" podID="3bea862f-27c7-4c10-aa1f-6324199447b4" containerID="d37c6c81ffba8372f3a344157fa0a6e07116a46dbb4d8832710cf29d6e4eadda" exitCode=0 Jul 02 13:45:14.256485 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:14.256410 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z97rv" event={"ID":"3bea862f-27c7-4c10-aa1f-6324199447b4","Type":"ContainerDied","Data":"d37c6c81ffba8372f3a344157fa0a6e07116a46dbb4d8832710cf29d6e4eadda"} Jul 02 13:45:14.258261 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:14.258238 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ct2sf" event={"ID":"edf38c8b-844c-4ac9-983b-e9395bb86adc","Type":"ContainerStarted","Data":"bf4ebf1bc6e74b49deff4653f8a9961f00cbda5fa7277821219744216ac4066e"} Jul 02 13:45:14.259869 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:14.259851 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" event={"ID":"1473d738-b887-415e-916f-93c9b845d73a","Type":"ContainerStarted","Data":"e80bb00be46ee21bee44941fb1ce403f794cc2283a445e3c7e7e711ebc549f4d"} Jul 02 13:45:14.261368 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:14.261299 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cww8g" event={"ID":"225d1975-2316-4234-aca6-24f98acf4484","Type":"ContainerStarted","Data":"f76c7401447dd5f66ba6c58a62419f25d4082057439db758d77e862c15be411c"} Jul 02 13:45:14.262816 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:14.262793 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w222x" event={"ID":"76001f3c-96f1-4e94-a8cd-0b7d575b2c4a","Type":"ContainerStarted","Data":"ba787d90ffd39108ea200a80d6557c3d8f5935211cc5ff37109a40f00ee6d4cb"} Jul 02 13:45:14.339870 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:14.339829 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-90.ec2.internal" podStartSLOduration=21.339816496 podStartE2EDuration="21.339816496s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:44:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:44:57.216386181 +0000 UTC m=+5.496640729" watchObservedRunningTime="2026-07-02 13:45:14.339816496 +0000 UTC m=+22.620071025" Jul 02 13:45:14.374646 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:14.374599 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-msksl" podStartSLOduration=3.691096132 podStartE2EDuration="22.374584727s" totalImagesPullingTime="18.683488595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:45:14.340461608 +0000 UTC m=+22.620716137" watchObservedRunningTime="2026-07-02 13:45:14.374584727 +0000 UTC m=+22.654839254" Jul 02 13:45:14.402560 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:14.402525 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ct2sf" podStartSLOduration=3.664646471 podStartE2EDuration="22.402496088s" totalImagesPullingTime="18.737849617s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:45:14.401153123 +0000 UTC m=+22.681407653" watchObservedRunningTime="2026-07-02 13:45:14.402496088 +0000 UTC m=+22.682750617" Jul 02 13:45:14.402658 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:14.402587 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-w222x" podStartSLOduration=3.662938432 podStartE2EDuration="22.402583275s" totalImagesPullingTime="18.739644843s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:45:14.374753554 +0000 UTC m=+22.655008082" watchObservedRunningTime="2026-07-02 13:45:14.402583275 +0000 UTC m=+22.682837808" Jul 02 13:45:14.535396 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:14.535204 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-j4xlq" podStartSLOduration=3.797790369 podStartE2EDuration="22.535183902s" totalImagesPullingTime="18.737393533s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:45:14.499592523 +0000 UTC m=+22.779847054" watchObservedRunningTime="2026-07-02 13:45:14.535183902 +0000 UTC m=+22.815438434" Jul 02 13:45:14.535982 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:14.535841 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cww8g" podStartSLOduration=3.571137122 podStartE2EDuration="22.535826985s" totalImagesPullingTime="18.964689863s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:45:14.531817739 +0000 UTC m=+22.812072290" watchObservedRunningTime="2026-07-02 13:45:14.535826985 +0000 UTC m=+22.816081515" Jul 02 13:45:15.205406 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:15.205371 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-msksl" Jul 02 13:45:15.205991 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:15.205974 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-msksl" Jul 02 13:45:15.268301 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:15.268249 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwl25_5e965a2b-30ed-4337-aaa5-c3dd9744cafc/ovn-acl-logging/0.log" Jul 02 13:45:15.268685 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:15.268584 2563 generic.go:356] "Generic (PLEG): container finished" podID="5e965a2b-30ed-4337-aaa5-c3dd9744cafc" containerID="e72903c2c41daeab20ba421a929c55041f4bf4df3afec471db898d0de7f240f6" exitCode=1 Jul 02 13:45:15.268685 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:15.268617 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" event={"ID":"5e965a2b-30ed-4337-aaa5-c3dd9744cafc","Type":"ContainerStarted","Data":"8a8ede3aa550ef8ef8b4367b468ae180a74553cfd9e17d5488be10a38e4fc9a4"} Jul 02 13:45:15.268911 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:15.268706 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" event={"ID":"5e965a2b-30ed-4337-aaa5-c3dd9744cafc","Type":"ContainerStarted","Data":"051bde0bed44709e358e94c5aecc754229c3b690aa889825f67bb8b33fe59ea0"} Jul 02 13:45:15.268911 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:15.268756 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" event={"ID":"5e965a2b-30ed-4337-aaa5-c3dd9744cafc","Type":"ContainerStarted","Data":"b53784dbb8e1f15339ae9aea5a08c8bbef53ddb6a832e530e861485846acae60"} Jul 02 13:45:15.268911 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:15.268800 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" event={"ID":"5e965a2b-30ed-4337-aaa5-c3dd9744cafc","Type":"ContainerStarted","Data":"713fac9b8193c32953ad8cef667178fbc27705f2dff6a42e47ca898c30d1edd0"} Jul 02 13:45:15.268911 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:15.268846 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" event={"ID":"5e965a2b-30ed-4337-aaa5-c3dd9744cafc","Type":"ContainerDied","Data":"e72903c2c41daeab20ba421a929c55041f4bf4df3afec471db898d0de7f240f6"} Jul 02 13:45:15.268911 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:15.268894 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" event={"ID":"5e965a2b-30ed-4337-aaa5-c3dd9744cafc","Type":"ContainerStarted","Data":"ed391b5ab328c5851c35da4f016deb2d97e683970d752ac666752b7f03f31f81"} Jul 02 13:45:15.270470 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:15.270446 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q47w9" event={"ID":"531d4bde-e94d-4141-99d9-661b3b40d081","Type":"ContainerStarted","Data":"a1ea54e3910243eccc94485f75831ac5ded2d80974186ab5118bde6411b0355c"} Jul 02 13:45:15.342127 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:15.342104 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 13:45:16.132906 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:16.132310 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvpks" Jul 02 13:45:16.132906 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:16.132424 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvpks" podUID="6b2943b8-7b87-46b4-8141-cfe5464bc8ad" Jul 02 13:45:16.132906 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:16.132770 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmpgv" Jul 02 13:45:16.132906 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:16.132862 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmpgv" podUID="43b79ed9-acd0-4973-828a-6b97b5ea8e0e" Jul 02 13:45:16.133279 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:16.133018 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wdg2" Jul 02 13:45:16.133279 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:16.133133 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wdg2" podUID="74ca80fe-9892-41a5-9066-89f77be19c4c" Jul 02 13:45:16.134285 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:16.134203 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T13:45:15.342122184Z","UUID":"cceeb7b8-a0c5-4647-a7ec-e4fa7132c478","Handler":null,"Name":"","Endpoint":""} Jul 02 13:45:16.136085 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:16.136060 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 13:45:16.136182 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:16.136104 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 13:45:16.275018 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:16.274563 2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 02 13:45:16.275018 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:16.274574 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmhfl" event={"ID":"e6707af2-c281-4e04-b547-eb1157b8db6a","Type":"ContainerStarted","Data":"814652d8885938d7079c46c83d2e16664a76f9559650433c8533009cc2e3a98e"} Jul 02 13:45:17.279965 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:17.279582 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwl25_5e965a2b-30ed-4337-aaa5-c3dd9744cafc/ovn-acl-logging/0.log" Jul 02 13:45:17.280473 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:17.280346 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" event={"ID":"5e965a2b-30ed-4337-aaa5-c3dd9744cafc","Type":"ContainerStarted","Data":"fae7e918f5fe15dc978d5f1356a39c3373652138aeaa4dfb785f95ac88f223fe"} Jul 02 13:45:17.282590 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:17.282569 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmhfl" event={"ID":"e6707af2-c281-4e04-b547-eb1157b8db6a","Type":"ContainerStarted","Data":"2c1c8f72a314ad455974dddccd92319859a4c1f87d3627f9ed6f98d3a94c4219"} Jul 02 13:45:17.309641 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:17.309596 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-q47w9" podStartSLOduration=6.570562531 podStartE2EDuration="25.30957924s" totalImagesPullingTime="18.739016709s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:45:15.335841372 +0000 UTC m=+23.616095926" watchObservedRunningTime="2026-07-02 13:45:17.30957924 +0000 UTC m=+25.589833771" Jul 02 13:45:18.132948 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:18.132902 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvpks" Jul 02 13:45:18.133096 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:18.133015 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvpks" podUID="6b2943b8-7b87-46b4-8141-cfe5464bc8ad" Jul 02 13:45:18.133322 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:18.133307 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmpgv" Jul 02 13:45:18.133384 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:18.133371 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmpgv" podUID="43b79ed9-acd0-4973-828a-6b97b5ea8e0e" Jul 02 13:45:18.133524 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:18.133510 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wdg2" Jul 02 13:45:18.133608 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:18.133592 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wdg2" podUID="74ca80fe-9892-41a5-9066-89f77be19c4c" Jul 02 13:45:19.287737 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:19.287709 2563 generic.go:356] "Generic (PLEG): container finished" podID="3bea862f-27c7-4c10-aa1f-6324199447b4" containerID="2fa339aec52255821f203288861aad040b7e46dc34dfe5949b9ac36f3fc15168" exitCode=0 Jul 02 13:45:19.288214 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:19.287763 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z97rv" event={"ID":"3bea862f-27c7-4c10-aa1f-6324199447b4","Type":"ContainerDied","Data":"2fa339aec52255821f203288861aad040b7e46dc34dfe5949b9ac36f3fc15168"} Jul 02 13:45:19.320692 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:19.320547 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmhfl" podStartSLOduration=6.224722593 podStartE2EDuration="27.320533202s" totalImagesPullingTime="21.095810609s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:44:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:45:17.310604747 +0000 UTC m=+25.590859291" watchObservedRunningTime="2026-07-02 13:45:19.320533202 +0000 UTC m=+27.600787732" Jul 02 13:45:20.132368 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:20.132336 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wdg2" Jul 02 13:45:20.132494 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:20.132336 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvpks" Jul 02 13:45:20.132494 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:20.132451 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wdg2" podUID="74ca80fe-9892-41a5-9066-89f77be19c4c" Jul 02 13:45:20.132494 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:20.132467 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmpgv" Jul 02 13:45:20.132591 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:20.132555 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvpks" podUID="6b2943b8-7b87-46b4-8141-cfe5464bc8ad" Jul 02 13:45:20.132638 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:20.132622 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmpgv" podUID="43b79ed9-acd0-4973-828a-6b97b5ea8e0e" Jul 02 13:45:20.293219 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:20.293157 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwl25_5e965a2b-30ed-4337-aaa5-c3dd9744cafc/ovn-acl-logging/0.log" Jul 02 13:45:20.293658 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:20.293500 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" event={"ID":"5e965a2b-30ed-4337-aaa5-c3dd9744cafc","Type":"ContainerStarted","Data":"244ec536a089bf5f73272890896b6aab71521a92d24f581f809c2a82e5568a82"} Jul 02 13:45:20.293811 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:20.293790 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:45:20.293956 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:20.293921 2563 scope.go:117] "RemoveContainer" containerID="e72903c2c41daeab20ba421a929c55041f4bf4df3afec471db898d0de7f240f6" Jul 02 13:45:20.310023 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:20.310004 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:45:21.297324 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:21.297284 2563 generic.go:356] "Generic (PLEG): container finished" podID="3bea862f-27c7-4c10-aa1f-6324199447b4" containerID="78cea07e0edb2130ed02275b6a155f10ba427a5058ccfc7b97104138dc42d38a" exitCode=0 Jul 02 13:45:21.297804 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:21.297365 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z97rv" event={"ID":"3bea862f-27c7-4c10-aa1f-6324199447b4","Type":"ContainerDied","Data":"78cea07e0edb2130ed02275b6a155f10ba427a5058ccfc7b97104138dc42d38a"} Jul 02 13:45:21.301174 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:21.301154 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwl25_5e965a2b-30ed-4337-aaa5-c3dd9744cafc/ovn-acl-logging/0.log" Jul 02 13:45:21.301527 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:21.301508 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" event={"ID":"5e965a2b-30ed-4337-aaa5-c3dd9744cafc","Type":"ContainerStarted","Data":"ce8f520a3dd9bd6495d3f7a60545a5f415fbb099760090500b1817b518b7272e"} Jul 02 13:45:21.301719 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:21.301696 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:45:21.301816 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:21.301769 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:45:21.316505 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:21.316484 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:45:21.352634 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:21.352596 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" podStartSLOduration=10.174995025 podStartE2EDuration="29.352583621s" totalImagesPullingTime="19.177588596s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:45:21.350842981 +0000 UTC m=+29.631097510" watchObservedRunningTime="2026-07-02 13:45:21.352583621 +0000 UTC m=+29.632838151" Jul 02 13:45:21.358703 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:21.358686 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pvpks"] Jul 02 13:45:21.358811 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:21.358761 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvpks" Jul 02 13:45:21.358854 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:21.358834 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvpks" podUID="6b2943b8-7b87-46b4-8141-cfe5464bc8ad" Jul 02 13:45:21.361763 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:21.361737 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5wdg2"] Jul 02 13:45:21.361876 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:21.361840 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wdg2" Jul 02 13:45:21.361977 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:21.361956 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wdg2" podUID="74ca80fe-9892-41a5-9066-89f77be19c4c" Jul 02 13:45:21.362437 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:21.362415 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cmpgv"] Jul 02 13:45:21.362521 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:21.362500 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmpgv" Jul 02 13:45:21.362615 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:21.362585 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmpgv" podUID="43b79ed9-acd0-4973-828a-6b97b5ea8e0e" Jul 02 13:45:23.132396 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:23.132208 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmpgv" Jul 02 13:45:23.132905 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:23.132255 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wdg2" Jul 02 13:45:23.132905 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:23.132464 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmpgv" podUID="43b79ed9-acd0-4973-828a-6b97b5ea8e0e" Jul 02 13:45:23.132905 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:23.132577 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wdg2" podUID="74ca80fe-9892-41a5-9066-89f77be19c4c" Jul 02 13:45:23.132905 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:23.132257 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvpks" Jul 02 13:45:23.132905 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:23.132665 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvpks" podUID="6b2943b8-7b87-46b4-8141-cfe5464bc8ad" Jul 02 13:45:23.307813 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:23.307781 2563 generic.go:356] "Generic (PLEG): container finished" podID="3bea862f-27c7-4c10-aa1f-6324199447b4" containerID="607119ad0690f285c486f4e320a82f677af733bd64913a42c18aa96315e830e8" exitCode=0 Jul 02 13:45:23.307980 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:23.307862 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z97rv" event={"ID":"3bea862f-27c7-4c10-aa1f-6324199447b4","Type":"ContainerDied","Data":"607119ad0690f285c486f4e320a82f677af733bd64913a42c18aa96315e830e8"} Jul 02 13:45:24.068307 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:24.068280 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-msksl" Jul 02 13:45:24.068437 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:24.068425 2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 02 13:45:24.068960 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:24.068938 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-msksl" Jul 02 13:45:25.132565 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:25.132539 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmpgv" Jul 02 13:45:25.132565 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:25.132555 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wdg2" Jul 02 13:45:25.133255 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:25.132539 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvpks" Jul 02 13:45:25.133255 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:25.132651 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmpgv" podUID="43b79ed9-acd0-4973-828a-6b97b5ea8e0e" Jul 02 13:45:25.133255 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:25.132717 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvpks" podUID="6b2943b8-7b87-46b4-8141-cfe5464bc8ad" Jul 02 13:45:25.133255 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:25.132820 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wdg2" podUID="74ca80fe-9892-41a5-9066-89f77be19c4c" Jul 02 13:45:25.828969 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:25.828923 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b2943b8-7b87-46b4-8141-cfe5464bc8ad-original-pull-secret\") pod \"global-pull-secret-syncer-pvpks\" (UID: \"6b2943b8-7b87-46b4-8141-cfe5464bc8ad\") " pod="kube-system/global-pull-secret-syncer-pvpks" Jul 02 13:45:25.829140 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:25.828996 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74ca80fe-9892-41a5-9066-89f77be19c4c-metrics-certs\") pod \"network-metrics-daemon-5wdg2\" (UID: \"74ca80fe-9892-41a5-9066-89f77be19c4c\") " pod="openshift-multus/network-metrics-daemon-5wdg2" Jul 02 13:45:25.829140 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:25.829086 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 13:45:25.829250 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:25.829141 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:45:25.829250 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:25.829159 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b2943b8-7b87-46b4-8141-cfe5464bc8ad-original-pull-secret podName:6b2943b8-7b87-46b4-8141-cfe5464bc8ad nodeName:}" failed. No retries permitted until 2026-07-02 13:45:57.829140309 +0000 UTC m=+66.109394830 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b2943b8-7b87-46b4-8141-cfe5464bc8ad-original-pull-secret") pod "global-pull-secret-syncer-pvpks" (UID: "6b2943b8-7b87-46b4-8141-cfe5464bc8ad") : object "kube-system"/"original-pull-secret" not registered Jul 02 13:45:25.829250 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:25.829181 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74ca80fe-9892-41a5-9066-89f77be19c4c-metrics-certs podName:74ca80fe-9892-41a5-9066-89f77be19c4c nodeName:}" failed. No retries permitted until 2026-07-02 13:45:57.829168176 +0000 UTC m=+66.109422684 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74ca80fe-9892-41a5-9066-89f77be19c4c-metrics-certs") pod "network-metrics-daemon-5wdg2" (UID: "74ca80fe-9892-41a5-9066-89f77be19c4c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:45:25.929408 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:25.929325 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzngk\" (UniqueName: \"kubernetes.io/projected/43b79ed9-acd0-4973-828a-6b97b5ea8e0e-kube-api-access-tzngk\") pod \"network-check-target-cmpgv\" (UID: \"43b79ed9-acd0-4973-828a-6b97b5ea8e0e\") " pod="openshift-network-diagnostics/network-check-target-cmpgv" Jul 02 13:45:25.929551 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:25.929496 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 13:45:25.929551 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:25.929515 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 13:45:25.929551 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:25.929524 2563 projected.go:196] Error preparing data for projected volume kube-api-access-tzngk for pod openshift-network-diagnostics/network-check-target-cmpgv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:45:25.929671 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:25.929589 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/43b79ed9-acd0-4973-828a-6b97b5ea8e0e-kube-api-access-tzngk podName:43b79ed9-acd0-4973-828a-6b97b5ea8e0e nodeName:}" failed. No retries permitted until 2026-07-02 13:45:57.929570222 +0000 UTC m=+66.209824745 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tzngk" (UniqueName: "kubernetes.io/projected/43b79ed9-acd0-4973-828a-6b97b5ea8e0e-kube-api-access-tzngk") pod "network-check-target-cmpgv" (UID: "43b79ed9-acd0-4973-828a-6b97b5ea8e0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:45:27.132270 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.132238 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmpgv" Jul 02 13:45:27.132719 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.132273 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvpks" Jul 02 13:45:27.132719 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.132352 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wdg2" Jul 02 13:45:27.132719 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:27.132368 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmpgv" podUID="43b79ed9-acd0-4973-828a-6b97b5ea8e0e" Jul 02 13:45:27.132719 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:27.132433 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvpks" podUID="6b2943b8-7b87-46b4-8141-cfe5464bc8ad" Jul 02 13:45:27.132719 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:27.132523 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wdg2" podUID="74ca80fe-9892-41a5-9066-89f77be19c4c" Jul 02 13:45:27.569327 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.567786 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-90.ec2.internal" event="NodeReady" Jul 02 13:45:27.569327 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.567954 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 13:45:27.612448 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.612416 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-9dd8f84df-2kc75"] Jul 02 13:45:27.615142 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.615119 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:45:27.618044 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.617959 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 02 13:45:27.618486 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.618464 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 02 13:45:27.619632 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.619594 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 02 13:45:27.621498 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.620212 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dkwdr\"" Jul 02 13:45:27.625866 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.625840 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 02 13:45:27.628273 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.628251 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dmq79"] Jul 02 13:45:27.630257 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.630241 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dmq79" Jul 02 13:45:27.631423 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.631409 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9dd8f84df-2kc75"] Jul 02 13:45:27.631892 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.631876 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-m7v6r"] Jul 02 13:45:27.633493 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.633475 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m7v6r" Jul 02 13:45:27.633839 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.633816 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 13:45:27.633998 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.633980 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pnc7w\"" Jul 02 13:45:27.634070 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.634015 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 13:45:27.637305 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.637285 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 13:45:27.637440 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.637400 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 13:45:27.637513 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.637487 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 13:45:27.637910 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.637893 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mrnkk\"" Jul 02 13:45:27.646296 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.646266 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dmq79"] Jul 02 13:45:27.649166 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.649146 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m7v6r"] Jul 02 13:45:27.745177 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.745151 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nnwx\" (UniqueName: \"kubernetes.io/projected/69f44293-335f-4e2b-a89a-043917f44a10-kube-api-access-2nnwx\") pod \"ingress-canary-m7v6r\" (UID: \"69f44293-335f-4e2b-a89a-043917f44a10\") " pod="openshift-ingress-canary/ingress-canary-m7v6r" Jul 02 13:45:27.745334 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.745194 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-image-registry-private-configuration\") pod \"image-registry-9dd8f84df-2kc75\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:45:27.745334 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.745222 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gt9f\" (UniqueName: \"kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-kube-api-access-2gt9f\") pod \"image-registry-9dd8f84df-2kc75\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:45:27.745334 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.745280 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/888590ed-3122-4425-816a-1292d70e3086-config-volume\") pod \"dns-default-dmq79\" (UID: \"888590ed-3122-4425-816a-1292d70e3086\") " pod="openshift-dns/dns-default-dmq79" Jul 02 13:45:27.745475 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.745419 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69f44293-335f-4e2b-a89a-043917f44a10-cert\") pod \"ingress-canary-m7v6r\" (UID: \"69f44293-335f-4e2b-a89a-043917f44a10\") " pod="openshift-ingress-canary/ingress-canary-m7v6r" Jul 02 13:45:27.745475 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.745461 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-registry-certificates\") pod \"image-registry-9dd8f84df-2kc75\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:45:27.745539 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.745507 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-bound-sa-token\") pod \"image-registry-9dd8f84df-2kc75\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:45:27.745539 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.745533 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/888590ed-3122-4425-816a-1292d70e3086-tmp-dir\") pod \"dns-default-dmq79\" (UID: \"888590ed-3122-4425-816a-1292d70e3086\") " pod="openshift-dns/dns-default-dmq79" Jul 02 13:45:27.745623 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.745560 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zpsj\" (UniqueName: \"kubernetes.io/projected/888590ed-3122-4425-816a-1292d70e3086-kube-api-access-8zpsj\") pod \"dns-default-dmq79\" (UID: \"888590ed-3122-4425-816a-1292d70e3086\") " pod="openshift-dns/dns-default-dmq79" Jul 02 13:45:27.745623 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.745602 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-installation-pull-secrets\") pod \"image-registry-9dd8f84df-2kc75\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:45:27.745710 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.745672 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-registry-tls\") pod \"image-registry-9dd8f84df-2kc75\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:45:27.745756 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.745708 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-trusted-ca\") pod \"image-registry-9dd8f84df-2kc75\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:45:27.745756 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.745724 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/888590ed-3122-4425-816a-1292d70e3086-metrics-tls\") pod \"dns-default-dmq79\" (UID: \"888590ed-3122-4425-816a-1292d70e3086\") " pod="openshift-dns/dns-default-dmq79" Jul 02 13:45:27.745756 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.745753 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-ca-trust-extracted\") pod \"image-registry-9dd8f84df-2kc75\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:45:27.846111 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.846086 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-registry-certificates\") pod \"image-registry-9dd8f84df-2kc75\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:45:27.846180 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.846126 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-bound-sa-token\") pod \"image-registry-9dd8f84df-2kc75\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:45:27.846180 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.846152 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/888590ed-3122-4425-816a-1292d70e3086-tmp-dir\") pod \"dns-default-dmq79\" (UID: \"888590ed-3122-4425-816a-1292d70e3086\") " pod="openshift-dns/dns-default-dmq79" Jul 02 13:45:27.846281 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.846179 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zpsj\" (UniqueName: \"kubernetes.io/projected/888590ed-3122-4425-816a-1292d70e3086-kube-api-access-8zpsj\") pod \"dns-default-dmq79\" (UID: \"888590ed-3122-4425-816a-1292d70e3086\") " pod="openshift-dns/dns-default-dmq79" Jul 02 13:45:27.846281 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.846203 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-installation-pull-secrets\") pod \"image-registry-9dd8f84df-2kc75\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:45:27.846281 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.846243 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-registry-tls\") pod \"image-registry-9dd8f84df-2kc75\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:45:27.846411 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.846281 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-trusted-ca\") pod \"image-registry-9dd8f84df-2kc75\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:45:27.846411 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.846304 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/888590ed-3122-4425-816a-1292d70e3086-metrics-tls\") pod \"dns-default-dmq79\" (UID: \"888590ed-3122-4425-816a-1292d70e3086\") " pod="openshift-dns/dns-default-dmq79" Jul 02 13:45:27.846411 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.846348 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-ca-trust-extracted\") pod \"image-registry-9dd8f84df-2kc75\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:45:27.846411 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.846397 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nnwx\" (UniqueName: \"kubernetes.io/projected/69f44293-335f-4e2b-a89a-043917f44a10-kube-api-access-2nnwx\") pod \"ingress-canary-m7v6r\" (UID: \"69f44293-335f-4e2b-a89a-043917f44a10\") " pod="openshift-ingress-canary/ingress-canary-m7v6r" Jul 02 13:45:27.846597 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:27.846411 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 13:45:27.846597 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:27.846428 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9dd8f84df-2kc75: secret "image-registry-tls" not found Jul 02 13:45:27.846597 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.846439 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-image-registry-private-configuration\") pod \"image-registry-9dd8f84df-2kc75\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:45:27.846597 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.846479 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/888590ed-3122-4425-816a-1292d70e3086-tmp-dir\") pod \"dns-default-dmq79\" (UID: \"888590ed-3122-4425-816a-1292d70e3086\") " pod="openshift-dns/dns-default-dmq79" Jul 02 13:45:27.846597 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:27.846504 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-registry-tls podName:d2e7b7d2-3bda-42bf-b87f-62e9387872dc nodeName:}" failed. No retries permitted until 2026-07-02 13:45:28.346479024 +0000 UTC m=+36.626733555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-registry-tls") pod "image-registry-9dd8f84df-2kc75" (UID: "d2e7b7d2-3bda-42bf-b87f-62e9387872dc") : secret "image-registry-tls" not found Jul 02 13:45:27.846597 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.846523 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gt9f\" (UniqueName: \"kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-kube-api-access-2gt9f\") pod \"image-registry-9dd8f84df-2kc75\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:45:27.846597 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.846545 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/888590ed-3122-4425-816a-1292d70e3086-config-volume\") pod \"dns-default-dmq79\" (UID: \"888590ed-3122-4425-816a-1292d70e3086\") " pod="openshift-dns/dns-default-dmq79" Jul 02 13:45:27.846597 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:27.846568 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 13:45:27.846597 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.846583 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69f44293-335f-4e2b-a89a-043917f44a10-cert\") pod \"ingress-canary-m7v6r\" (UID: \"69f44293-335f-4e2b-a89a-043917f44a10\") " pod="openshift-ingress-canary/ingress-canary-m7v6r" Jul 02 13:45:27.846597 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:27.846612 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/888590ed-3122-4425-816a-1292d70e3086-metrics-tls podName:888590ed-3122-4425-816a-1292d70e3086 nodeName:}" failed. No retries permitted until 2026-07-02 13:45:28.346591254 +0000 UTC m=+36.626845791 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/888590ed-3122-4425-816a-1292d70e3086-metrics-tls") pod "dns-default-dmq79" (UID: "888590ed-3122-4425-816a-1292d70e3086") : secret "dns-default-metrics-tls" not found Jul 02 13:45:27.847113 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.846771 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-registry-certificates\") pod \"image-registry-9dd8f84df-2kc75\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:45:27.847286 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.847103 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-ca-trust-extracted\") pod \"image-registry-9dd8f84df-2kc75\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:45:27.847593 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.847556 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/888590ed-3122-4425-816a-1292d70e3086-config-volume\") pod \"dns-default-dmq79\" (UID: \"888590ed-3122-4425-816a-1292d70e3086\") " pod="openshift-dns/dns-default-dmq79" Jul 02 13:45:27.847703 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.847678 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-trusted-ca\") pod \"image-registry-9dd8f84df-2kc75\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:45:27.850916 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.850893 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-installation-pull-secrets\") pod \"image-registry-9dd8f84df-2kc75\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:45:27.851022 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.850899 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-image-registry-private-configuration\") pod \"image-registry-9dd8f84df-2kc75\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:45:27.851022 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.850948 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69f44293-335f-4e2b-a89a-043917f44a10-cert\") pod \"ingress-canary-m7v6r\" (UID: \"69f44293-335f-4e2b-a89a-043917f44a10\") " pod="openshift-ingress-canary/ingress-canary-m7v6r" Jul 02 13:45:27.860807 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.860783 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gt9f\" (UniqueName: \"kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-kube-api-access-2gt9f\") pod \"image-registry-9dd8f84df-2kc75\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:45:27.861404 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.861381 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-bound-sa-token\") pod \"image-registry-9dd8f84df-2kc75\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:45:27.872547 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.872520 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zpsj\" (UniqueName: \"kubernetes.io/projected/888590ed-3122-4425-816a-1292d70e3086-kube-api-access-8zpsj\") pod \"dns-default-dmq79\" (UID: \"888590ed-3122-4425-816a-1292d70e3086\") " pod="openshift-dns/dns-default-dmq79" Jul 02 13:45:27.894235 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.894169 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nnwx\" (UniqueName: \"kubernetes.io/projected/69f44293-335f-4e2b-a89a-043917f44a10-kube-api-access-2nnwx\") pod \"ingress-canary-m7v6r\" (UID: \"69f44293-335f-4e2b-a89a-043917f44a10\") " pod="openshift-ingress-canary/ingress-canary-m7v6r" Jul 02 13:45:27.940879 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.940852 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-msksl_ec310ba1-2060-44e4-afc5-0d8689c0879d/konnectivity-agent/0.log" limit=1024 Jul 02 13:45:27.947344 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:27.947319 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m7v6r" Jul 02 13:45:28.088161 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:28.088052 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m7v6r"] Jul 02 13:45:28.091245 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:45:28.091217 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69f44293_335f_4e2b_a89a_043917f44a10.slice/crio-942a7d1ad963f528d1369b3d8ee7a53a55d8243a1b1fff310cfa1b2e81aa1523 WatchSource:0}: Error finding container 942a7d1ad963f528d1369b3d8ee7a53a55d8243a1b1fff310cfa1b2e81aa1523: Status 404 returned error can't find the container with id 942a7d1ad963f528d1369b3d8ee7a53a55d8243a1b1fff310cfa1b2e81aa1523 Jul 02 13:45:28.099286 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:28.099260 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-msksl_ec310ba1-2060-44e4-afc5-0d8689c0879d/konnectivity-agent/0.log" limit=1024 Jul 02 13:45:28.323463 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:28.323381 2563 generic.go:356] "Generic (PLEG): container finished" podID="3bea862f-27c7-4c10-aa1f-6324199447b4" containerID="caa412b9ea3b031f2b2d4a6a3c27df9f5a6409d680aa59f71911ba152376fdfd" exitCode=0 Jul 02 13:45:28.323825 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:28.323476 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z97rv" event={"ID":"3bea862f-27c7-4c10-aa1f-6324199447b4","Type":"ContainerDied","Data":"caa412b9ea3b031f2b2d4a6a3c27df9f5a6409d680aa59f71911ba152376fdfd"} Jul 02 13:45:28.327464 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:28.327436 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m7v6r" event={"ID":"69f44293-335f-4e2b-a89a-043917f44a10","Type":"ContainerStarted","Data":"942a7d1ad963f528d1369b3d8ee7a53a55d8243a1b1fff310cfa1b2e81aa1523"} Jul 02 13:45:28.351422 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:28.351397 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/888590ed-3122-4425-816a-1292d70e3086-metrics-tls\") pod \"dns-default-dmq79\" (UID: \"888590ed-3122-4425-816a-1292d70e3086\") " pod="openshift-dns/dns-default-dmq79" Jul 02 13:45:28.351547 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:28.351508 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-registry-tls\") pod \"image-registry-9dd8f84df-2kc75\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:45:28.351605 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:28.351554 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 13:45:28.351649 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:28.351612 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/888590ed-3122-4425-816a-1292d70e3086-metrics-tls podName:888590ed-3122-4425-816a-1292d70e3086 nodeName:}" failed. No retries permitted until 2026-07-02 13:45:29.351592855 +0000 UTC m=+37.631847378 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/888590ed-3122-4425-816a-1292d70e3086-metrics-tls") pod "dns-default-dmq79" (UID: "888590ed-3122-4425-816a-1292d70e3086") : secret "dns-default-metrics-tls" not found Jul 02 13:45:28.351649 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:28.351622 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 13:45:28.351649 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:28.351635 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9dd8f84df-2kc75: secret "image-registry-tls" not found Jul 02 13:45:28.351853 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:28.351679 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-registry-tls podName:d2e7b7d2-3bda-42bf-b87f-62e9387872dc nodeName:}" failed. No retries permitted until 2026-07-02 13:45:29.351663489 +0000 UTC m=+37.631918000 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-registry-tls") pod "image-registry-9dd8f84df-2kc75" (UID: "d2e7b7d2-3bda-42bf-b87f-62e9387872dc") : secret "image-registry-tls" not found Jul 02 13:45:29.132174 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:29.132094 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvpks" Jul 02 13:45:29.132322 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:29.132111 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wdg2" Jul 02 13:45:29.132322 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:29.132111 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmpgv" Jul 02 13:45:29.135431 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:29.135410 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 13:45:29.135712 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:29.135684 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 13:45:29.136857 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:29.136735 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7vs28\"" Jul 02 13:45:29.136857 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:29.136752 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 13:45:29.136857 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:29.136753 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 13:45:29.136857 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:29.136803 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4vzgw\"" Jul 02 13:45:29.333639 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:29.333599 2563 generic.go:356] "Generic (PLEG): container finished" podID="3bea862f-27c7-4c10-aa1f-6324199447b4" containerID="dd727ea7d04bad4f3f69a96697060e94f1ae190d44dae6d026f6e83d89158d11" exitCode=0 Jul 02 13:45:29.334043 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:29.333648 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z97rv" event={"ID":"3bea862f-27c7-4c10-aa1f-6324199447b4","Type":"ContainerDied","Data":"dd727ea7d04bad4f3f69a96697060e94f1ae190d44dae6d026f6e83d89158d11"} Jul 02 13:45:29.360126 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:29.359893 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-registry-tls\") pod \"image-registry-9dd8f84df-2kc75\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:45:29.360231 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:29.360163 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/888590ed-3122-4425-816a-1292d70e3086-metrics-tls\") pod \"dns-default-dmq79\" (UID: \"888590ed-3122-4425-816a-1292d70e3086\") " pod="openshift-dns/dns-default-dmq79" Jul 02 13:45:29.360331 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:29.360042 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 13:45:29.360410 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:29.360334 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9dd8f84df-2kc75: secret "image-registry-tls" not found Jul 02 13:45:29.360461 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:29.360436 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-registry-tls podName:d2e7b7d2-3bda-42bf-b87f-62e9387872dc nodeName:}" failed. No retries permitted until 2026-07-02 13:45:31.360419376 +0000 UTC m=+39.640673900 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-registry-tls") pod "image-registry-9dd8f84df-2kc75" (UID: "d2e7b7d2-3bda-42bf-b87f-62e9387872dc") : secret "image-registry-tls" not found Jul 02 13:45:29.360729 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:29.360315 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 13:45:29.360843 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:29.360765 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/888590ed-3122-4425-816a-1292d70e3086-metrics-tls podName:888590ed-3122-4425-816a-1292d70e3086 nodeName:}" failed. No retries permitted until 2026-07-02 13:45:31.360747774 +0000 UTC m=+39.641002284 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/888590ed-3122-4425-816a-1292d70e3086-metrics-tls") pod "dns-default-dmq79" (UID: "888590ed-3122-4425-816a-1292d70e3086") : secret "dns-default-metrics-tls" not found Jul 02 13:45:30.340512 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:30.340479 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z97rv" event={"ID":"3bea862f-27c7-4c10-aa1f-6324199447b4","Type":"ContainerStarted","Data":"a5c0bf90bf076ad51d4835680a84c8419f32286b7edb0ea559dc45d7e52830d7"} Jul 02 13:45:30.522854 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:30.522816 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-msksl_ec310ba1-2060-44e4-afc5-0d8689c0879d/konnectivity-agent/0.log" limit=1024 Jul 02 13:45:30.592519 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:30.592439 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-msksl_ec310ba1-2060-44e4-afc5-0d8689c0879d/konnectivity-agent/0.log" limit=1024 Jul 02 13:45:31.323908 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:31.323829 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-msksl_ec310ba1-2060-44e4-afc5-0d8689c0879d/konnectivity-agent/0.log" limit=1024 Jul 02 13:45:31.343669 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:31.343643 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m7v6r" event={"ID":"69f44293-335f-4e2b-a89a-043917f44a10","Type":"ContainerStarted","Data":"22ce2917922b4ab960cc0ceca6c7dbe2f7b8451b8b77f2f5e26c8f8f5e68b8d4"} Jul 02 13:45:31.363642 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:31.363599 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-z97rv" podStartSLOduration=9.3417375 podStartE2EDuration="39.363582692s" totalImagesPullingTime="30.021845192s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:44:52 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:45:30.375462224 +0000 UTC m=+38.655716772" watchObservedRunningTime="2026-07-02 13:45:31.363582692 +0000 UTC m=+39.643837222" Jul 02 13:45:31.363782 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:31.363761 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-m7v6r" podStartSLOduration=1.391714473 podStartE2EDuration="4.3637552s" totalImagesPullingTime="2.972040727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:45:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:45:31.363016623 +0000 UTC m=+39.643271163" watchObservedRunningTime="2026-07-02 13:45:31.3637552 +0000 UTC m=+39.644009730" Jul 02 13:45:31.377801 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:31.377772 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-registry-tls\") pod \"image-registry-9dd8f84df-2kc75\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:45:31.377899 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:31.377813 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/888590ed-3122-4425-816a-1292d70e3086-metrics-tls\") pod \"dns-default-dmq79\" (UID: \"888590ed-3122-4425-816a-1292d70e3086\") " pod="openshift-dns/dns-default-dmq79" Jul 02 13:45:31.377978 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:31.377898 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 13:45:31.377978 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:31.377909 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 13:45:31.377978 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:31.377955 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9dd8f84df-2kc75: secret "image-registry-tls" not found Jul 02 13:45:31.377978 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:31.377963 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/888590ed-3122-4425-816a-1292d70e3086-metrics-tls podName:888590ed-3122-4425-816a-1292d70e3086 nodeName:}" failed. No retries permitted until 2026-07-02 13:45:35.377949428 +0000 UTC m=+43.658203941 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/888590ed-3122-4425-816a-1292d70e3086-metrics-tls") pod "dns-default-dmq79" (UID: "888590ed-3122-4425-816a-1292d70e3086") : secret "dns-default-metrics-tls" not found Jul 02 13:45:31.378118 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:31.378002 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-registry-tls podName:d2e7b7d2-3bda-42bf-b87f-62e9387872dc nodeName:}" failed. No retries permitted until 2026-07-02 13:45:35.377990401 +0000 UTC m=+43.658244909 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-registry-tls") pod "image-registry-9dd8f84df-2kc75" (UID: "d2e7b7d2-3bda-42bf-b87f-62e9387872dc") : secret "image-registry-tls" not found Jul 02 13:45:34.927121 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:34.927091 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-msksl_ec310ba1-2060-44e4-afc5-0d8689c0879d/konnectivity-agent/0.log" limit=1024 Jul 02 13:45:35.029184 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:35.029146 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-msksl_ec310ba1-2060-44e4-afc5-0d8689c0879d/konnectivity-agent/0.log" limit=1024 Jul 02 13:45:35.408141 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:35.408102 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-registry-tls\") pod \"image-registry-9dd8f84df-2kc75\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:45:35.408299 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:35.408152 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/888590ed-3122-4425-816a-1292d70e3086-metrics-tls\") pod \"dns-default-dmq79\" (UID: \"888590ed-3122-4425-816a-1292d70e3086\") " pod="openshift-dns/dns-default-dmq79" Jul 02 13:45:35.408299 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:35.408259 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 13:45:35.408299 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:35.408277 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9dd8f84df-2kc75: secret "image-registry-tls" not found Jul 02 13:45:35.408408 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:35.408312 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 13:45:35.408408 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:35.408330 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-registry-tls podName:d2e7b7d2-3bda-42bf-b87f-62e9387872dc nodeName:}" failed. No retries permitted until 2026-07-02 13:45:43.408315143 +0000 UTC m=+51.688569651 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-registry-tls") pod "image-registry-9dd8f84df-2kc75" (UID: "d2e7b7d2-3bda-42bf-b87f-62e9387872dc") : secret "image-registry-tls" not found Jul 02 13:45:35.408408 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:35.408363 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/888590ed-3122-4425-816a-1292d70e3086-metrics-tls podName:888590ed-3122-4425-816a-1292d70e3086 nodeName:}" failed. No retries permitted until 2026-07-02 13:45:43.408350614 +0000 UTC m=+51.688605123 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/888590ed-3122-4425-816a-1292d70e3086-metrics-tls") pod "dns-default-dmq79" (UID: "888590ed-3122-4425-816a-1292d70e3086") : secret "dns-default-metrics-tls" not found Jul 02 13:45:43.459320 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:43.459230 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-registry-tls\") pod \"image-registry-9dd8f84df-2kc75\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:45:43.459320 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:43.459275 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/888590ed-3122-4425-816a-1292d70e3086-metrics-tls\") pod \"dns-default-dmq79\" (UID: \"888590ed-3122-4425-816a-1292d70e3086\") " pod="openshift-dns/dns-default-dmq79" Jul 02 13:45:43.459745 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:43.459371 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 13:45:43.459745 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:43.459375 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 13:45:43.459745 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:43.459394 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9dd8f84df-2kc75: secret "image-registry-tls" not found Jul 02 13:45:43.459745 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:43.459431 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/888590ed-3122-4425-816a-1292d70e3086-metrics-tls podName:888590ed-3122-4425-816a-1292d70e3086 nodeName:}" failed. No retries permitted until 2026-07-02 13:45:59.459415587 +0000 UTC m=+67.739670095 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/888590ed-3122-4425-816a-1292d70e3086-metrics-tls") pod "dns-default-dmq79" (UID: "888590ed-3122-4425-816a-1292d70e3086") : secret "dns-default-metrics-tls" not found Jul 02 13:45:43.459745 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:43.459450 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-registry-tls podName:d2e7b7d2-3bda-42bf-b87f-62e9387872dc nodeName:}" failed. No retries permitted until 2026-07-02 13:45:59.459437246 +0000 UTC m=+67.739691755 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-registry-tls") pod "image-registry-9dd8f84df-2kc75" (UID: "d2e7b7d2-3bda-42bf-b87f-62e9387872dc") : secret "image-registry-tls" not found Jul 02 13:45:53.321278 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:53.321248 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lwl25" Jul 02 13:45:57.861048 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:57.861008 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b2943b8-7b87-46b4-8141-cfe5464bc8ad-original-pull-secret\") pod \"global-pull-secret-syncer-pvpks\" (UID: \"6b2943b8-7b87-46b4-8141-cfe5464bc8ad\") " pod="kube-system/global-pull-secret-syncer-pvpks" Jul 02 13:45:57.861447 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:57.861081 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74ca80fe-9892-41a5-9066-89f77be19c4c-metrics-certs\") pod \"network-metrics-daemon-5wdg2\" (UID: \"74ca80fe-9892-41a5-9066-89f77be19c4c\") " pod="openshift-multus/network-metrics-daemon-5wdg2" Jul 02 13:45:57.864200 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:57.864178 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 13:45:57.864321 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:57.864219 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 13:45:57.871536 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:57.871514 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 13:45:57.871614 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:57.871586 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74ca80fe-9892-41a5-9066-89f77be19c4c-metrics-certs podName:74ca80fe-9892-41a5-9066-89f77be19c4c nodeName:}" failed. No retries permitted until 2026-07-02 13:47:01.871569983 +0000 UTC m=+130.151824491 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74ca80fe-9892-41a5-9066-89f77be19c4c-metrics-certs") pod "network-metrics-daemon-5wdg2" (UID: "74ca80fe-9892-41a5-9066-89f77be19c4c") : secret "metrics-daemon-secret" not found Jul 02 13:45:57.874783 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:57.874765 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b2943b8-7b87-46b4-8141-cfe5464bc8ad-original-pull-secret\") pod \"global-pull-secret-syncer-pvpks\" (UID: \"6b2943b8-7b87-46b4-8141-cfe5464bc8ad\") " pod="kube-system/global-pull-secret-syncer-pvpks" Jul 02 13:45:57.943123 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:57.943080 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvpks" Jul 02 13:45:57.961839 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:57.961806 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzngk\" (UniqueName: \"kubernetes.io/projected/43b79ed9-acd0-4973-828a-6b97b5ea8e0e-kube-api-access-tzngk\") pod \"network-check-target-cmpgv\" (UID: \"43b79ed9-acd0-4973-828a-6b97b5ea8e0e\") " pod="openshift-network-diagnostics/network-check-target-cmpgv" Jul 02 13:45:57.965074 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:57.965056 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 13:45:57.978133 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:57.978107 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 13:45:57.985984 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:57.985963 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzngk\" (UniqueName: \"kubernetes.io/projected/43b79ed9-acd0-4973-828a-6b97b5ea8e0e-kube-api-access-tzngk\") pod \"network-check-target-cmpgv\" (UID: \"43b79ed9-acd0-4973-828a-6b97b5ea8e0e\") " pod="openshift-network-diagnostics/network-check-target-cmpgv" Jul 02 13:45:58.061477 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:58.061444 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pvpks"] Jul 02 13:45:58.064915 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:45:58.064890 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b2943b8_7b87_46b4_8141_cfe5464bc8ad.slice/crio-581376a213db52fc561a824ecaaeda2b1375cf4d516c40aede310160c21593a1 WatchSource:0}: Error finding container 581376a213db52fc561a824ecaaeda2b1375cf4d516c40aede310160c21593a1: Status 404 returned error can't find the container with id 581376a213db52fc561a824ecaaeda2b1375cf4d516c40aede310160c21593a1 Jul 02 13:45:58.255843 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:58.255762 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7vs28\"" Jul 02 13:45:58.263621 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:58.263601 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmpgv" Jul 02 13:45:58.381646 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:58.381617 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cmpgv"] Jul 02 13:45:58.384770 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:45:58.384743 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43b79ed9_acd0_4973_828a_6b97b5ea8e0e.slice/crio-acabd56f6a105dc1e138f004736c5d52b88d1b7cf1d41dfc1f4683742e27284d WatchSource:0}: Error finding container acabd56f6a105dc1e138f004736c5d52b88d1b7cf1d41dfc1f4683742e27284d: Status 404 returned error can't find the container with id acabd56f6a105dc1e138f004736c5d52b88d1b7cf1d41dfc1f4683742e27284d Jul 02 13:45:58.406077 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:58.406049 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pvpks" event={"ID":"6b2943b8-7b87-46b4-8141-cfe5464bc8ad","Type":"ContainerStarted","Data":"581376a213db52fc561a824ecaaeda2b1375cf4d516c40aede310160c21593a1"} Jul 02 13:45:58.406887 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:58.406868 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cmpgv" event={"ID":"43b79ed9-acd0-4973-828a-6b97b5ea8e0e","Type":"ContainerStarted","Data":"acabd56f6a105dc1e138f004736c5d52b88d1b7cf1d41dfc1f4683742e27284d"} Jul 02 13:45:59.472900 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:59.472862 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-registry-tls\") pod \"image-registry-9dd8f84df-2kc75\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:45:59.473366 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:45:59.472911 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/888590ed-3122-4425-816a-1292d70e3086-metrics-tls\") pod \"dns-default-dmq79\" (UID: \"888590ed-3122-4425-816a-1292d70e3086\") " pod="openshift-dns/dns-default-dmq79" Jul 02 13:45:59.473366 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:59.473039 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 13:45:59.473366 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:59.473039 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 13:45:59.473366 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:59.473059 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9dd8f84df-2kc75: secret "image-registry-tls" not found Jul 02 13:45:59.473366 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:59.473096 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/888590ed-3122-4425-816a-1292d70e3086-metrics-tls podName:888590ed-3122-4425-816a-1292d70e3086 nodeName:}" failed. No retries permitted until 2026-07-02 13:46:31.473079035 +0000 UTC m=+99.753333545 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/888590ed-3122-4425-816a-1292d70e3086-metrics-tls") pod "dns-default-dmq79" (UID: "888590ed-3122-4425-816a-1292d70e3086") : secret "dns-default-metrics-tls" not found Jul 02 13:45:59.473366 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:45:59.473111 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-registry-tls podName:d2e7b7d2-3bda-42bf-b87f-62e9387872dc nodeName:}" failed. No retries permitted until 2026-07-02 13:46:31.473104623 +0000 UTC m=+99.753359132 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-registry-tls") pod "image-registry-9dd8f84df-2kc75" (UID: "d2e7b7d2-3bda-42bf-b87f-62e9387872dc") : secret "image-registry-tls" not found Jul 02 13:46:03.425282 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:03.425247 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cmpgv" event={"ID":"43b79ed9-acd0-4973-828a-6b97b5ea8e0e","Type":"ContainerStarted","Data":"a208297bf1ba3ebb8b126a40937283a8b1cb0da42c79f7d87d7da9ab6c74bb7c"} Jul 02 13:46:03.425716 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:03.425382 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cmpgv" Jul 02 13:46:03.426602 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:03.426580 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pvpks" event={"ID":"6b2943b8-7b87-46b4-8141-cfe5464bc8ad","Type":"ContainerStarted","Data":"16765533185f3d94f4c9f9af27f2ecb642dadf1dc33b2df94dd44054faca589f"} Jul 02 13:46:03.443750 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:03.443711 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cmpgv" podStartSLOduration=67.134282075 podStartE2EDuration="1m11.443699023s" totalImagesPullingTime="4.309416948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:46:03.442807016 +0000 UTC m=+71.723061546" watchObservedRunningTime="2026-07-02 13:46:03.443699023 +0000 UTC m=+71.723953552" Jul 02 13:46:03.459659 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:03.459625 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pvpks" podStartSLOduration=66.827029326 podStartE2EDuration="1m11.459612602s" totalImagesPullingTime="4.632583276s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:46:03.459101909 +0000 UTC m=+71.739356438" watchObservedRunningTime="2026-07-02 13:46:03.459612602 +0000 UTC m=+71.739867132" Jul 02 13:46:31.496647 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:31.496615 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-registry-tls\") pod \"image-registry-9dd8f84df-2kc75\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:46:31.497050 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:31.496654 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/888590ed-3122-4425-816a-1292d70e3086-metrics-tls\") pod \"dns-default-dmq79\" (UID: \"888590ed-3122-4425-816a-1292d70e3086\") " pod="openshift-dns/dns-default-dmq79" Jul 02 13:46:31.497050 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:46:31.496744 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 13:46:31.497050 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:46:31.496749 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 13:46:31.497050 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:46:31.496762 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9dd8f84df-2kc75: secret "image-registry-tls" not found Jul 02 13:46:31.497050 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:46:31.496798 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/888590ed-3122-4425-816a-1292d70e3086-metrics-tls podName:888590ed-3122-4425-816a-1292d70e3086 nodeName:}" failed. No retries permitted until 2026-07-02 13:47:35.496784533 +0000 UTC m=+163.777039042 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/888590ed-3122-4425-816a-1292d70e3086-metrics-tls") pod "dns-default-dmq79" (UID: "888590ed-3122-4425-816a-1292d70e3086") : secret "dns-default-metrics-tls" not found Jul 02 13:46:31.497050 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:46:31.496816 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-registry-tls podName:d2e7b7d2-3bda-42bf-b87f-62e9387872dc nodeName:}" failed. No retries permitted until 2026-07-02 13:47:35.496802742 +0000 UTC m=+163.777057262 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-registry-tls") pod "image-registry-9dd8f84df-2kc75" (UID: "d2e7b7d2-3bda-42bf-b87f-62e9387872dc") : secret "image-registry-tls" not found Jul 02 13:46:34.431529 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:34.431495 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cmpgv" Jul 02 13:46:41.206429 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.206388 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-rb985"] Jul 02 13:46:41.208436 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.208418 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-rb985" Jul 02 13:46:41.210256 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.210224 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pkn85"] Jul 02 13:46:41.212374 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.212352 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 02 13:46:41.212795 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.212422 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pkn85" Jul 02 13:46:41.212795 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.212438 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 02 13:46:41.213572 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.213557 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-m8s9n\"" Jul 02 13:46:41.213623 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.213585 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 02 13:46:41.214957 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.214914 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-6q84g"] Jul 02 13:46:41.216704 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.216676 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 02 13:46:41.216704 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.216697 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 02 13:46:41.216836 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.216776 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 02 13:46:41.216881 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.216842 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-6q84g" Jul 02 13:46:41.217188 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.217172 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-88q8v\"" Jul 02 13:46:41.217272 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.217258 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 02 13:46:41.220962 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.220944 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 02 13:46:41.222496 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.222474 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-78nfq\"" Jul 02 13:46:41.222579 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.222499 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 02 13:46:41.222579 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.222509 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 02 13:46:41.222687 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.222594 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 02 13:46:41.226369 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.226348 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-rb985"] Jul 02 13:46:41.232793 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.232766 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pkn85"] Jul 02 13:46:41.233563 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.233540 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-6q84g"] Jul 02 13:46:41.362882 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.362841 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8216e3d5-395e-435f-92e3-e3a872349527-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-6q84g\" (UID: \"8216e3d5-395e-435f-92e3-e3a872349527\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-6q84g" Jul 02 13:46:41.362882 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.362877 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8216e3d5-395e-435f-92e3-e3a872349527-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-6q84g\" (UID: \"8216e3d5-395e-435f-92e3-e3a872349527\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-6q84g" Jul 02 13:46:41.363103 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.362947 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpghb\" (UniqueName: \"kubernetes.io/projected/6370bd7b-43c9-41ac-8596-0a975155445c-kube-api-access-dpghb\") pod \"service-ca-operator-5d7b7dc95c-pkn85\" (UID: \"6370bd7b-43c9-41ac-8596-0a975155445c\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pkn85" Jul 02 13:46:41.363103 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.362972 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e121e507-0f73-4ccf-8853-a3d2b9169518-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-rb985\" (UID: \"e121e507-0f73-4ccf-8853-a3d2b9169518\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-rb985" Jul 02 13:46:41.363103 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.363003 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4rzm\" (UniqueName: \"kubernetes.io/projected/8216e3d5-395e-435f-92e3-e3a872349527-kube-api-access-h4rzm\") pod \"kube-storage-version-migrator-operator-79964ff6f9-6q84g\" (UID: \"8216e3d5-395e-435f-92e3-e3a872349527\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-6q84g" Jul 02 13:46:41.363103 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.363027 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6370bd7b-43c9-41ac-8596-0a975155445c-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-pkn85\" (UID: \"6370bd7b-43c9-41ac-8596-0a975155445c\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pkn85" Jul 02 13:46:41.363103 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.363085 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzrg8\" (UniqueName: \"kubernetes.io/projected/e121e507-0f73-4ccf-8853-a3d2b9169518-kube-api-access-pzrg8\") pod \"cluster-samples-operator-9ddc5ff76-rb985\" (UID: \"e121e507-0f73-4ccf-8853-a3d2b9169518\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-rb985" Jul 02 13:46:41.363249 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.363113 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6370bd7b-43c9-41ac-8596-0a975155445c-config\") pod \"service-ca-operator-5d7b7dc95c-pkn85\" (UID: \"6370bd7b-43c9-41ac-8596-0a975155445c\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pkn85" Jul 02 13:46:41.464317 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.464229 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzrg8\" (UniqueName: \"kubernetes.io/projected/e121e507-0f73-4ccf-8853-a3d2b9169518-kube-api-access-pzrg8\") pod \"cluster-samples-operator-9ddc5ff76-rb985\" (UID: \"e121e507-0f73-4ccf-8853-a3d2b9169518\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-rb985" Jul 02 13:46:41.464317 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.464276 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6370bd7b-43c9-41ac-8596-0a975155445c-config\") pod \"service-ca-operator-5d7b7dc95c-pkn85\" (UID: \"6370bd7b-43c9-41ac-8596-0a975155445c\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pkn85" Jul 02 13:46:41.464317 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.464300 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8216e3d5-395e-435f-92e3-e3a872349527-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-6q84g\" (UID: \"8216e3d5-395e-435f-92e3-e3a872349527\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-6q84g" Jul 02 13:46:41.464565 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.464321 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8216e3d5-395e-435f-92e3-e3a872349527-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-6q84g\" (UID: \"8216e3d5-395e-435f-92e3-e3a872349527\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-6q84g" Jul 02 13:46:41.464565 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.464371 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpghb\" (UniqueName: \"kubernetes.io/projected/6370bd7b-43c9-41ac-8596-0a975155445c-kube-api-access-dpghb\") pod \"service-ca-operator-5d7b7dc95c-pkn85\" (UID: \"6370bd7b-43c9-41ac-8596-0a975155445c\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pkn85" Jul 02 13:46:41.464565 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.464394 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e121e507-0f73-4ccf-8853-a3d2b9169518-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-rb985\" (UID: \"e121e507-0f73-4ccf-8853-a3d2b9169518\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-rb985" Jul 02 13:46:41.464565 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.464437 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4rzm\" (UniqueName: \"kubernetes.io/projected/8216e3d5-395e-435f-92e3-e3a872349527-kube-api-access-h4rzm\") pod \"kube-storage-version-migrator-operator-79964ff6f9-6q84g\" (UID: \"8216e3d5-395e-435f-92e3-e3a872349527\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-6q84g" Jul 02 13:46:41.464565 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.464462 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6370bd7b-43c9-41ac-8596-0a975155445c-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-pkn85\" (UID: \"6370bd7b-43c9-41ac-8596-0a975155445c\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pkn85" Jul 02 13:46:41.464565 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:46:41.464550 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 13:46:41.464864 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:46:41.464637 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e121e507-0f73-4ccf-8853-a3d2b9169518-samples-operator-tls podName:e121e507-0f73-4ccf-8853-a3d2b9169518 nodeName:}" failed. No retries permitted until 2026-07-02 13:46:41.964613846 +0000 UTC m=+110.244868373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e121e507-0f73-4ccf-8853-a3d2b9169518-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-rb985" (UID: "e121e507-0f73-4ccf-8853-a3d2b9169518") : secret "samples-operator-tls" not found Jul 02 13:46:41.464967 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.464924 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6370bd7b-43c9-41ac-8596-0a975155445c-config\") pod \"service-ca-operator-5d7b7dc95c-pkn85\" (UID: \"6370bd7b-43c9-41ac-8596-0a975155445c\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pkn85" Jul 02 13:46:41.465038 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.465015 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8216e3d5-395e-435f-92e3-e3a872349527-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-6q84g\" (UID: \"8216e3d5-395e-435f-92e3-e3a872349527\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-6q84g" Jul 02 13:46:41.466733 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.466717 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6370bd7b-43c9-41ac-8596-0a975155445c-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-pkn85\" (UID: \"6370bd7b-43c9-41ac-8596-0a975155445c\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pkn85" Jul 02 13:46:41.466787 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.466734 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8216e3d5-395e-435f-92e3-e3a872349527-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-6q84g\" (UID: \"8216e3d5-395e-435f-92e3-e3a872349527\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-6q84g" Jul 02 13:46:41.480310 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.480278 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpghb\" (UniqueName: \"kubernetes.io/projected/6370bd7b-43c9-41ac-8596-0a975155445c-kube-api-access-dpghb\") pod \"service-ca-operator-5d7b7dc95c-pkn85\" (UID: \"6370bd7b-43c9-41ac-8596-0a975155445c\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pkn85" Jul 02 13:46:41.480444 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.480318 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4rzm\" (UniqueName: \"kubernetes.io/projected/8216e3d5-395e-435f-92e3-e3a872349527-kube-api-access-h4rzm\") pod \"kube-storage-version-migrator-operator-79964ff6f9-6q84g\" (UID: \"8216e3d5-395e-435f-92e3-e3a872349527\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-6q84g" Jul 02 13:46:41.480444 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.480433 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzrg8\" (UniqueName: \"kubernetes.io/projected/e121e507-0f73-4ccf-8853-a3d2b9169518-kube-api-access-pzrg8\") pod \"cluster-samples-operator-9ddc5ff76-rb985\" (UID: \"e121e507-0f73-4ccf-8853-a3d2b9169518\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-rb985" Jul 02 13:46:41.525309 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.525280 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pkn85" Jul 02 13:46:41.530726 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.530701 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-6q84g" Jul 02 13:46:41.658194 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.658162 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pkn85"] Jul 02 13:46:41.661115 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:46:41.661083 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6370bd7b_43c9_41ac_8596_0a975155445c.slice/crio-46045fae78eb689283288bc5288422d43d59432bbb984fc0972b0669108d7c16 WatchSource:0}: Error finding container 46045fae78eb689283288bc5288422d43d59432bbb984fc0972b0669108d7c16: Status 404 returned error can't find the container with id 46045fae78eb689283288bc5288422d43d59432bbb984fc0972b0669108d7c16 Jul 02 13:46:41.674861 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.674826 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-6q84g"] Jul 02 13:46:41.678760 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:46:41.678738 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8216e3d5_395e_435f_92e3_e3a872349527.slice/crio-0cb66838a038c2cf502e4e53451827ab73aa93d7d3ab356c4e2b9b54e44339d8 WatchSource:0}: Error finding container 0cb66838a038c2cf502e4e53451827ab73aa93d7d3ab356c4e2b9b54e44339d8: Status 404 returned error can't find the container with id 0cb66838a038c2cf502e4e53451827ab73aa93d7d3ab356c4e2b9b54e44339d8 Jul 02 13:46:41.968062 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:41.968028 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e121e507-0f73-4ccf-8853-a3d2b9169518-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-rb985\" (UID: \"e121e507-0f73-4ccf-8853-a3d2b9169518\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-rb985" Jul 02 13:46:41.968260 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:46:41.968189 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 13:46:41.968260 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:46:41.968257 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e121e507-0f73-4ccf-8853-a3d2b9169518-samples-operator-tls podName:e121e507-0f73-4ccf-8853-a3d2b9169518 nodeName:}" failed. No retries permitted until 2026-07-02 13:46:42.968241466 +0000 UTC m=+111.248495974 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e121e507-0f73-4ccf-8853-a3d2b9169518-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-rb985" (UID: "e121e507-0f73-4ccf-8853-a3d2b9169518") : secret "samples-operator-tls" not found Jul 02 13:46:42.523297 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:42.523258 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-6q84g" event={"ID":"8216e3d5-395e-435f-92e3-e3a872349527","Type":"ContainerStarted","Data":"0cb66838a038c2cf502e4e53451827ab73aa93d7d3ab356c4e2b9b54e44339d8"} Jul 02 13:46:42.524559 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:42.524528 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pkn85" event={"ID":"6370bd7b-43c9-41ac-8596-0a975155445c","Type":"ContainerStarted","Data":"46045fae78eb689283288bc5288422d43d59432bbb984fc0972b0669108d7c16"} Jul 02 13:46:42.977482 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:42.977444 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e121e507-0f73-4ccf-8853-a3d2b9169518-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-rb985\" (UID: \"e121e507-0f73-4ccf-8853-a3d2b9169518\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-rb985" Jul 02 13:46:42.977644 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:46:42.977587 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 13:46:42.977684 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:46:42.977647 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e121e507-0f73-4ccf-8853-a3d2b9169518-samples-operator-tls podName:e121e507-0f73-4ccf-8853-a3d2b9169518 nodeName:}" failed. No retries permitted until 2026-07-02 13:46:44.977631723 +0000 UTC m=+113.257886232 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e121e507-0f73-4ccf-8853-a3d2b9169518-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-rb985" (UID: "e121e507-0f73-4ccf-8853-a3d2b9169518") : secret "samples-operator-tls" not found Jul 02 13:46:44.532019 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:44.531911 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-6q84g" event={"ID":"8216e3d5-395e-435f-92e3-e3a872349527","Type":"ContainerStarted","Data":"9e5a938681cb7e489ad6d774e6a4167da44370e37ae4eb1187e9f944dbe3bef4"} Jul 02 13:46:44.533454 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:44.533430 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pkn85" event={"ID":"6370bd7b-43c9-41ac-8596-0a975155445c","Type":"ContainerStarted","Data":"8ad6c89908029b2a00fd5600e7358ee5ecfcaa8b3787e812279306b5dddda02b"} Jul 02 13:46:44.549787 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:44.549738 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-6q84g" podStartSLOduration=1.092289969 podStartE2EDuration="3.549719217s" totalImagesPullingTime="2.457429248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:46:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:46:44.54854564 +0000 UTC m=+112.828800181" watchObservedRunningTime="2026-07-02 13:46:44.549719217 +0000 UTC m=+112.829973747" Jul 02 13:46:44.567245 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:44.567181 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pkn85" podStartSLOduration=1.094764842 podStartE2EDuration="3.567161722s" totalImagesPullingTime="2.47239688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:46:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:46:44.565157757 +0000 UTC m=+112.845412319" watchObservedRunningTime="2026-07-02 13:46:44.567161722 +0000 UTC m=+112.847416253" Jul 02 13:46:44.995297 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:44.995253 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e121e507-0f73-4ccf-8853-a3d2b9169518-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-rb985\" (UID: \"e121e507-0f73-4ccf-8853-a3d2b9169518\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-rb985" Jul 02 13:46:44.995506 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:46:44.995398 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 13:46:44.995506 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:46:44.995465 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e121e507-0f73-4ccf-8853-a3d2b9169518-samples-operator-tls podName:e121e507-0f73-4ccf-8853-a3d2b9169518 nodeName:}" failed. No retries permitted until 2026-07-02 13:46:48.995450622 +0000 UTC m=+117.275705130 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e121e507-0f73-4ccf-8853-a3d2b9169518-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-rb985" (UID: "e121e507-0f73-4ccf-8853-a3d2b9169518") : secret "samples-operator-tls" not found Jul 02 13:46:45.273245 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:45.273164 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9brbm"] Jul 02 13:46:45.275972 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:45.275948 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9brbm" Jul 02 13:46:45.294796 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:45.294767 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 13:46:45.298816 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:45.298787 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 13:46:45.298980 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:45.298822 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dmzxj\"" Jul 02 13:46:45.298980 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:45.298867 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 13:46:45.298980 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:45.298963 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 13:46:45.312721 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:45.312689 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9brbm"] Jul 02 13:46:45.355459 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:45.355422 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-6ddkj"] Jul 02 13:46:45.357902 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:45.357879 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-6ddkj" Jul 02 13:46:45.361270 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:45.361250 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-ll4fm\"" Jul 02 13:46:45.372948 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:45.372908 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-6ddkj"] Jul 02 13:46:45.399473 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:45.399439 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/12dc36c3-9cca-4bdb-a9c5-1406643510b5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9brbm\" (UID: \"12dc36c3-9cca-4bdb-a9c5-1406643510b5\") " pod="openshift-insights/insights-runtime-extractor-9brbm" Jul 02 13:46:45.399646 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:45.399508 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/12dc36c3-9cca-4bdb-a9c5-1406643510b5-crio-socket\") pod \"insights-runtime-extractor-9brbm\" (UID: \"12dc36c3-9cca-4bdb-a9c5-1406643510b5\") " pod="openshift-insights/insights-runtime-extractor-9brbm" Jul 02 13:46:45.399646 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:45.399564 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p96bh\" (UniqueName: \"kubernetes.io/projected/12dc36c3-9cca-4bdb-a9c5-1406643510b5-kube-api-access-p96bh\") pod \"insights-runtime-extractor-9brbm\" (UID: \"12dc36c3-9cca-4bdb-a9c5-1406643510b5\") " pod="openshift-insights/insights-runtime-extractor-9brbm" Jul 02 13:46:45.399646 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:45.399593 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/12dc36c3-9cca-4bdb-a9c5-1406643510b5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9brbm\" (UID: \"12dc36c3-9cca-4bdb-a9c5-1406643510b5\") " pod="openshift-insights/insights-runtime-extractor-9brbm" Jul 02 13:46:45.399646 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:45.399619 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/12dc36c3-9cca-4bdb-a9c5-1406643510b5-data-volume\") pod \"insights-runtime-extractor-9brbm\" (UID: \"12dc36c3-9cca-4bdb-a9c5-1406643510b5\") " pod="openshift-insights/insights-runtime-extractor-9brbm" Jul 02 13:46:45.500467 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:45.500436 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/12dc36c3-9cca-4bdb-a9c5-1406643510b5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9brbm\" (UID: \"12dc36c3-9cca-4bdb-a9c5-1406643510b5\") " pod="openshift-insights/insights-runtime-extractor-9brbm" Jul 02 13:46:45.500639 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:45.500485 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/12dc36c3-9cca-4bdb-a9c5-1406643510b5-crio-socket\") pod \"insights-runtime-extractor-9brbm\" (UID: \"12dc36c3-9cca-4bdb-a9c5-1406643510b5\") " pod="openshift-insights/insights-runtime-extractor-9brbm" Jul 02 13:46:45.500639 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:45.500509 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsh5b\" (UniqueName: \"kubernetes.io/projected/212bc0a0-107e-4f1e-80d9-2ee22c8dc9ad-kube-api-access-dsh5b\") pod \"network-check-source-56499946bc-6ddkj\" (UID: \"212bc0a0-107e-4f1e-80d9-2ee22c8dc9ad\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-6ddkj" Jul 02 13:46:45.500639 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:45.500577 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/12dc36c3-9cca-4bdb-a9c5-1406643510b5-crio-socket\") pod \"insights-runtime-extractor-9brbm\" (UID: \"12dc36c3-9cca-4bdb-a9c5-1406643510b5\") " pod="openshift-insights/insights-runtime-extractor-9brbm" Jul 02 13:46:45.500639 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:46:45.500597 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 13:46:45.500813 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:46:45.500668 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12dc36c3-9cca-4bdb-a9c5-1406643510b5-insights-runtime-extractor-tls podName:12dc36c3-9cca-4bdb-a9c5-1406643510b5 nodeName:}" failed. No retries permitted until 2026-07-02 13:46:46.000646679 +0000 UTC m=+114.280901189 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/12dc36c3-9cca-4bdb-a9c5-1406643510b5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9brbm" (UID: "12dc36c3-9cca-4bdb-a9c5-1406643510b5") : secret "insights-runtime-extractor-tls" not found Jul 02 13:46:45.500813 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:45.500700 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p96bh\" (UniqueName: \"kubernetes.io/projected/12dc36c3-9cca-4bdb-a9c5-1406643510b5-kube-api-access-p96bh\") pod \"insights-runtime-extractor-9brbm\" (UID: \"12dc36c3-9cca-4bdb-a9c5-1406643510b5\") " pod="openshift-insights/insights-runtime-extractor-9brbm" Jul 02 13:46:45.500813 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:45.500727 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/12dc36c3-9cca-4bdb-a9c5-1406643510b5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9brbm\" (UID: \"12dc36c3-9cca-4bdb-a9c5-1406643510b5\") " pod="openshift-insights/insights-runtime-extractor-9brbm" Jul 02 13:46:45.500813 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:45.500743 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/12dc36c3-9cca-4bdb-a9c5-1406643510b5-data-volume\") pod \"insights-runtime-extractor-9brbm\" (UID: \"12dc36c3-9cca-4bdb-a9c5-1406643510b5\") " pod="openshift-insights/insights-runtime-extractor-9brbm" Jul 02 13:46:45.501024 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:46:45.500848 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 13:46:45.501024 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:46:45.500914 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/12dc36c3-9cca-4bdb-a9c5-1406643510b5-kube-rbac-proxy-cm podName:12dc36c3-9cca-4bdb-a9c5-1406643510b5 nodeName:}" failed. No retries permitted until 2026-07-02 13:46:46.000898825 +0000 UTC m=+114.281153333 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/12dc36c3-9cca-4bdb-a9c5-1406643510b5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9brbm" (UID: "12dc36c3-9cca-4bdb-a9c5-1406643510b5") : configmap "kube-rbac-proxy" not found Jul 02 13:46:45.501097 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:45.501020 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/12dc36c3-9cca-4bdb-a9c5-1406643510b5-data-volume\") pod \"insights-runtime-extractor-9brbm\" (UID: \"12dc36c3-9cca-4bdb-a9c5-1406643510b5\") " pod="openshift-insights/insights-runtime-extractor-9brbm" Jul 02 13:46:45.515797 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:45.515772 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p96bh\" (UniqueName: \"kubernetes.io/projected/12dc36c3-9cca-4bdb-a9c5-1406643510b5-kube-api-access-p96bh\") pod \"insights-runtime-extractor-9brbm\" (UID: \"12dc36c3-9cca-4bdb-a9c5-1406643510b5\") " pod="openshift-insights/insights-runtime-extractor-9brbm" Jul 02 13:46:45.601429 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:45.601398 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsh5b\" (UniqueName: \"kubernetes.io/projected/212bc0a0-107e-4f1e-80d9-2ee22c8dc9ad-kube-api-access-dsh5b\") pod \"network-check-source-56499946bc-6ddkj\" (UID: \"212bc0a0-107e-4f1e-80d9-2ee22c8dc9ad\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-6ddkj" Jul 02 13:46:45.610450 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:45.610416 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsh5b\" (UniqueName: \"kubernetes.io/projected/212bc0a0-107e-4f1e-80d9-2ee22c8dc9ad-kube-api-access-dsh5b\") pod \"network-check-source-56499946bc-6ddkj\" (UID: \"212bc0a0-107e-4f1e-80d9-2ee22c8dc9ad\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-6ddkj" Jul 02 13:46:45.667514 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:45.667478 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-6ddkj" Jul 02 13:46:45.803550 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:45.803504 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-6ddkj"] Jul 02 13:46:46.004650 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:46.004612 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/12dc36c3-9cca-4bdb-a9c5-1406643510b5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9brbm\" (UID: \"12dc36c3-9cca-4bdb-a9c5-1406643510b5\") " pod="openshift-insights/insights-runtime-extractor-9brbm" Jul 02 13:46:46.004826 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:46.004674 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/12dc36c3-9cca-4bdb-a9c5-1406643510b5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9brbm\" (UID: \"12dc36c3-9cca-4bdb-a9c5-1406643510b5\") " pod="openshift-insights/insights-runtime-extractor-9brbm" Jul 02 13:46:46.004826 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:46:46.004742 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 13:46:46.004826 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:46:46.004802 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 13:46:46.004826 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:46:46.004806 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/12dc36c3-9cca-4bdb-a9c5-1406643510b5-kube-rbac-proxy-cm podName:12dc36c3-9cca-4bdb-a9c5-1406643510b5 nodeName:}" failed. No retries permitted until 2026-07-02 13:46:47.00479153 +0000 UTC m=+115.285046039 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/12dc36c3-9cca-4bdb-a9c5-1406643510b5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9brbm" (UID: "12dc36c3-9cca-4bdb-a9c5-1406643510b5") : configmap "kube-rbac-proxy" not found Jul 02 13:46:46.005074 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:46:46.004841 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12dc36c3-9cca-4bdb-a9c5-1406643510b5-insights-runtime-extractor-tls podName:12dc36c3-9cca-4bdb-a9c5-1406643510b5 nodeName:}" failed. No retries permitted until 2026-07-02 13:46:47.004829941 +0000 UTC m=+115.285084449 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/12dc36c3-9cca-4bdb-a9c5-1406643510b5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9brbm" (UID: "12dc36c3-9cca-4bdb-a9c5-1406643510b5") : secret "insights-runtime-extractor-tls" not found Jul 02 13:46:46.542548 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:46.542516 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-6ddkj" event={"ID":"212bc0a0-107e-4f1e-80d9-2ee22c8dc9ad","Type":"ContainerStarted","Data":"b7423009a9676ab91e047b4f96eba478969c46dc1574dff869d71cb0eb66d920"} Jul 02 13:46:46.542747 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:46.542563 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-6ddkj" event={"ID":"212bc0a0-107e-4f1e-80d9-2ee22c8dc9ad","Type":"ContainerStarted","Data":"3d31812450134ba4d0ffbfdf3ec304edd712ac26bfb1b74b5599cbc7b98badf3"} Jul 02 13:46:46.562349 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:46.562291 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56499946bc-6ddkj" podStartSLOduration=1.56227149 podStartE2EDuration="1.56227149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:46:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:46:46.560282425 +0000 UTC m=+114.840536958" watchObservedRunningTime="2026-07-02 13:46:46.56227149 +0000 UTC m=+114.842526021" Jul 02 13:46:47.012583 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:47.012542 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/12dc36c3-9cca-4bdb-a9c5-1406643510b5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9brbm\" (UID: \"12dc36c3-9cca-4bdb-a9c5-1406643510b5\") " pod="openshift-insights/insights-runtime-extractor-9brbm" Jul 02 13:46:47.013003 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:47.012605 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/12dc36c3-9cca-4bdb-a9c5-1406643510b5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9brbm\" (UID: \"12dc36c3-9cca-4bdb-a9c5-1406643510b5\") " pod="openshift-insights/insights-runtime-extractor-9brbm" Jul 02 13:46:47.013003 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:46:47.012674 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 13:46:47.013003 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:46:47.012715 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 13:46:47.013003 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:46:47.012738 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/12dc36c3-9cca-4bdb-a9c5-1406643510b5-kube-rbac-proxy-cm podName:12dc36c3-9cca-4bdb-a9c5-1406643510b5 nodeName:}" failed. No retries permitted until 2026-07-02 13:46:49.012722414 +0000 UTC m=+117.292976923 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/12dc36c3-9cca-4bdb-a9c5-1406643510b5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9brbm" (UID: "12dc36c3-9cca-4bdb-a9c5-1406643510b5") : configmap "kube-rbac-proxy" not found Jul 02 13:46:47.013003 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:46:47.012762 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12dc36c3-9cca-4bdb-a9c5-1406643510b5-insights-runtime-extractor-tls podName:12dc36c3-9cca-4bdb-a9c5-1406643510b5 nodeName:}" failed. No retries permitted until 2026-07-02 13:46:49.012750857 +0000 UTC m=+117.293005365 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/12dc36c3-9cca-4bdb-a9c5-1406643510b5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9brbm" (UID: "12dc36c3-9cca-4bdb-a9c5-1406643510b5") : secret "insights-runtime-extractor-tls" not found Jul 02 13:46:47.057972 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:47.057925 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ct2sf_edf38c8b-844c-4ac9-983b-e9395bb86adc/dns-node-resolver/0.log" Jul 02 13:46:48.453061 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:48.453033 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w222x_76001f3c-96f1-4e94-a8cd-0b7d575b2c4a/node-ca/0.log" Jul 02 13:46:49.027068 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:49.027026 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/12dc36c3-9cca-4bdb-a9c5-1406643510b5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9brbm\" (UID: \"12dc36c3-9cca-4bdb-a9c5-1406643510b5\") " pod="openshift-insights/insights-runtime-extractor-9brbm" Jul 02 13:46:49.027068 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:49.027070 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e121e507-0f73-4ccf-8853-a3d2b9169518-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-rb985\" (UID: \"e121e507-0f73-4ccf-8853-a3d2b9169518\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-rb985" Jul 02 13:46:49.027292 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:49.027129 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/12dc36c3-9cca-4bdb-a9c5-1406643510b5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9brbm\" (UID: \"12dc36c3-9cca-4bdb-a9c5-1406643510b5\") " pod="openshift-insights/insights-runtime-extractor-9brbm" Jul 02 13:46:49.027292 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:46:49.027169 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 13:46:49.027292 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:46:49.027229 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 13:46:49.027292 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:46:49.027236 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12dc36c3-9cca-4bdb-a9c5-1406643510b5-insights-runtime-extractor-tls podName:12dc36c3-9cca-4bdb-a9c5-1406643510b5 nodeName:}" failed. No retries permitted until 2026-07-02 13:46:53.027220227 +0000 UTC m=+121.307474735 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/12dc36c3-9cca-4bdb-a9c5-1406643510b5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9brbm" (UID: "12dc36c3-9cca-4bdb-a9c5-1406643510b5") : secret "insights-runtime-extractor-tls" not found Jul 02 13:46:49.027292 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:46:49.027237 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 13:46:49.027292 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:46:49.027278 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/12dc36c3-9cca-4bdb-a9c5-1406643510b5-kube-rbac-proxy-cm podName:12dc36c3-9cca-4bdb-a9c5-1406643510b5 nodeName:}" failed. No retries permitted until 2026-07-02 13:46:53.02726399 +0000 UTC m=+121.307518513 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/12dc36c3-9cca-4bdb-a9c5-1406643510b5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9brbm" (UID: "12dc36c3-9cca-4bdb-a9c5-1406643510b5") : configmap "kube-rbac-proxy" not found Jul 02 13:46:49.027292 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:46:49.027293 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e121e507-0f73-4ccf-8853-a3d2b9169518-samples-operator-tls podName:e121e507-0f73-4ccf-8853-a3d2b9169518 nodeName:}" failed. No retries permitted until 2026-07-02 13:46:57.027286991 +0000 UTC m=+125.307541500 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e121e507-0f73-4ccf-8853-a3d2b9169518-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-rb985" (UID: "e121e507-0f73-4ccf-8853-a3d2b9169518") : secret "samples-operator-tls" not found Jul 02 13:46:49.051333 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:49.051298 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m7v6r_69f44293-335f-4e2b-a89a-043917f44a10/serve-healthcheck-canary/0.log" Jul 02 13:46:53.056594 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:53.056533 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/12dc36c3-9cca-4bdb-a9c5-1406643510b5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9brbm\" (UID: \"12dc36c3-9cca-4bdb-a9c5-1406643510b5\") " pod="openshift-insights/insights-runtime-extractor-9brbm" Jul 02 13:46:53.057057 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:53.056628 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/12dc36c3-9cca-4bdb-a9c5-1406643510b5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9brbm\" (UID: \"12dc36c3-9cca-4bdb-a9c5-1406643510b5\") " pod="openshift-insights/insights-runtime-extractor-9brbm" Jul 02 13:46:53.057057 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:46:53.056670 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 13:46:53.057057 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:46:53.056742 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/12dc36c3-9cca-4bdb-a9c5-1406643510b5-kube-rbac-proxy-cm podName:12dc36c3-9cca-4bdb-a9c5-1406643510b5 nodeName:}" failed. No retries permitted until 2026-07-02 13:47:01.056725636 +0000 UTC m=+129.336980144 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/12dc36c3-9cca-4bdb-a9c5-1406643510b5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9brbm" (UID: "12dc36c3-9cca-4bdb-a9c5-1406643510b5") : configmap "kube-rbac-proxy" not found Jul 02 13:46:53.057057 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:46:53.056756 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 13:46:53.057057 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:46:53.056808 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12dc36c3-9cca-4bdb-a9c5-1406643510b5-insights-runtime-extractor-tls podName:12dc36c3-9cca-4bdb-a9c5-1406643510b5 nodeName:}" failed. No retries permitted until 2026-07-02 13:47:01.056793044 +0000 UTC m=+129.337047557 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/12dc36c3-9cca-4bdb-a9c5-1406643510b5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9brbm" (UID: "12dc36c3-9cca-4bdb-a9c5-1406643510b5") : secret "insights-runtime-extractor-tls" not found Jul 02 13:46:57.087686 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:57.087650 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e121e507-0f73-4ccf-8853-a3d2b9169518-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-rb985\" (UID: \"e121e507-0f73-4ccf-8853-a3d2b9169518\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-rb985" Jul 02 13:46:57.090072 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:57.090051 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e121e507-0f73-4ccf-8853-a3d2b9169518-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-rb985\" (UID: \"e121e507-0f73-4ccf-8853-a3d2b9169518\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-rb985" Jul 02 13:46:57.122037 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:57.122005 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-m8s9n\"" Jul 02 13:46:57.129705 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:57.129686 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-rb985" Jul 02 13:46:57.258491 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:57.258359 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-rb985"] Jul 02 13:46:57.574533 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:57.574494 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-rb985" event={"ID":"e121e507-0f73-4ccf-8853-a3d2b9169518","Type":"ContainerStarted","Data":"2dfa6e6ab20e9f838c667ad2578aea711bd68ce78860206f27c6a94fa1fc316f"} Jul 02 13:46:59.582257 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:59.582220 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-rb985" event={"ID":"e121e507-0f73-4ccf-8853-a3d2b9169518","Type":"ContainerStarted","Data":"a9b3bc7b897ff3012e57d02e1fe8f86d10fb7ecdc07a8a4f303919879413bd1e"} Jul 02 13:46:59.582601 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:59.582311 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-rb985" event={"ID":"e121e507-0f73-4ccf-8853-a3d2b9169518","Type":"ContainerStarted","Data":"a17a03261e64268ff97b5232c9e82677543b7c6a8437e5de467f1fd324f6e4d6"} Jul 02 13:46:59.604057 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:46:59.604004 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-rb985" podStartSLOduration=17.043077147 podStartE2EDuration="18.60399015s" totalImagesPullingTime="1.560913003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:46:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:46:59.602362755 +0000 UTC m=+127.882617310" watchObservedRunningTime="2026-07-02 13:46:59.60399015 +0000 UTC m=+127.884244680" Jul 02 13:47:01.117855 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:01.117814 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/12dc36c3-9cca-4bdb-a9c5-1406643510b5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9brbm\" (UID: \"12dc36c3-9cca-4bdb-a9c5-1406643510b5\") " pod="openshift-insights/insights-runtime-extractor-9brbm" Jul 02 13:47:01.118245 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:01.117878 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/12dc36c3-9cca-4bdb-a9c5-1406643510b5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9brbm\" (UID: \"12dc36c3-9cca-4bdb-a9c5-1406643510b5\") " pod="openshift-insights/insights-runtime-extractor-9brbm" Jul 02 13:47:01.118245 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:47:01.117985 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 13:47:01.118245 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:47:01.118060 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12dc36c3-9cca-4bdb-a9c5-1406643510b5-insights-runtime-extractor-tls podName:12dc36c3-9cca-4bdb-a9c5-1406643510b5 nodeName:}" failed. No retries permitted until 2026-07-02 13:47:17.118045186 +0000 UTC m=+145.398299694 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/12dc36c3-9cca-4bdb-a9c5-1406643510b5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9brbm" (UID: "12dc36c3-9cca-4bdb-a9c5-1406643510b5") : secret "insights-runtime-extractor-tls" not found Jul 02 13:47:01.118346 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:01.118313 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/12dc36c3-9cca-4bdb-a9c5-1406643510b5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9brbm\" (UID: \"12dc36c3-9cca-4bdb-a9c5-1406643510b5\") " pod="openshift-insights/insights-runtime-extractor-9brbm" Jul 02 13:47:01.924627 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:01.924593 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74ca80fe-9892-41a5-9066-89f77be19c4c-metrics-certs\") pod \"network-metrics-daemon-5wdg2\" (UID: \"74ca80fe-9892-41a5-9066-89f77be19c4c\") " pod="openshift-multus/network-metrics-daemon-5wdg2" Jul 02 13:47:01.926952 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:01.926914 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74ca80fe-9892-41a5-9066-89f77be19c4c-metrics-certs\") pod \"network-metrics-daemon-5wdg2\" (UID: \"74ca80fe-9892-41a5-9066-89f77be19c4c\") " pod="openshift-multus/network-metrics-daemon-5wdg2" Jul 02 13:47:02.150416 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:02.150387 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4vzgw\"" Jul 02 13:47:02.158087 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:02.158071 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wdg2" Jul 02 13:47:02.278320 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:02.278286 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5wdg2"] Jul 02 13:47:02.280984 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:47:02.280956 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74ca80fe_9892_41a5_9066_89f77be19c4c.slice/crio-4691bb3aa679c5040e837de39d7e464df5bce21f3031ecfc4ee74b69fcfe73ef WatchSource:0}: Error finding container 4691bb3aa679c5040e837de39d7e464df5bce21f3031ecfc4ee74b69fcfe73ef: Status 404 returned error can't find the container with id 4691bb3aa679c5040e837de39d7e464df5bce21f3031ecfc4ee74b69fcfe73ef Jul 02 13:47:02.593420 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:02.593391 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5wdg2" event={"ID":"74ca80fe-9892-41a5-9066-89f77be19c4c","Type":"ContainerStarted","Data":"4691bb3aa679c5040e837de39d7e464df5bce21f3031ecfc4ee74b69fcfe73ef"} Jul 02 13:47:03.598234 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:03.598197 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5wdg2" event={"ID":"74ca80fe-9892-41a5-9066-89f77be19c4c","Type":"ContainerStarted","Data":"d65ee9e530fca9de1869903cd5296b81e9588c45a1ea03c68163ca47072c4273"} Jul 02 13:47:03.598591 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:03.598250 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5wdg2" event={"ID":"74ca80fe-9892-41a5-9066-89f77be19c4c","Type":"ContainerStarted","Data":"756e6b0d0c62a41c0383f90e5dbf82c7a1a76c433148c474ffdb2b394ae1e52e"} Jul 02 13:47:03.618277 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:03.618231 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5wdg2" podStartSLOduration=130.736647551 podStartE2EDuration="2m11.618216237s" totalImagesPullingTime="881.568686ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:47:03.617751028 +0000 UTC m=+131.898005558" watchObservedRunningTime="2026-07-02 13:47:03.618216237 +0000 UTC m=+131.898470765" Jul 02 13:47:13.472606 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:13.472572 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c45bf8dcf-6cn6w"] Jul 02 13:47:13.474947 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:13.474914 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c45bf8dcf-6cn6w" Jul 02 13:47:13.479461 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:13.479435 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 02 13:47:13.479836 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:13.479812 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 02 13:47:13.481055 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:13.480760 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 02 13:47:13.484387 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:13.484369 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 02 13:47:13.515471 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:13.515447 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c45bf8dcf-6cn6w"] Jul 02 13:47:13.575996 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:13.575967 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-nzf6t"] Jul 02 13:47:13.578063 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:13.578048 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-nzf6t" Jul 02 13:47:13.583745 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:13.583724 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-jqhp2\"" Jul 02 13:47:13.584009 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:13.583990 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 02 13:47:13.584123 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:13.584071 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 02 13:47:13.607315 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:13.607286 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cmgg\" (UniqueName: \"kubernetes.io/projected/803fd957-0887-4a0b-bd8d-c13fbcd26f56-kube-api-access-6cmgg\") pod \"klusterlet-addon-workmgr-7c45bf8dcf-6cn6w\" (UID: \"803fd957-0887-4a0b-bd8d-c13fbcd26f56\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c45bf8dcf-6cn6w" Jul 02 13:47:13.607315 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:13.607315 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/803fd957-0887-4a0b-bd8d-c13fbcd26f56-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c45bf8dcf-6cn6w\" (UID: \"803fd957-0887-4a0b-bd8d-c13fbcd26f56\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c45bf8dcf-6cn6w" Jul 02 13:47:13.607506 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:13.607425 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/803fd957-0887-4a0b-bd8d-c13fbcd26f56-tmp\") pod \"klusterlet-addon-workmgr-7c45bf8dcf-6cn6w\" (UID: \"803fd957-0887-4a0b-bd8d-c13fbcd26f56\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c45bf8dcf-6cn6w" Jul 02 13:47:13.618401 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:13.618378 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-nzf6t"] Jul 02 13:47:13.708194 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:13.708155 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/803fd957-0887-4a0b-bd8d-c13fbcd26f56-tmp\") pod \"klusterlet-addon-workmgr-7c45bf8dcf-6cn6w\" (UID: \"803fd957-0887-4a0b-bd8d-c13fbcd26f56\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c45bf8dcf-6cn6w" Jul 02 13:47:13.708394 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:13.708204 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cmgg\" (UniqueName: \"kubernetes.io/projected/803fd957-0887-4a0b-bd8d-c13fbcd26f56-kube-api-access-6cmgg\") pod \"klusterlet-addon-workmgr-7c45bf8dcf-6cn6w\" (UID: \"803fd957-0887-4a0b-bd8d-c13fbcd26f56\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c45bf8dcf-6cn6w" Jul 02 13:47:13.708394 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:13.708223 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/803fd957-0887-4a0b-bd8d-c13fbcd26f56-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c45bf8dcf-6cn6w\" (UID: \"803fd957-0887-4a0b-bd8d-c13fbcd26f56\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c45bf8dcf-6cn6w" Jul 02 13:47:13.708394 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:13.708342 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d7ef52a0-3953-48ec-a8ae-25617d72c722-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-nzf6t\" (UID: \"d7ef52a0-3953-48ec-a8ae-25617d72c722\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-nzf6t" Jul 02 13:47:13.708394 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:13.708380 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d7ef52a0-3953-48ec-a8ae-25617d72c722-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-nzf6t\" (UID: \"d7ef52a0-3953-48ec-a8ae-25617d72c722\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-nzf6t" Jul 02 13:47:13.708683 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:13.708662 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/803fd957-0887-4a0b-bd8d-c13fbcd26f56-tmp\") pod \"klusterlet-addon-workmgr-7c45bf8dcf-6cn6w\" (UID: \"803fd957-0887-4a0b-bd8d-c13fbcd26f56\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c45bf8dcf-6cn6w" Jul 02 13:47:13.710759 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:13.710740 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/803fd957-0887-4a0b-bd8d-c13fbcd26f56-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c45bf8dcf-6cn6w\" (UID: \"803fd957-0887-4a0b-bd8d-c13fbcd26f56\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c45bf8dcf-6cn6w" Jul 02 13:47:13.744442 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:13.744382 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cmgg\" (UniqueName: \"kubernetes.io/projected/803fd957-0887-4a0b-bd8d-c13fbcd26f56-kube-api-access-6cmgg\") pod \"klusterlet-addon-workmgr-7c45bf8dcf-6cn6w\" (UID: \"803fd957-0887-4a0b-bd8d-c13fbcd26f56\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c45bf8dcf-6cn6w" Jul 02 13:47:13.783704 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:13.783668 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c45bf8dcf-6cn6w" Jul 02 13:47:13.809573 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:13.809547 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d7ef52a0-3953-48ec-a8ae-25617d72c722-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-nzf6t\" (UID: \"d7ef52a0-3953-48ec-a8ae-25617d72c722\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-nzf6t" Jul 02 13:47:13.809717 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:13.809577 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d7ef52a0-3953-48ec-a8ae-25617d72c722-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-nzf6t\" (UID: \"d7ef52a0-3953-48ec-a8ae-25617d72c722\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-nzf6t" Jul 02 13:47:13.810324 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:13.810245 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d7ef52a0-3953-48ec-a8ae-25617d72c722-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-nzf6t\" (UID: \"d7ef52a0-3953-48ec-a8ae-25617d72c722\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-nzf6t" Jul 02 13:47:13.812014 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:13.811995 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d7ef52a0-3953-48ec-a8ae-25617d72c722-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-nzf6t\" (UID: \"d7ef52a0-3953-48ec-a8ae-25617d72c722\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-nzf6t" Jul 02 13:47:13.886842 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:13.886813 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-nzf6t" Jul 02 13:47:13.911158 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:13.911086 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c45bf8dcf-6cn6w"] Jul 02 13:47:13.913621 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:47:13.913589 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod803fd957_0887_4a0b_bd8d_c13fbcd26f56.slice/crio-b87eb64bf1614a68ecc01d6250056e987fdb4c2f3ccdf630c1c71a5fa9ba5010 WatchSource:0}: Error finding container b87eb64bf1614a68ecc01d6250056e987fdb4c2f3ccdf630c1c71a5fa9ba5010: Status 404 returned error can't find the container with id b87eb64bf1614a68ecc01d6250056e987fdb4c2f3ccdf630c1c71a5fa9ba5010 Jul 02 13:47:14.025037 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:14.024964 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-nzf6t"] Jul 02 13:47:14.028004 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:47:14.027923 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7ef52a0_3953_48ec_a8ae_25617d72c722.slice/crio-958b092313d584a41ee405f965a9cd17b3223e04e6273018dfaeebd45a8ac2a1 WatchSource:0}: Error finding container 958b092313d584a41ee405f965a9cd17b3223e04e6273018dfaeebd45a8ac2a1: Status 404 returned error can't find the container with id 958b092313d584a41ee405f965a9cd17b3223e04e6273018dfaeebd45a8ac2a1 Jul 02 13:47:14.632378 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:14.632342 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c45bf8dcf-6cn6w" event={"ID":"803fd957-0887-4a0b-bd8d-c13fbcd26f56","Type":"ContainerStarted","Data":"b87eb64bf1614a68ecc01d6250056e987fdb4c2f3ccdf630c1c71a5fa9ba5010"} Jul 02 13:47:14.633415 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:14.633391 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-nzf6t" event={"ID":"d7ef52a0-3953-48ec-a8ae-25617d72c722","Type":"ContainerStarted","Data":"958b092313d584a41ee405f965a9cd17b3223e04e6273018dfaeebd45a8ac2a1"} Jul 02 13:47:15.639213 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:15.639177 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-nzf6t" event={"ID":"d7ef52a0-3953-48ec-a8ae-25617d72c722","Type":"ContainerStarted","Data":"9849cd61e782cfd25d3877b26763472dddc4678599426927ef39c3eea67977e2"} Jul 02 13:47:15.660447 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:15.660380 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-nzf6t" podStartSLOduration=1.472287867 podStartE2EDuration="2.660358994s" totalImagesPullingTime="1.188071127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:47:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:47:15.659597318 +0000 UTC m=+143.939851872" watchObservedRunningTime="2026-07-02 13:47:15.660358994 +0000 UTC m=+143.940613540" Jul 02 13:47:16.024990 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:16.024884 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-cg6rh"] Jul 02 13:47:16.032607 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:16.032577 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-cg6rh" Jul 02 13:47:16.036372 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:16.035571 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 02 13:47:16.036372 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:16.035896 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-m75p4\"" Jul 02 13:47:16.040126 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:16.040099 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-cg6rh"] Jul 02 13:47:16.130039 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:16.129998 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4f37713f-5148-4f50-a054-532a34660de9-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-cg6rh\" (UID: \"4f37713f-5148-4f50-a054-532a34660de9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-cg6rh" Jul 02 13:47:16.231003 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:16.230968 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4f37713f-5148-4f50-a054-532a34660de9-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-cg6rh\" (UID: \"4f37713f-5148-4f50-a054-532a34660de9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-cg6rh" Jul 02 13:47:16.231182 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:47:16.231094 2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 02 13:47:16.231182 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:47:16.231153 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f37713f-5148-4f50-a054-532a34660de9-tls-certificates podName:4f37713f-5148-4f50-a054-532a34660de9 nodeName:}" failed. No retries permitted until 2026-07-02 13:47:16.731136071 +0000 UTC m=+145.011390601 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/4f37713f-5148-4f50-a054-532a34660de9-tls-certificates") pod "prometheus-operator-admission-webhook-7ddc8784d4-cg6rh" (UID: "4f37713f-5148-4f50-a054-532a34660de9") : secret "prometheus-operator-admission-webhook-tls" not found Jul 02 13:47:16.736116 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:16.736073 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4f37713f-5148-4f50-a054-532a34660de9-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-cg6rh\" (UID: \"4f37713f-5148-4f50-a054-532a34660de9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-cg6rh" Jul 02 13:47:16.738878 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:16.738851 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4f37713f-5148-4f50-a054-532a34660de9-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-cg6rh\" (UID: \"4f37713f-5148-4f50-a054-532a34660de9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-cg6rh" Jul 02 13:47:16.944724 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:16.944685 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-cg6rh" Jul 02 13:47:17.140187 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.140150 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/12dc36c3-9cca-4bdb-a9c5-1406643510b5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9brbm\" (UID: \"12dc36c3-9cca-4bdb-a9c5-1406643510b5\") " pod="openshift-insights/insights-runtime-extractor-9brbm" Jul 02 13:47:17.143027 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.142987 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/12dc36c3-9cca-4bdb-a9c5-1406643510b5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9brbm\" (UID: \"12dc36c3-9cca-4bdb-a9c5-1406643510b5\") " pod="openshift-insights/insights-runtime-extractor-9brbm" Jul 02 13:47:17.387836 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.387807 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dmzxj\"" Jul 02 13:47:17.395192 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.395123 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9brbm" Jul 02 13:47:17.613762 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.613733 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-cg6rh"] Jul 02 13:47:17.616911 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:47:17.616891 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f37713f_5148_4f50_a054_532a34660de9.slice/crio-4b1b21c03f7d15d0d48edd22c87044562dfad6b3ed972a139922e1efe3f82724 WatchSource:0}: Error finding container 4b1b21c03f7d15d0d48edd22c87044562dfad6b3ed972a139922e1efe3f82724: Status 404 returned error can't find the container with id 4b1b21c03f7d15d0d48edd22c87044562dfad6b3ed972a139922e1efe3f82724 Jul 02 13:47:17.632668 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.632639 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9brbm"] Jul 02 13:47:17.635579 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:47:17.635555 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12dc36c3_9cca_4bdb_a9c5_1406643510b5.slice/crio-4e147fb4cabaf75db525f4a801a2d68856a39e9b2d2ec5e625a5c9d649d54877 WatchSource:0}: Error finding container 4e147fb4cabaf75db525f4a801a2d68856a39e9b2d2ec5e625a5c9d649d54877: Status 404 returned error can't find the container with id 4e147fb4cabaf75db525f4a801a2d68856a39e9b2d2ec5e625a5c9d649d54877 Jul 02 13:47:17.649353 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.649277 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-cg6rh" event={"ID":"4f37713f-5148-4f50-a054-532a34660de9","Type":"ContainerStarted","Data":"4b1b21c03f7d15d0d48edd22c87044562dfad6b3ed972a139922e1efe3f82724"} Jul 02 13:47:17.651104 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.651077 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c45bf8dcf-6cn6w" event={"ID":"803fd957-0887-4a0b-bd8d-c13fbcd26f56","Type":"ContainerStarted","Data":"9d52aa02c1acf37715b6469d8761bdde312206c25b32be3d16ca22b591c556b0"} Jul 02 13:47:17.651339 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.651286 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c45bf8dcf-6cn6w" Jul 02 13:47:17.652751 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.652726 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c45bf8dcf-6cn6w" Jul 02 13:47:17.653299 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.653279 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9brbm" event={"ID":"12dc36c3-9cca-4bdb-a9c5-1406643510b5","Type":"ContainerStarted","Data":"4e147fb4cabaf75db525f4a801a2d68856a39e9b2d2ec5e625a5c9d649d54877"} Jul 02 13:47:17.674009 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.673962 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c45bf8dcf-6cn6w" podStartSLOduration=1.048440011 podStartE2EDuration="4.673949687s" totalImagesPullingTime="3.625509676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:47:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:47:17.673384199 +0000 UTC m=+145.953638730" watchObservedRunningTime="2026-07-02 13:47:17.673949687 +0000 UTC m=+145.954204235" Jul 02 13:47:17.735789 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.735760 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58599dd996-92wr2"] Jul 02 13:47:17.741627 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.741608 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58599dd996-92wr2" Jul 02 13:47:17.744855 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.744816 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 02 13:47:17.744855 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.744874 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 02 13:47:17.745106 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.744964 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 02 13:47:17.745416 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.745257 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hlnlb\"" Jul 02 13:47:17.745416 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.745261 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 02 13:47:17.745877 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.745860 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 02 13:47:17.746014 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.745883 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 02 13:47:17.746014 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.745996 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 02 13:47:17.753347 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.753324 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58599dd996-92wr2"] Jul 02 13:47:17.845637 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.845608 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1ee8cd2-0adc-401e-b978-c149a7a7b026-service-ca\") pod \"console-58599dd996-92wr2\" (UID: \"d1ee8cd2-0adc-401e-b978-c149a7a7b026\") " pod="openshift-console/console-58599dd996-92wr2" Jul 02 13:47:17.845637 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.845638 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1ee8cd2-0adc-401e-b978-c149a7a7b026-console-config\") pod \"console-58599dd996-92wr2\" (UID: \"d1ee8cd2-0adc-401e-b978-c149a7a7b026\") " pod="openshift-console/console-58599dd996-92wr2" Jul 02 13:47:17.845807 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.845688 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1ee8cd2-0adc-401e-b978-c149a7a7b026-console-oauth-config\") pod \"console-58599dd996-92wr2\" (UID: \"d1ee8cd2-0adc-401e-b978-c149a7a7b026\") " pod="openshift-console/console-58599dd996-92wr2" Jul 02 13:47:17.845807 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.845712 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1ee8cd2-0adc-401e-b978-c149a7a7b026-oauth-serving-cert\") pod \"console-58599dd996-92wr2\" (UID: \"d1ee8cd2-0adc-401e-b978-c149a7a7b026\") " pod="openshift-console/console-58599dd996-92wr2" Jul 02 13:47:17.845807 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.845760 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77j6n\" (UniqueName: \"kubernetes.io/projected/d1ee8cd2-0adc-401e-b978-c149a7a7b026-kube-api-access-77j6n\") pod \"console-58599dd996-92wr2\" (UID: \"d1ee8cd2-0adc-401e-b978-c149a7a7b026\") " pod="openshift-console/console-58599dd996-92wr2" Jul 02 13:47:17.845908 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.845811 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1ee8cd2-0adc-401e-b978-c149a7a7b026-console-serving-cert\") pod \"console-58599dd996-92wr2\" (UID: \"d1ee8cd2-0adc-401e-b978-c149a7a7b026\") " pod="openshift-console/console-58599dd996-92wr2" Jul 02 13:47:17.946562 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.946475 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1ee8cd2-0adc-401e-b978-c149a7a7b026-service-ca\") pod \"console-58599dd996-92wr2\" (UID: \"d1ee8cd2-0adc-401e-b978-c149a7a7b026\") " pod="openshift-console/console-58599dd996-92wr2" Jul 02 13:47:17.946562 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.946504 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1ee8cd2-0adc-401e-b978-c149a7a7b026-console-config\") pod \"console-58599dd996-92wr2\" (UID: \"d1ee8cd2-0adc-401e-b978-c149a7a7b026\") " pod="openshift-console/console-58599dd996-92wr2" Jul 02 13:47:17.946562 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.946548 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1ee8cd2-0adc-401e-b978-c149a7a7b026-console-oauth-config\") pod \"console-58599dd996-92wr2\" (UID: \"d1ee8cd2-0adc-401e-b978-c149a7a7b026\") " pod="openshift-console/console-58599dd996-92wr2" Jul 02 13:47:17.946820 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.946566 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1ee8cd2-0adc-401e-b978-c149a7a7b026-oauth-serving-cert\") pod \"console-58599dd996-92wr2\" (UID: \"d1ee8cd2-0adc-401e-b978-c149a7a7b026\") " pod="openshift-console/console-58599dd996-92wr2" Jul 02 13:47:17.946820 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.946584 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77j6n\" (UniqueName: \"kubernetes.io/projected/d1ee8cd2-0adc-401e-b978-c149a7a7b026-kube-api-access-77j6n\") pod \"console-58599dd996-92wr2\" (UID: \"d1ee8cd2-0adc-401e-b978-c149a7a7b026\") " pod="openshift-console/console-58599dd996-92wr2" Jul 02 13:47:17.946820 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.946628 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1ee8cd2-0adc-401e-b978-c149a7a7b026-console-serving-cert\") pod \"console-58599dd996-92wr2\" (UID: \"d1ee8cd2-0adc-401e-b978-c149a7a7b026\") " pod="openshift-console/console-58599dd996-92wr2" Jul 02 13:47:17.947297 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.947270 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1ee8cd2-0adc-401e-b978-c149a7a7b026-console-config\") pod \"console-58599dd996-92wr2\" (UID: \"d1ee8cd2-0adc-401e-b978-c149a7a7b026\") " pod="openshift-console/console-58599dd996-92wr2" Jul 02 13:47:17.947412 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.947380 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1ee8cd2-0adc-401e-b978-c149a7a7b026-oauth-serving-cert\") pod \"console-58599dd996-92wr2\" (UID: \"d1ee8cd2-0adc-401e-b978-c149a7a7b026\") " pod="openshift-console/console-58599dd996-92wr2" Jul 02 13:47:17.947581 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.947561 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1ee8cd2-0adc-401e-b978-c149a7a7b026-service-ca\") pod \"console-58599dd996-92wr2\" (UID: \"d1ee8cd2-0adc-401e-b978-c149a7a7b026\") " pod="openshift-console/console-58599dd996-92wr2" Jul 02 13:47:17.949040 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.949018 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1ee8cd2-0adc-401e-b978-c149a7a7b026-console-oauth-config\") pod \"console-58599dd996-92wr2\" (UID: \"d1ee8cd2-0adc-401e-b978-c149a7a7b026\") " pod="openshift-console/console-58599dd996-92wr2" Jul 02 13:47:17.949204 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.949186 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1ee8cd2-0adc-401e-b978-c149a7a7b026-console-serving-cert\") pod \"console-58599dd996-92wr2\" (UID: \"d1ee8cd2-0adc-401e-b978-c149a7a7b026\") " pod="openshift-console/console-58599dd996-92wr2" Jul 02 13:47:17.955893 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:17.955869 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77j6n\" (UniqueName: \"kubernetes.io/projected/d1ee8cd2-0adc-401e-b978-c149a7a7b026-kube-api-access-77j6n\") pod \"console-58599dd996-92wr2\" (UID: \"d1ee8cd2-0adc-401e-b978-c149a7a7b026\") " pod="openshift-console/console-58599dd996-92wr2" Jul 02 13:47:18.053988 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:18.053953 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58599dd996-92wr2" Jul 02 13:47:18.220418 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:18.220313 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58599dd996-92wr2"] Jul 02 13:47:18.222874 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:47:18.222849 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1ee8cd2_0adc_401e_b978_c149a7a7b026.slice/crio-50cf51243f85b06e8122152fa3042eb2b1c739c18525b720103ee5ac73e6cdf7 WatchSource:0}: Error finding container 50cf51243f85b06e8122152fa3042eb2b1c739c18525b720103ee5ac73e6cdf7: Status 404 returned error can't find the container with id 50cf51243f85b06e8122152fa3042eb2b1c739c18525b720103ee5ac73e6cdf7 Jul 02 13:47:18.660317 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:18.660251 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58599dd996-92wr2" event={"ID":"d1ee8cd2-0adc-401e-b978-c149a7a7b026","Type":"ContainerStarted","Data":"50cf51243f85b06e8122152fa3042eb2b1c739c18525b720103ee5ac73e6cdf7"} Jul 02 13:47:23.679394 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:23.679352 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9brbm" event={"ID":"12dc36c3-9cca-4bdb-a9c5-1406643510b5","Type":"ContainerStarted","Data":"b31ebadba59f35f7c7fdab30f4fedf53d93d9374bbd1716f75bcdc99395510eb"} Jul 02 13:47:23.679810 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:23.679417 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9brbm" event={"ID":"12dc36c3-9cca-4bdb-a9c5-1406643510b5","Type":"ContainerStarted","Data":"58ecac8067c3f6eb1d95a26b46860abfb636977e98c1768f3e74312f0a3d192f"} Jul 02 13:47:23.680730 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:23.680701 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58599dd996-92wr2" event={"ID":"d1ee8cd2-0adc-401e-b978-c149a7a7b026","Type":"ContainerStarted","Data":"f3b9e1344ae9a851ff445437b9b1249901598d4119abacb964d0035bf6dc5f8c"} Jul 02 13:47:23.682055 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:23.682032 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-cg6rh" event={"ID":"4f37713f-5148-4f50-a054-532a34660de9","Type":"ContainerStarted","Data":"255f08cfb09c83c856bbf2fce69ec22b7509930e1431ab1dac552dd65a0c605c"} Jul 02 13:47:23.682236 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:23.682216 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-cg6rh" Jul 02 13:47:23.686660 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:23.686634 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-cg6rh" Jul 02 13:47:23.716328 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:23.716038 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58599dd996-92wr2" podStartSLOduration=2.276696966 podStartE2EDuration="6.71601743s" totalImagesPullingTime="4.439320464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:47:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:47:23.715554036 +0000 UTC m=+151.995808567" watchObservedRunningTime="2026-07-02 13:47:23.71601743 +0000 UTC m=+151.996271970" Jul 02 13:47:23.743148 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:23.743082 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-cg6rh" podStartSLOduration=3.706593432 podStartE2EDuration="8.743064306s" totalImagesPullingTime="5.036470874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:47:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:47:23.738510675 +0000 UTC m=+152.018765207" watchObservedRunningTime="2026-07-02 13:47:23.743064306 +0000 UTC m=+152.023318850" Jul 02 13:47:26.694562 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:26.694522 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9brbm" event={"ID":"12dc36c3-9cca-4bdb-a9c5-1406643510b5","Type":"ContainerStarted","Data":"c0304b3b65b947bd5748ddd8da9e8531b44ce360b0a8ab26b0662627110e4ade"} Jul 02 13:47:26.716041 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:26.715975 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9brbm" podStartSLOduration=33.51414564 podStartE2EDuration="41.715954269s" totalImagesPullingTime="8.201808629s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:46:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:47:26.715480998 +0000 UTC m=+154.995735546" watchObservedRunningTime="2026-07-02 13:47:26.715954269 +0000 UTC m=+154.996208793" Jul 02 13:47:28.054640 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:28.054594 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58599dd996-92wr2" Jul 02 13:47:28.055050 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:28.054669 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58599dd996-92wr2" Jul 02 13:47:28.055911 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:28.055890 2563 patch_prober.go:28] interesting pod/console-58599dd996-92wr2 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.17:8443/health\": dial tcp 10.132.0.17:8443: connect: connection refused" start-of-body= Jul 02 13:47:28.055980 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:28.055946 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-58599dd996-92wr2" podUID="d1ee8cd2-0adc-401e-b978-c149a7a7b026" containerName="console" probeResult="failure" output="Get \"https://10.132.0.17:8443/health\": dial tcp 10.132.0.17:8443: connect: connection refused" Jul 02 13:47:30.630431 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:47:30.630382 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" podUID="d2e7b7d2-3bda-42bf-b87f-62e9387872dc" Jul 02 13:47:30.641540 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:47:30.641508 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dmq79" podUID="888590ed-3122-4425-816a-1292d70e3086" Jul 02 13:47:30.707413 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:30.707390 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dmq79" Jul 02 13:47:30.707545 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:30.707390 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:47:35.593207 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:35.593171 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-registry-tls\") pod \"image-registry-9dd8f84df-2kc75\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:47:35.593207 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:35.593209 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/888590ed-3122-4425-816a-1292d70e3086-metrics-tls\") pod \"dns-default-dmq79\" (UID: \"888590ed-3122-4425-816a-1292d70e3086\") " pod="openshift-dns/dns-default-dmq79" Jul 02 13:47:35.595759 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:35.595737 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/888590ed-3122-4425-816a-1292d70e3086-metrics-tls\") pod \"dns-default-dmq79\" (UID: \"888590ed-3122-4425-816a-1292d70e3086\") " pod="openshift-dns/dns-default-dmq79" Jul 02 13:47:35.595831 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:35.595748 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-registry-tls\") pod \"image-registry-9dd8f84df-2kc75\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:47:35.812368 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:35.812337 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pnc7w\"" Jul 02 13:47:35.812368 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:35.812338 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dkwdr\"" Jul 02 13:47:35.818673 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:35.818651 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dmq79" Jul 02 13:47:35.818768 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:35.818751 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:47:35.966737 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:35.966703 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9dd8f84df-2kc75"] Jul 02 13:47:35.969464 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:47:35.969430 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2e7b7d2_3bda_42bf_b87f_62e9387872dc.slice/crio-fdb0b1343282c8e00e72e65a66ee7daa2af451069e57e9c6ce34194ceebd43ce WatchSource:0}: Error finding container fdb0b1343282c8e00e72e65a66ee7daa2af451069e57e9c6ce34194ceebd43ce: Status 404 returned error can't find the container with id fdb0b1343282c8e00e72e65a66ee7daa2af451069e57e9c6ce34194ceebd43ce Jul 02 13:47:35.974074 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:35.974052 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dmq79"] Jul 02 13:47:35.977280 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:47:35.977259 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod888590ed_3122_4425_816a_1292d70e3086.slice/crio-34518006a524e13fed437ea4b9277fa425a6f68fa9363fd21c671628f33d3ffb WatchSource:0}: Error finding container 34518006a524e13fed437ea4b9277fa425a6f68fa9363fd21c671628f33d3ffb: Status 404 returned error can't find the container with id 34518006a524e13fed437ea4b9277fa425a6f68fa9363fd21c671628f33d3ffb Jul 02 13:47:36.729970 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:36.729907 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dmq79" event={"ID":"888590ed-3122-4425-816a-1292d70e3086","Type":"ContainerStarted","Data":"34518006a524e13fed437ea4b9277fa425a6f68fa9363fd21c671628f33d3ffb"} Jul 02 13:47:36.731465 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:36.731435 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" event={"ID":"d2e7b7d2-3bda-42bf-b87f-62e9387872dc","Type":"ContainerStarted","Data":"caaa8c3026e26a461969dcd0072e64b967bad560f796286792a28a1bcac0bece"} Jul 02 13:47:36.731580 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:36.731483 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" event={"ID":"d2e7b7d2-3bda-42bf-b87f-62e9387872dc","Type":"ContainerStarted","Data":"fdb0b1343282c8e00e72e65a66ee7daa2af451069e57e9c6ce34194ceebd43ce"} Jul 02 13:47:36.731580 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:36.731534 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:47:36.755173 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:36.755114 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" podStartSLOduration=164.755094155 podStartE2EDuration="2m44.755094155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:44:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:47:36.753516888 +0000 UTC m=+165.033771420" watchObservedRunningTime="2026-07-02 13:47:36.755094155 +0000 UTC m=+165.035348688" Jul 02 13:47:37.738182 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:37.738122 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dmq79" event={"ID":"888590ed-3122-4425-816a-1292d70e3086","Type":"ContainerStarted","Data":"59576aa7c3948df7ff22012c9bb7141406077aada6d3a230bb839cc232fbd375"} Jul 02 13:47:38.054797 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:38.054712 2563 patch_prober.go:28] interesting pod/console-58599dd996-92wr2 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.17:8443/health\": dial tcp 10.132.0.17:8443: connect: connection refused" start-of-body= Jul 02 13:47:38.054797 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:38.054767 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-58599dd996-92wr2" podUID="d1ee8cd2-0adc-401e-b978-c149a7a7b026" containerName="console" probeResult="failure" output="Get \"https://10.132.0.17:8443/health\": dial tcp 10.132.0.17:8443: connect: connection refused" Jul 02 13:47:38.742802 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:38.742768 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dmq79" event={"ID":"888590ed-3122-4425-816a-1292d70e3086","Type":"ContainerStarted","Data":"9aa4c8b547fa0f94e9cbcb7f459397a2ecf3627af79715198ff549dc95953549"} Jul 02 13:47:38.743231 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:38.742898 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dmq79" Jul 02 13:47:38.763030 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:38.762972 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dmq79" podStartSLOduration=130.144489513 podStartE2EDuration="2m11.762924732s" totalImagesPullingTime="1.618435219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:45:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:47:38.761746993 +0000 UTC m=+167.042001541" watchObservedRunningTime="2026-07-02 13:47:38.762924732 +0000 UTC m=+167.043179240" Jul 02 13:47:39.507522 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:39.507490 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gtlvt"] Jul 02 13:47:39.510694 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:39.510680 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gtlvt" Jul 02 13:47:39.513526 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:39.513505 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 13:47:39.514211 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:39.514195 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 13:47:39.514515 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:39.514496 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 13:47:39.515385 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:39.514961 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 13:47:39.515385 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:39.515120 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mczhp\"" Jul 02 13:47:39.515385 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:39.515287 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 13:47:39.515917 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:39.515898 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 13:47:39.624212 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:39.624174 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3a5dfa19-40b6-42b3-9723-830f449d7aa4-node-exporter-accelerators-collector-config\") pod \"node-exporter-gtlvt\" (UID: \"3a5dfa19-40b6-42b3-9723-830f449d7aa4\") " pod="openshift-monitoring/node-exporter-gtlvt" Jul 02 13:47:39.624212 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:39.624212 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qphcf\" (UniqueName: \"kubernetes.io/projected/3a5dfa19-40b6-42b3-9723-830f449d7aa4-kube-api-access-qphcf\") pod \"node-exporter-gtlvt\" (UID: \"3a5dfa19-40b6-42b3-9723-830f449d7aa4\") " pod="openshift-monitoring/node-exporter-gtlvt" Jul 02 13:47:39.624417 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:39.624268 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a5dfa19-40b6-42b3-9723-830f449d7aa4-metrics-client-ca\") pod \"node-exporter-gtlvt\" (UID: \"3a5dfa19-40b6-42b3-9723-830f449d7aa4\") " pod="openshift-monitoring/node-exporter-gtlvt" Jul 02 13:47:39.624417 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:39.624296 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a5dfa19-40b6-42b3-9723-830f449d7aa4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gtlvt\" (UID: \"3a5dfa19-40b6-42b3-9723-830f449d7aa4\") " pod="openshift-monitoring/node-exporter-gtlvt" Jul 02 13:47:39.624417 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:39.624321 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3a5dfa19-40b6-42b3-9723-830f449d7aa4-node-exporter-tls\") pod \"node-exporter-gtlvt\" (UID: \"3a5dfa19-40b6-42b3-9723-830f449d7aa4\") " pod="openshift-monitoring/node-exporter-gtlvt" Jul 02 13:47:39.624417 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:39.624383 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3a5dfa19-40b6-42b3-9723-830f449d7aa4-root\") pod \"node-exporter-gtlvt\" (UID: \"3a5dfa19-40b6-42b3-9723-830f449d7aa4\") " pod="openshift-monitoring/node-exporter-gtlvt" Jul 02 13:47:39.624417 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:39.624414 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a5dfa19-40b6-42b3-9723-830f449d7aa4-sys\") pod \"node-exporter-gtlvt\" (UID: \"3a5dfa19-40b6-42b3-9723-830f449d7aa4\") " pod="openshift-monitoring/node-exporter-gtlvt" Jul 02 13:47:39.624565 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:39.624432 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3a5dfa19-40b6-42b3-9723-830f449d7aa4-node-exporter-wtmp\") pod \"node-exporter-gtlvt\" (UID: \"3a5dfa19-40b6-42b3-9723-830f449d7aa4\") " pod="openshift-monitoring/node-exporter-gtlvt" Jul 02 13:47:39.624565 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:39.624507 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3a5dfa19-40b6-42b3-9723-830f449d7aa4-node-exporter-textfile\") pod \"node-exporter-gtlvt\" (UID: \"3a5dfa19-40b6-42b3-9723-830f449d7aa4\") " pod="openshift-monitoring/node-exporter-gtlvt" Jul 02 13:47:39.726449 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:39.726408 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3a5dfa19-40b6-42b3-9723-830f449d7aa4-node-exporter-accelerators-collector-config\") pod \"node-exporter-gtlvt\" (UID: \"3a5dfa19-40b6-42b3-9723-830f449d7aa4\") " pod="openshift-monitoring/node-exporter-gtlvt" Jul 02 13:47:39.726449 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:39.726454 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qphcf\" (UniqueName: \"kubernetes.io/projected/3a5dfa19-40b6-42b3-9723-830f449d7aa4-kube-api-access-qphcf\") pod \"node-exporter-gtlvt\" (UID: \"3a5dfa19-40b6-42b3-9723-830f449d7aa4\") " pod="openshift-monitoring/node-exporter-gtlvt" Jul 02 13:47:39.726694 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:39.726494 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a5dfa19-40b6-42b3-9723-830f449d7aa4-metrics-client-ca\") pod \"node-exporter-gtlvt\" (UID: \"3a5dfa19-40b6-42b3-9723-830f449d7aa4\") " pod="openshift-monitoring/node-exporter-gtlvt" Jul 02 13:47:39.726694 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:39.726534 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a5dfa19-40b6-42b3-9723-830f449d7aa4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gtlvt\" (UID: \"3a5dfa19-40b6-42b3-9723-830f449d7aa4\") " pod="openshift-monitoring/node-exporter-gtlvt" Jul 02 13:47:39.726795 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:39.726682 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3a5dfa19-40b6-42b3-9723-830f449d7aa4-node-exporter-tls\") pod \"node-exporter-gtlvt\" (UID: \"3a5dfa19-40b6-42b3-9723-830f449d7aa4\") " pod="openshift-monitoring/node-exporter-gtlvt" Jul 02 13:47:39.726795 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:39.726735 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3a5dfa19-40b6-42b3-9723-830f449d7aa4-root\") pod \"node-exporter-gtlvt\" (UID: \"3a5dfa19-40b6-42b3-9723-830f449d7aa4\") " pod="openshift-monitoring/node-exporter-gtlvt" Jul 02 13:47:39.726795 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:39.726769 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a5dfa19-40b6-42b3-9723-830f449d7aa4-sys\") pod \"node-exporter-gtlvt\" (UID: \"3a5dfa19-40b6-42b3-9723-830f449d7aa4\") " pod="openshift-monitoring/node-exporter-gtlvt" Jul 02 13:47:39.726963 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:39.726794 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3a5dfa19-40b6-42b3-9723-830f449d7aa4-node-exporter-wtmp\") pod \"node-exporter-gtlvt\" (UID: \"3a5dfa19-40b6-42b3-9723-830f449d7aa4\") " pod="openshift-monitoring/node-exporter-gtlvt" Jul 02 13:47:39.726963 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:47:39.726826 2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 02 13:47:39.726963 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:39.726862 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3a5dfa19-40b6-42b3-9723-830f449d7aa4-root\") pod \"node-exporter-gtlvt\" (UID: \"3a5dfa19-40b6-42b3-9723-830f449d7aa4\") " pod="openshift-monitoring/node-exporter-gtlvt" Jul 02 13:47:39.726963 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:47:39.726891 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a5dfa19-40b6-42b3-9723-830f449d7aa4-node-exporter-tls podName:3a5dfa19-40b6-42b3-9723-830f449d7aa4 nodeName:}" failed. No retries permitted until 2026-07-02 13:47:40.226873548 +0000 UTC m=+168.507128076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3a5dfa19-40b6-42b3-9723-830f449d7aa4-node-exporter-tls") pod "node-exporter-gtlvt" (UID: "3a5dfa19-40b6-42b3-9723-830f449d7aa4") : secret "node-exporter-tls" not found Jul 02 13:47:39.726963 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:39.726912 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3a5dfa19-40b6-42b3-9723-830f449d7aa4-node-exporter-textfile\") pod \"node-exporter-gtlvt\" (UID: \"3a5dfa19-40b6-42b3-9723-830f449d7aa4\") " pod="openshift-monitoring/node-exporter-gtlvt" Jul 02 13:47:39.726963 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:39.726920 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a5dfa19-40b6-42b3-9723-830f449d7aa4-sys\") pod \"node-exporter-gtlvt\" (UID: \"3a5dfa19-40b6-42b3-9723-830f449d7aa4\") " pod="openshift-monitoring/node-exporter-gtlvt" Jul 02 13:47:39.727238 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:39.726978 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3a5dfa19-40b6-42b3-9723-830f449d7aa4-node-exporter-wtmp\") pod \"node-exporter-gtlvt\" (UID: \"3a5dfa19-40b6-42b3-9723-830f449d7aa4\") " pod="openshift-monitoring/node-exporter-gtlvt" Jul 02 13:47:39.727238 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:39.727154 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3a5dfa19-40b6-42b3-9723-830f449d7aa4-node-exporter-accelerators-collector-config\") pod \"node-exporter-gtlvt\" (UID: \"3a5dfa19-40b6-42b3-9723-830f449d7aa4\") " pod="openshift-monitoring/node-exporter-gtlvt" Jul 02 13:47:39.727238 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:39.727176 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a5dfa19-40b6-42b3-9723-830f449d7aa4-metrics-client-ca\") pod \"node-exporter-gtlvt\" (UID: \"3a5dfa19-40b6-42b3-9723-830f449d7aa4\") " pod="openshift-monitoring/node-exporter-gtlvt" Jul 02 13:47:39.727238 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:39.727227 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3a5dfa19-40b6-42b3-9723-830f449d7aa4-node-exporter-textfile\") pod \"node-exporter-gtlvt\" (UID: \"3a5dfa19-40b6-42b3-9723-830f449d7aa4\") " pod="openshift-monitoring/node-exporter-gtlvt" Jul 02 13:47:39.729417 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:39.729396 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a5dfa19-40b6-42b3-9723-830f449d7aa4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gtlvt\" (UID: \"3a5dfa19-40b6-42b3-9723-830f449d7aa4\") " pod="openshift-monitoring/node-exporter-gtlvt" Jul 02 13:47:39.742317 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:39.742296 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qphcf\" (UniqueName: \"kubernetes.io/projected/3a5dfa19-40b6-42b3-9723-830f449d7aa4-kube-api-access-qphcf\") pod \"node-exporter-gtlvt\" (UID: \"3a5dfa19-40b6-42b3-9723-830f449d7aa4\") " pod="openshift-monitoring/node-exporter-gtlvt" Jul 02 13:47:40.230957 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:40.230887 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3a5dfa19-40b6-42b3-9723-830f449d7aa4-node-exporter-tls\") pod \"node-exporter-gtlvt\" (UID: \"3a5dfa19-40b6-42b3-9723-830f449d7aa4\") " pod="openshift-monitoring/node-exporter-gtlvt" Jul 02 13:47:40.233366 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:40.233344 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3a5dfa19-40b6-42b3-9723-830f449d7aa4-node-exporter-tls\") pod \"node-exporter-gtlvt\" (UID: \"3a5dfa19-40b6-42b3-9723-830f449d7aa4\") " pod="openshift-monitoring/node-exporter-gtlvt" Jul 02 13:47:40.420811 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:40.420776 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gtlvt" Jul 02 13:47:40.750516 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:40.750484 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gtlvt" event={"ID":"3a5dfa19-40b6-42b3-9723-830f449d7aa4","Type":"ContainerStarted","Data":"855607024fc906729e8c037145366adc7a9a4adef27c053d46e06ef1799737a7"} Jul 02 13:47:41.503516 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.503485 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj"] Jul 02 13:47:41.507325 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.507301 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj" Jul 02 13:47:41.510528 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.510344 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 02 13:47:41.510528 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.510346 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 02 13:47:41.510528 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.510344 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 02 13:47:41.510528 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.510467 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-lzm6s\"" Jul 02 13:47:41.510841 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.510647 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 02 13:47:41.510841 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.510667 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-85fsai53qf365\"" Jul 02 13:47:41.511464 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.511450 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 02 13:47:41.524303 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.524272 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj"] Jul 02 13:47:41.642624 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.642590 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plcf4\" (UniqueName: \"kubernetes.io/projected/13a96d5b-9754-47a9-8d66-5bb826b3be73-kube-api-access-plcf4\") pod \"thanos-querier-5f4dfb4495-wxnwj\" (UID: \"13a96d5b-9754-47a9-8d66-5bb826b3be73\") " pod="openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj" Jul 02 13:47:41.642797 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.642652 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13a96d5b-9754-47a9-8d66-5bb826b3be73-metrics-client-ca\") pod \"thanos-querier-5f4dfb4495-wxnwj\" (UID: \"13a96d5b-9754-47a9-8d66-5bb826b3be73\") " pod="openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj" Jul 02 13:47:41.642797 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.642685 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/13a96d5b-9754-47a9-8d66-5bb826b3be73-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f4dfb4495-wxnwj\" (UID: \"13a96d5b-9754-47a9-8d66-5bb826b3be73\") " pod="openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj" Jul 02 13:47:41.642797 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.642745 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/13a96d5b-9754-47a9-8d66-5bb826b3be73-secret-thanos-querier-tls\") pod \"thanos-querier-5f4dfb4495-wxnwj\" (UID: \"13a96d5b-9754-47a9-8d66-5bb826b3be73\") " pod="openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj" Jul 02 13:47:41.642797 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.642781 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/13a96d5b-9754-47a9-8d66-5bb826b3be73-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f4dfb4495-wxnwj\" (UID: \"13a96d5b-9754-47a9-8d66-5bb826b3be73\") " pod="openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj" Jul 02 13:47:41.642987 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.642834 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/13a96d5b-9754-47a9-8d66-5bb826b3be73-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f4dfb4495-wxnwj\" (UID: \"13a96d5b-9754-47a9-8d66-5bb826b3be73\") " pod="openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj" Jul 02 13:47:41.642987 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.642859 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/13a96d5b-9754-47a9-8d66-5bb826b3be73-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f4dfb4495-wxnwj\" (UID: \"13a96d5b-9754-47a9-8d66-5bb826b3be73\") " pod="openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj" Jul 02 13:47:41.642987 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.642885 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/13a96d5b-9754-47a9-8d66-5bb826b3be73-secret-grpc-tls\") pod \"thanos-querier-5f4dfb4495-wxnwj\" (UID: \"13a96d5b-9754-47a9-8d66-5bb826b3be73\") " pod="openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj" Jul 02 13:47:41.743538 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.743423 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/13a96d5b-9754-47a9-8d66-5bb826b3be73-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f4dfb4495-wxnwj\" (UID: \"13a96d5b-9754-47a9-8d66-5bb826b3be73\") " pod="openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj" Jul 02 13:47:41.743538 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.743478 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/13a96d5b-9754-47a9-8d66-5bb826b3be73-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f4dfb4495-wxnwj\" (UID: \"13a96d5b-9754-47a9-8d66-5bb826b3be73\") " pod="openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj" Jul 02 13:47:41.743538 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.743499 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/13a96d5b-9754-47a9-8d66-5bb826b3be73-secret-grpc-tls\") pod \"thanos-querier-5f4dfb4495-wxnwj\" (UID: \"13a96d5b-9754-47a9-8d66-5bb826b3be73\") " pod="openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj" Jul 02 13:47:41.743538 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.743524 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plcf4\" (UniqueName: \"kubernetes.io/projected/13a96d5b-9754-47a9-8d66-5bb826b3be73-kube-api-access-plcf4\") pod \"thanos-querier-5f4dfb4495-wxnwj\" (UID: \"13a96d5b-9754-47a9-8d66-5bb826b3be73\") " pod="openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj" Jul 02 13:47:41.743865 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.743558 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13a96d5b-9754-47a9-8d66-5bb826b3be73-metrics-client-ca\") pod \"thanos-querier-5f4dfb4495-wxnwj\" (UID: \"13a96d5b-9754-47a9-8d66-5bb826b3be73\") " pod="openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj" Jul 02 13:47:41.743865 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.743595 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/13a96d5b-9754-47a9-8d66-5bb826b3be73-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f4dfb4495-wxnwj\" (UID: \"13a96d5b-9754-47a9-8d66-5bb826b3be73\") " pod="openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj" Jul 02 13:47:41.743865 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.743625 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/13a96d5b-9754-47a9-8d66-5bb826b3be73-secret-thanos-querier-tls\") pod \"thanos-querier-5f4dfb4495-wxnwj\" (UID: \"13a96d5b-9754-47a9-8d66-5bb826b3be73\") " pod="openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj" Jul 02 13:47:41.743865 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.743658 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/13a96d5b-9754-47a9-8d66-5bb826b3be73-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f4dfb4495-wxnwj\" (UID: \"13a96d5b-9754-47a9-8d66-5bb826b3be73\") " pod="openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj" Jul 02 13:47:41.744764 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.744732 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13a96d5b-9754-47a9-8d66-5bb826b3be73-metrics-client-ca\") pod \"thanos-querier-5f4dfb4495-wxnwj\" (UID: \"13a96d5b-9754-47a9-8d66-5bb826b3be73\") " pod="openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj" Jul 02 13:47:41.746448 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.746390 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/13a96d5b-9754-47a9-8d66-5bb826b3be73-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f4dfb4495-wxnwj\" (UID: \"13a96d5b-9754-47a9-8d66-5bb826b3be73\") " pod="openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj" Jul 02 13:47:41.746448 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.746432 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/13a96d5b-9754-47a9-8d66-5bb826b3be73-secret-thanos-querier-tls\") pod \"thanos-querier-5f4dfb4495-wxnwj\" (UID: \"13a96d5b-9754-47a9-8d66-5bb826b3be73\") " pod="openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj" Jul 02 13:47:41.746687 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.746666 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/13a96d5b-9754-47a9-8d66-5bb826b3be73-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f4dfb4495-wxnwj\" (UID: \"13a96d5b-9754-47a9-8d66-5bb826b3be73\") " pod="openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj" Jul 02 13:47:41.746733 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.746716 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/13a96d5b-9754-47a9-8d66-5bb826b3be73-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f4dfb4495-wxnwj\" (UID: \"13a96d5b-9754-47a9-8d66-5bb826b3be73\") " pod="openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj" Jul 02 13:47:41.746872 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.746853 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/13a96d5b-9754-47a9-8d66-5bb826b3be73-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f4dfb4495-wxnwj\" (UID: \"13a96d5b-9754-47a9-8d66-5bb826b3be73\") " pod="openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj" Jul 02 13:47:41.746957 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.746916 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/13a96d5b-9754-47a9-8d66-5bb826b3be73-secret-grpc-tls\") pod \"thanos-querier-5f4dfb4495-wxnwj\" (UID: \"13a96d5b-9754-47a9-8d66-5bb826b3be73\") " pod="openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj" Jul 02 13:47:41.757635 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.757610 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plcf4\" (UniqueName: \"kubernetes.io/projected/13a96d5b-9754-47a9-8d66-5bb826b3be73-kube-api-access-plcf4\") pod \"thanos-querier-5f4dfb4495-wxnwj\" (UID: \"13a96d5b-9754-47a9-8d66-5bb826b3be73\") " pod="openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj" Jul 02 13:47:41.758065 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.758045 2563 generic.go:356] "Generic (PLEG): container finished" podID="3a5dfa19-40b6-42b3-9723-830f449d7aa4" containerID="43781e6781c44040960fbd4d0e455e7c52558d1126384cbf1810d899bf02e2f6" exitCode=0 Jul 02 13:47:41.758119 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.758087 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gtlvt" event={"ID":"3a5dfa19-40b6-42b3-9723-830f449d7aa4","Type":"ContainerDied","Data":"43781e6781c44040960fbd4d0e455e7c52558d1126384cbf1810d899bf02e2f6"} Jul 02 13:47:41.817410 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.817384 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj" Jul 02 13:47:41.955885 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:41.955852 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj"] Jul 02 13:47:41.958582 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:47:41.958559 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13a96d5b_9754_47a9_8d66_5bb826b3be73.slice/crio-8193ae9dd6518ff20d18a8e536c5d18570fbefb2112391c403727bf75c90bc44 WatchSource:0}: Error finding container 8193ae9dd6518ff20d18a8e536c5d18570fbefb2112391c403727bf75c90bc44: Status 404 returned error can't find the container with id 8193ae9dd6518ff20d18a8e536c5d18570fbefb2112391c403727bf75c90bc44 Jul 02 13:47:42.763468 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:42.763368 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj" event={"ID":"13a96d5b-9754-47a9-8d66-5bb826b3be73","Type":"ContainerStarted","Data":"8193ae9dd6518ff20d18a8e536c5d18570fbefb2112391c403727bf75c90bc44"} Jul 02 13:47:42.765711 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:42.765686 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gtlvt" event={"ID":"3a5dfa19-40b6-42b3-9723-830f449d7aa4","Type":"ContainerStarted","Data":"46adf9b848028eaff6b7f591dffc45d80b79886991113272e595a99802cbe4b1"} Jul 02 13:47:42.765814 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:42.765733 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gtlvt" event={"ID":"3a5dfa19-40b6-42b3-9723-830f449d7aa4","Type":"ContainerStarted","Data":"230c98f7e81cbde040a41dad89782c129d0f64c383ef40dff3ea0e9e5faa361a"} Jul 02 13:47:42.791179 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:42.791125 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gtlvt" podStartSLOduration=2.753798312 podStartE2EDuration="3.791103783s" totalImagesPullingTime="965.352603ms" totalInitContainerRuntime="71.952868ms" isStatefulPod=true podCreationTimestamp="2026-07-02 13:47:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:47:42.789287858 +0000 UTC m=+171.069542404" watchObservedRunningTime="2026-07-02 13:47:42.791103783 +0000 UTC m=+171.071358315" Jul 02 13:47:44.337141 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.337108 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58599dd996-92wr2"] Jul 02 13:47:44.358833 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.358756 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-zqjj8"] Jul 02 13:47:44.362197 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.362175 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-zqjj8" Jul 02 13:47:44.365014 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.364990 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 02 13:47:44.365014 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.365007 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-v5kxz\"" Jul 02 13:47:44.373181 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.373156 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-zqjj8"] Jul 02 13:47:44.388948 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.388908 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d8b66bb7f-zngn9"] Jul 02 13:47:44.391915 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.391898 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d8b66bb7f-zngn9" Jul 02 13:47:44.400004 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.399982 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 02 13:47:44.403994 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.403972 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d8b66bb7f-zngn9"] Jul 02 13:47:44.465167 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.465134 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp8b2\" (UniqueName: \"kubernetes.io/projected/57320423-1f32-4113-972c-1511902243a8-kube-api-access-gp8b2\") pod \"monitoring-plugin-cd8656b8-zqjj8\" (UID: \"57320423-1f32-4113-972c-1511902243a8\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-zqjj8" Jul 02 13:47:44.465361 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.465211 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/57320423-1f32-4113-972c-1511902243a8-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-zqjj8\" (UID: \"57320423-1f32-4113-972c-1511902243a8\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-zqjj8" Jul 02 13:47:44.565694 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.565660 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-console-config\") pod \"console-d8b66bb7f-zngn9\" (UID: \"f18e6c98-f0e3-473d-8ec1-57ec4db432d2\") " pod="openshift-console/console-d8b66bb7f-zngn9" Jul 02 13:47:44.565694 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.565693 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-oauth-serving-cert\") pod \"console-d8b66bb7f-zngn9\" (UID: \"f18e6c98-f0e3-473d-8ec1-57ec4db432d2\") " pod="openshift-console/console-d8b66bb7f-zngn9" Jul 02 13:47:44.565895 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.565717 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77z5m\" (UniqueName: \"kubernetes.io/projected/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-kube-api-access-77z5m\") pod \"console-d8b66bb7f-zngn9\" (UID: \"f18e6c98-f0e3-473d-8ec1-57ec4db432d2\") " pod="openshift-console/console-d8b66bb7f-zngn9" Jul 02 13:47:44.565895 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.565783 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-service-ca\") pod \"console-d8b66bb7f-zngn9\" (UID: \"f18e6c98-f0e3-473d-8ec1-57ec4db432d2\") " pod="openshift-console/console-d8b66bb7f-zngn9" Jul 02 13:47:44.565895 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.565844 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/57320423-1f32-4113-972c-1511902243a8-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-zqjj8\" (UID: \"57320423-1f32-4113-972c-1511902243a8\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-zqjj8" Jul 02 13:47:44.566091 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.565917 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-console-serving-cert\") pod \"console-d8b66bb7f-zngn9\" (UID: \"f18e6c98-f0e3-473d-8ec1-57ec4db432d2\") " pod="openshift-console/console-d8b66bb7f-zngn9" Jul 02 13:47:44.566091 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.565983 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-console-oauth-config\") pod \"console-d8b66bb7f-zngn9\" (UID: \"f18e6c98-f0e3-473d-8ec1-57ec4db432d2\") " pod="openshift-console/console-d8b66bb7f-zngn9" Jul 02 13:47:44.566091 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.566010 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-trusted-ca-bundle\") pod \"console-d8b66bb7f-zngn9\" (UID: \"f18e6c98-f0e3-473d-8ec1-57ec4db432d2\") " pod="openshift-console/console-d8b66bb7f-zngn9" Jul 02 13:47:44.566091 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.566053 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp8b2\" (UniqueName: \"kubernetes.io/projected/57320423-1f32-4113-972c-1511902243a8-kube-api-access-gp8b2\") pod \"monitoring-plugin-cd8656b8-zqjj8\" (UID: \"57320423-1f32-4113-972c-1511902243a8\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-zqjj8" Jul 02 13:47:44.568392 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.568371 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/57320423-1f32-4113-972c-1511902243a8-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-zqjj8\" (UID: \"57320423-1f32-4113-972c-1511902243a8\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-zqjj8" Jul 02 13:47:44.575007 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.574989 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp8b2\" (UniqueName: \"kubernetes.io/projected/57320423-1f32-4113-972c-1511902243a8-kube-api-access-gp8b2\") pod \"monitoring-plugin-cd8656b8-zqjj8\" (UID: \"57320423-1f32-4113-972c-1511902243a8\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-zqjj8" Jul 02 13:47:44.666987 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.666858 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-console-config\") pod \"console-d8b66bb7f-zngn9\" (UID: \"f18e6c98-f0e3-473d-8ec1-57ec4db432d2\") " pod="openshift-console/console-d8b66bb7f-zngn9" Jul 02 13:47:44.666987 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.666895 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-oauth-serving-cert\") pod \"console-d8b66bb7f-zngn9\" (UID: \"f18e6c98-f0e3-473d-8ec1-57ec4db432d2\") " pod="openshift-console/console-d8b66bb7f-zngn9" Jul 02 13:47:44.666987 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.666914 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77z5m\" (UniqueName: \"kubernetes.io/projected/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-kube-api-access-77z5m\") pod \"console-d8b66bb7f-zngn9\" (UID: \"f18e6c98-f0e3-473d-8ec1-57ec4db432d2\") " pod="openshift-console/console-d8b66bb7f-zngn9" Jul 02 13:47:44.666987 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.666975 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-service-ca\") pod \"console-d8b66bb7f-zngn9\" (UID: \"f18e6c98-f0e3-473d-8ec1-57ec4db432d2\") " pod="openshift-console/console-d8b66bb7f-zngn9" Jul 02 13:47:44.667267 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.667005 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-console-serving-cert\") pod \"console-d8b66bb7f-zngn9\" (UID: \"f18e6c98-f0e3-473d-8ec1-57ec4db432d2\") " pod="openshift-console/console-d8b66bb7f-zngn9" Jul 02 13:47:44.667267 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.667037 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-console-oauth-config\") pod \"console-d8b66bb7f-zngn9\" (UID: \"f18e6c98-f0e3-473d-8ec1-57ec4db432d2\") " pod="openshift-console/console-d8b66bb7f-zngn9" Jul 02 13:47:44.667267 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.667053 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-trusted-ca-bundle\") pod \"console-d8b66bb7f-zngn9\" (UID: \"f18e6c98-f0e3-473d-8ec1-57ec4db432d2\") " pod="openshift-console/console-d8b66bb7f-zngn9" Jul 02 13:47:44.670618 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.668062 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-console-config\") pod \"console-d8b66bb7f-zngn9\" (UID: \"f18e6c98-f0e3-473d-8ec1-57ec4db432d2\") " pod="openshift-console/console-d8b66bb7f-zngn9" Jul 02 13:47:44.670618 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.668132 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-oauth-serving-cert\") pod \"console-d8b66bb7f-zngn9\" (UID: \"f18e6c98-f0e3-473d-8ec1-57ec4db432d2\") " pod="openshift-console/console-d8b66bb7f-zngn9" Jul 02 13:47:44.670618 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.668310 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-trusted-ca-bundle\") pod \"console-d8b66bb7f-zngn9\" (UID: \"f18e6c98-f0e3-473d-8ec1-57ec4db432d2\") " pod="openshift-console/console-d8b66bb7f-zngn9" Jul 02 13:47:44.670618 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.668486 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-service-ca\") pod \"console-d8b66bb7f-zngn9\" (UID: \"f18e6c98-f0e3-473d-8ec1-57ec4db432d2\") " pod="openshift-console/console-d8b66bb7f-zngn9" Jul 02 13:47:44.670618 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.670300 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-console-serving-cert\") pod \"console-d8b66bb7f-zngn9\" (UID: \"f18e6c98-f0e3-473d-8ec1-57ec4db432d2\") " pod="openshift-console/console-d8b66bb7f-zngn9" Jul 02 13:47:44.670618 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.670416 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-console-oauth-config\") pod \"console-d8b66bb7f-zngn9\" (UID: \"f18e6c98-f0e3-473d-8ec1-57ec4db432d2\") " pod="openshift-console/console-d8b66bb7f-zngn9" Jul 02 13:47:44.670618 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.670433 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-zqjj8" Jul 02 13:47:44.676518 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.676488 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77z5m\" (UniqueName: \"kubernetes.io/projected/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-kube-api-access-77z5m\") pod \"console-d8b66bb7f-zngn9\" (UID: \"f18e6c98-f0e3-473d-8ec1-57ec4db432d2\") " pod="openshift-console/console-d8b66bb7f-zngn9" Jul 02 13:47:44.701577 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.701546 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d8b66bb7f-zngn9" Jul 02 13:47:44.778960 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.778676 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj" event={"ID":"13a96d5b-9754-47a9-8d66-5bb826b3be73","Type":"ContainerStarted","Data":"e49e6ca5967fc2255355127a9b9639b30c53df2f42c63a0586e640aee495f693"} Jul 02 13:47:44.778960 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.778806 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj" event={"ID":"13a96d5b-9754-47a9-8d66-5bb826b3be73","Type":"ContainerStarted","Data":"3cc5aadf9d5e2fa80680675bcb23b80d6d2a3df6f60632f352d7af42defdf1bf"} Jul 02 13:47:44.778960 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.778855 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj" event={"ID":"13a96d5b-9754-47a9-8d66-5bb826b3be73","Type":"ContainerStarted","Data":"b06840999573dde5138acbe0cd305f3d36e6b18fe04065010fe725b9159b9829"} Jul 02 13:47:44.809126 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.809048 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-zqjj8"] Jul 02 13:47:44.811687 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:47:44.811660 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57320423_1f32_4113_972c_1511902243a8.slice/crio-4f64674c1be817b9a1d0a82934f84ded8f3c3f633785b67dbd9f4c7c95c2fe52 WatchSource:0}: Error finding container 4f64674c1be817b9a1d0a82934f84ded8f3c3f633785b67dbd9f4c7c95c2fe52: Status 404 returned error can't find the container with id 4f64674c1be817b9a1d0a82934f84ded8f3c3f633785b67dbd9f4c7c95c2fe52 Jul 02 13:47:44.841776 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:44.841748 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d8b66bb7f-zngn9"] Jul 02 13:47:44.844562 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:47:44.844536 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf18e6c98_f0e3_473d_8ec1_57ec4db432d2.slice/crio-4b5ab601457c75e3ffb124447ae62da40c610703844c8bb31a6834946aea206b WatchSource:0}: Error finding container 4b5ab601457c75e3ffb124447ae62da40c610703844c8bb31a6834946aea206b: Status 404 returned error can't find the container with id 4b5ab601457c75e3ffb124447ae62da40c610703844c8bb31a6834946aea206b Jul 02 13:47:45.784068 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:45.783982 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-zqjj8" event={"ID":"57320423-1f32-4113-972c-1511902243a8","Type":"ContainerStarted","Data":"4f64674c1be817b9a1d0a82934f84ded8f3c3f633785b67dbd9f4c7c95c2fe52"} Jul 02 13:47:45.787518 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:45.787491 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj" event={"ID":"13a96d5b-9754-47a9-8d66-5bb826b3be73","Type":"ContainerStarted","Data":"22866a55e226e3b2a86676ed8b771e6ff1dae2d54bd70d66efe5ce8038e27729"} Jul 02 13:47:45.787653 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:45.787562 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj" event={"ID":"13a96d5b-9754-47a9-8d66-5bb826b3be73","Type":"ContainerStarted","Data":"2d665a7d0691114359a54e5b6b27e2d29ec81f6511def7b10d6bea164ab7749e"} Jul 02 13:47:45.787653 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:45.787606 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj" event={"ID":"13a96d5b-9754-47a9-8d66-5bb826b3be73","Type":"ContainerStarted","Data":"0b9c1b3a79e9bfc1d625487d2c2e287efd8b7370d6231953ab72d6b8642359fc"} Jul 02 13:47:45.787653 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:45.787650 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj" Jul 02 13:47:45.789245 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:45.789209 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d8b66bb7f-zngn9" event={"ID":"f18e6c98-f0e3-473d-8ec1-57ec4db432d2","Type":"ContainerStarted","Data":"faf74bf0d142a912f491fccb61bac1eededb86f9874966f2a107de18e113af15"} Jul 02 13:47:45.789370 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:45.789255 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d8b66bb7f-zngn9" event={"ID":"f18e6c98-f0e3-473d-8ec1-57ec4db432d2","Type":"ContainerStarted","Data":"4b5ab601457c75e3ffb124447ae62da40c610703844c8bb31a6834946aea206b"} Jul 02 13:47:45.846629 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:45.846562 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj" podStartSLOduration=1.522355702 podStartE2EDuration="4.84653835s" totalImagesPullingTime="3.324182648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:47:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:47:45.845949291 +0000 UTC m=+174.126203832" watchObservedRunningTime="2026-07-02 13:47:45.84653835 +0000 UTC m=+174.126792880" Jul 02 13:47:45.892236 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:45.892174 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d8b66bb7f-zngn9" podStartSLOduration=1.892151551 podStartE2EDuration="1.892151551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:47:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:47:45.891268137 +0000 UTC m=+174.171522703" watchObservedRunningTime="2026-07-02 13:47:45.892151551 +0000 UTC m=+174.172406080" Jul 02 13:47:46.794846 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:46.794804 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-zqjj8" event={"ID":"57320423-1f32-4113-972c-1511902243a8","Type":"ContainerStarted","Data":"2b2760dcffa744c79ac7a1ed42e880e901d217b1179d0a460744425ffe604be9"} Jul 02 13:47:46.795370 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:46.795351 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-zqjj8" Jul 02 13:47:46.799438 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:46.799418 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-zqjj8" Jul 02 13:47:46.821159 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:46.821112 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-cd8656b8-zqjj8" podStartSLOduration=1.463437702 podStartE2EDuration="2.821095648s" totalImagesPullingTime="1.357657946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:47:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:47:46.819666242 +0000 UTC m=+175.099920770" watchObservedRunningTime="2026-07-02 13:47:46.821095648 +0000 UTC m=+175.101350178" Jul 02 13:47:48.748688 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:48.748654 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dmq79" Jul 02 13:47:51.801629 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:51.801600 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5f4dfb4495-wxnwj" Jul 02 13:47:54.702184 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:54.702154 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d8b66bb7f-zngn9" Jul 02 13:47:54.702536 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:54.702212 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d8b66bb7f-zngn9" Jul 02 13:47:54.706689 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:54.706668 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d8b66bb7f-zngn9" Jul 02 13:47:54.828327 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:54.828301 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d8b66bb7f-zngn9" Jul 02 13:47:55.822741 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:55.822710 2563 patch_prober.go:28] interesting pod/image-registry-9dd8f84df-2kc75 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 02 13:47:55.823121 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:55.822757 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" podUID="d2e7b7d2-3bda-42bf-b87f-62e9387872dc" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 13:47:57.742023 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:47:57.741992 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:48:04.077611 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:04.077577 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9dd8f84df-2kc75"] Jul 02 13:48:09.357029 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:09.356967 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-58599dd996-92wr2" podUID="d1ee8cd2-0adc-401e-b978-c149a7a7b026" containerName="console" containerID="cri-o://f3b9e1344ae9a851ff445437b9b1249901598d4119abacb964d0035bf6dc5f8c" gracePeriod=15 Jul 02 13:48:09.601531 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:09.601509 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58599dd996-92wr2" Jul 02 13:48:09.665768 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:09.665694 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1ee8cd2-0adc-401e-b978-c149a7a7b026-console-config\") pod \"d1ee8cd2-0adc-401e-b978-c149a7a7b026\" (UID: \"d1ee8cd2-0adc-401e-b978-c149a7a7b026\") " Jul 02 13:48:09.665768 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:09.665734 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1ee8cd2-0adc-401e-b978-c149a7a7b026-oauth-serving-cert\") pod \"d1ee8cd2-0adc-401e-b978-c149a7a7b026\" (UID: \"d1ee8cd2-0adc-401e-b978-c149a7a7b026\") " Jul 02 13:48:09.665768 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:09.665755 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1ee8cd2-0adc-401e-b978-c149a7a7b026-console-serving-cert\") pod \"d1ee8cd2-0adc-401e-b978-c149a7a7b026\" (UID: \"d1ee8cd2-0adc-401e-b978-c149a7a7b026\") " Jul 02 13:48:09.666147 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:09.665791 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77j6n\" (UniqueName: \"kubernetes.io/projected/d1ee8cd2-0adc-401e-b978-c149a7a7b026-kube-api-access-77j6n\") pod \"d1ee8cd2-0adc-401e-b978-c149a7a7b026\" (UID: \"d1ee8cd2-0adc-401e-b978-c149a7a7b026\") " Jul 02 13:48:09.666147 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:09.665823 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1ee8cd2-0adc-401e-b978-c149a7a7b026-service-ca\") pod \"d1ee8cd2-0adc-401e-b978-c149a7a7b026\" (UID: \"d1ee8cd2-0adc-401e-b978-c149a7a7b026\") " Jul 02 13:48:09.666147 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:09.665880 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1ee8cd2-0adc-401e-b978-c149a7a7b026-console-oauth-config\") pod \"d1ee8cd2-0adc-401e-b978-c149a7a7b026\" (UID: \"d1ee8cd2-0adc-401e-b978-c149a7a7b026\") " Jul 02 13:48:09.666283 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:09.666207 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1ee8cd2-0adc-401e-b978-c149a7a7b026-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d1ee8cd2-0adc-401e-b978-c149a7a7b026" (UID: "d1ee8cd2-0adc-401e-b978-c149a7a7b026"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:48:09.666283 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:09.666228 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1ee8cd2-0adc-401e-b978-c149a7a7b026-console-config" (OuterVolumeSpecName: "console-config") pod "d1ee8cd2-0adc-401e-b978-c149a7a7b026" (UID: "d1ee8cd2-0adc-401e-b978-c149a7a7b026"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:48:09.666389 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:09.666277 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1ee8cd2-0adc-401e-b978-c149a7a7b026-service-ca" (OuterVolumeSpecName: "service-ca") pod "d1ee8cd2-0adc-401e-b978-c149a7a7b026" (UID: "d1ee8cd2-0adc-401e-b978-c149a7a7b026"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:48:09.668246 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:09.668209 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1ee8cd2-0adc-401e-b978-c149a7a7b026-kube-api-access-77j6n" (OuterVolumeSpecName: "kube-api-access-77j6n") pod "d1ee8cd2-0adc-401e-b978-c149a7a7b026" (UID: "d1ee8cd2-0adc-401e-b978-c149a7a7b026"). InnerVolumeSpecName "kube-api-access-77j6n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:48:09.668348 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:09.668294 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1ee8cd2-0adc-401e-b978-c149a7a7b026-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d1ee8cd2-0adc-401e-b978-c149a7a7b026" (UID: "d1ee8cd2-0adc-401e-b978-c149a7a7b026"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:48:09.668348 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:09.668336 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1ee8cd2-0adc-401e-b978-c149a7a7b026-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d1ee8cd2-0adc-401e-b978-c149a7a7b026" (UID: "d1ee8cd2-0adc-401e-b978-c149a7a7b026"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:48:09.766428 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:09.766402 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1ee8cd2-0adc-401e-b978-c149a7a7b026-console-config\") on node \"ip-10-0-136-90.ec2.internal\" DevicePath \"\"" Jul 02 13:48:09.766428 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:09.766427 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1ee8cd2-0adc-401e-b978-c149a7a7b026-oauth-serving-cert\") on node \"ip-10-0-136-90.ec2.internal\" DevicePath \"\"" Jul 02 13:48:09.766587 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:09.766436 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1ee8cd2-0adc-401e-b978-c149a7a7b026-console-serving-cert\") on node \"ip-10-0-136-90.ec2.internal\" DevicePath \"\"" Jul 02 13:48:09.766587 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:09.766445 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77j6n\" (UniqueName: \"kubernetes.io/projected/d1ee8cd2-0adc-401e-b978-c149a7a7b026-kube-api-access-77j6n\") on node \"ip-10-0-136-90.ec2.internal\" DevicePath \"\"" Jul 02 13:48:09.766587 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:09.766456 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1ee8cd2-0adc-401e-b978-c149a7a7b026-service-ca\") on node \"ip-10-0-136-90.ec2.internal\" DevicePath \"\"" Jul 02 13:48:09.766587 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:09.766463 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1ee8cd2-0adc-401e-b978-c149a7a7b026-console-oauth-config\") on node \"ip-10-0-136-90.ec2.internal\" DevicePath \"\"" Jul 02 13:48:09.883135 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:09.883102 2563 generic.go:356] "Generic (PLEG): container finished" podID="d1ee8cd2-0adc-401e-b978-c149a7a7b026" containerID="f3b9e1344ae9a851ff445437b9b1249901598d4119abacb964d0035bf6dc5f8c" exitCode=0 Jul 02 13:48:09.883330 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:09.883144 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58599dd996-92wr2" Jul 02 13:48:09.883330 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:09.883180 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58599dd996-92wr2" event={"ID":"d1ee8cd2-0adc-401e-b978-c149a7a7b026","Type":"ContainerDied","Data":"f3b9e1344ae9a851ff445437b9b1249901598d4119abacb964d0035bf6dc5f8c"} Jul 02 13:48:09.883330 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:09.883224 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58599dd996-92wr2" event={"ID":"d1ee8cd2-0adc-401e-b978-c149a7a7b026","Type":"ContainerDied","Data":"50cf51243f85b06e8122152fa3042eb2b1c739c18525b720103ee5ac73e6cdf7"} Jul 02 13:48:09.883330 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:09.883268 2563 scope.go:117] "RemoveContainer" containerID="f3b9e1344ae9a851ff445437b9b1249901598d4119abacb964d0035bf6dc5f8c" Jul 02 13:48:09.884801 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:09.884784 2563 generic.go:356] "Generic (PLEG): container finished" podID="8216e3d5-395e-435f-92e3-e3a872349527" containerID="9e5a938681cb7e489ad6d774e6a4167da44370e37ae4eb1187e9f944dbe3bef4" exitCode=0 Jul 02 13:48:09.884869 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:09.884843 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-6q84g" event={"ID":"8216e3d5-395e-435f-92e3-e3a872349527","Type":"ContainerDied","Data":"9e5a938681cb7e489ad6d774e6a4167da44370e37ae4eb1187e9f944dbe3bef4"} Jul 02 13:48:09.885152 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:09.885138 2563 scope.go:117] "RemoveContainer" containerID="9e5a938681cb7e489ad6d774e6a4167da44370e37ae4eb1187e9f944dbe3bef4" Jul 02 13:48:09.896054 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:09.896031 2563 scope.go:117] "RemoveContainer" containerID="f3b9e1344ae9a851ff445437b9b1249901598d4119abacb964d0035bf6dc5f8c" Jul 02 13:48:09.896346 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:48:09.896326 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3b9e1344ae9a851ff445437b9b1249901598d4119abacb964d0035bf6dc5f8c\": container with ID starting with f3b9e1344ae9a851ff445437b9b1249901598d4119abacb964d0035bf6dc5f8c not found: ID does not exist" containerID="f3b9e1344ae9a851ff445437b9b1249901598d4119abacb964d0035bf6dc5f8c" Jul 02 13:48:09.896422 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:09.896355 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3b9e1344ae9a851ff445437b9b1249901598d4119abacb964d0035bf6dc5f8c"} err="failed to get container status \"f3b9e1344ae9a851ff445437b9b1249901598d4119abacb964d0035bf6dc5f8c\": rpc error: code = NotFound desc = could not find container \"f3b9e1344ae9a851ff445437b9b1249901598d4119abacb964d0035bf6dc5f8c\": container with ID starting with f3b9e1344ae9a851ff445437b9b1249901598d4119abacb964d0035bf6dc5f8c not found: ID does not exist" Jul 02 13:48:09.930234 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:09.930210 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58599dd996-92wr2"] Jul 02 13:48:09.936775 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:09.936747 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58599dd996-92wr2"] Jul 02 13:48:10.138426 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:10.138387 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1ee8cd2-0adc-401e-b978-c149a7a7b026" path="/var/lib/kubelet/pods/d1ee8cd2-0adc-401e-b978-c149a7a7b026/volumes" Jul 02 13:48:10.891945 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:10.891904 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-6q84g" event={"ID":"8216e3d5-395e-435f-92e3-e3a872349527","Type":"ContainerStarted","Data":"6e691a9c4508ffcaaa14ada4b5e1185d5cc04d5eb2790574adaceedb4600423d"} Jul 02 13:48:14.907211 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:14.907171 2563 generic.go:356] "Generic (PLEG): container finished" podID="6370bd7b-43c9-41ac-8596-0a975155445c" containerID="8ad6c89908029b2a00fd5600e7358ee5ecfcaa8b3787e812279306b5dddda02b" exitCode=0 Jul 02 13:48:14.907565 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:14.907215 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pkn85" event={"ID":"6370bd7b-43c9-41ac-8596-0a975155445c","Type":"ContainerDied","Data":"8ad6c89908029b2a00fd5600e7358ee5ecfcaa8b3787e812279306b5dddda02b"} Jul 02 13:48:14.907565 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:14.907531 2563 scope.go:117] "RemoveContainer" containerID="8ad6c89908029b2a00fd5600e7358ee5ecfcaa8b3787e812279306b5dddda02b" Jul 02 13:48:15.654779 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:15.654743 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dmq79_888590ed-3122-4425-816a-1292d70e3086/dns/0.log" Jul 02 13:48:15.661979 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:15.661957 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dmq79_888590ed-3122-4425-816a-1292d70e3086/kube-rbac-proxy/0.log" Jul 02 13:48:15.795085 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:15.795030 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ct2sf_edf38c8b-844c-4ac9-983b-e9395bb86adc/dns-node-resolver/0.log" Jul 02 13:48:15.913600 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:15.913515 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pkn85" event={"ID":"6370bd7b-43c9-41ac-8596-0a975155445c","Type":"ContainerStarted","Data":"1ecd275d6ab81d9aefcd036794c48711c71b8e5db36585e6437701a7a8a004a8"} Jul 02 13:48:29.097809 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:29.097763 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" podUID="d2e7b7d2-3bda-42bf-b87f-62e9387872dc" containerName="registry" containerID="cri-o://caaa8c3026e26a461969dcd0072e64b967bad560f796286792a28a1bcac0bece" gracePeriod=30 Jul 02 13:48:29.349981 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:29.349909 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:48:29.426271 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:29.426240 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-bound-sa-token\") pod \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " Jul 02 13:48:29.426438 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:29.426279 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-registry-certificates\") pod \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " Jul 02 13:48:29.426438 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:29.426299 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-installation-pull-secrets\") pod \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " Jul 02 13:48:29.426542 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:29.426429 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gt9f\" (UniqueName: \"kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-kube-api-access-2gt9f\") pod \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " Jul 02 13:48:29.426542 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:29.426471 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-trusted-ca\") pod \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " Jul 02 13:48:29.426542 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:29.426505 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-image-registry-private-configuration\") pod \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " Jul 02 13:48:29.426696 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:29.426551 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-registry-tls\") pod \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " Jul 02 13:48:29.426696 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:29.426583 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-ca-trust-extracted\") pod \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\" (UID: \"d2e7b7d2-3bda-42bf-b87f-62e9387872dc\") " Jul 02 13:48:29.426808 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:29.426717 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d2e7b7d2-3bda-42bf-b87f-62e9387872dc" (UID: "d2e7b7d2-3bda-42bf-b87f-62e9387872dc"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:48:29.426868 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:29.426857 2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-registry-certificates\") on node \"ip-10-0-136-90.ec2.internal\" DevicePath \"\"" Jul 02 13:48:29.427639 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:29.426910 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d2e7b7d2-3bda-42bf-b87f-62e9387872dc" (UID: "d2e7b7d2-3bda-42bf-b87f-62e9387872dc"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:48:29.428834 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:29.428812 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d2e7b7d2-3bda-42bf-b87f-62e9387872dc" (UID: "d2e7b7d2-3bda-42bf-b87f-62e9387872dc"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:48:29.428970 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:29.428921 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d2e7b7d2-3bda-42bf-b87f-62e9387872dc" (UID: "d2e7b7d2-3bda-42bf-b87f-62e9387872dc"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:48:29.429130 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:29.429108 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-kube-api-access-2gt9f" (OuterVolumeSpecName: "kube-api-access-2gt9f") pod "d2e7b7d2-3bda-42bf-b87f-62e9387872dc" (UID: "d2e7b7d2-3bda-42bf-b87f-62e9387872dc"). InnerVolumeSpecName "kube-api-access-2gt9f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:48:29.429408 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:29.429384 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d2e7b7d2-3bda-42bf-b87f-62e9387872dc" (UID: "d2e7b7d2-3bda-42bf-b87f-62e9387872dc"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:48:29.429480 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:29.429435 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d2e7b7d2-3bda-42bf-b87f-62e9387872dc" (UID: "d2e7b7d2-3bda-42bf-b87f-62e9387872dc"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:48:29.435415 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:29.435392 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d2e7b7d2-3bda-42bf-b87f-62e9387872dc" (UID: "d2e7b7d2-3bda-42bf-b87f-62e9387872dc"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 13:48:29.527266 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:29.527230 2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-registry-tls\") on node \"ip-10-0-136-90.ec2.internal\" DevicePath \"\"" Jul 02 13:48:29.527266 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:29.527261 2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-ca-trust-extracted\") on node \"ip-10-0-136-90.ec2.internal\" DevicePath \"\"" Jul 02 13:48:29.527266 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:29.527271 2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-bound-sa-token\") on node \"ip-10-0-136-90.ec2.internal\" DevicePath \"\"" Jul 02 13:48:29.527491 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:29.527279 2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-installation-pull-secrets\") on node \"ip-10-0-136-90.ec2.internal\" DevicePath \"\"" Jul 02 13:48:29.527491 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:29.527289 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gt9f\" (UniqueName: \"kubernetes.io/projected/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-kube-api-access-2gt9f\") on node \"ip-10-0-136-90.ec2.internal\" DevicePath \"\"" Jul 02 13:48:29.527491 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:29.527297 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-trusted-ca\") on node \"ip-10-0-136-90.ec2.internal\" DevicePath \"\"" Jul 02 13:48:29.527491 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:29.527306 2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d2e7b7d2-3bda-42bf-b87f-62e9387872dc-image-registry-private-configuration\") on node \"ip-10-0-136-90.ec2.internal\" DevicePath \"\"" Jul 02 13:48:29.971279 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:29.971242 2563 generic.go:356] "Generic (PLEG): container finished" podID="d2e7b7d2-3bda-42bf-b87f-62e9387872dc" containerID="caaa8c3026e26a461969dcd0072e64b967bad560f796286792a28a1bcac0bece" exitCode=0 Jul 02 13:48:29.971455 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:29.971301 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" Jul 02 13:48:29.971455 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:29.971307 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" event={"ID":"d2e7b7d2-3bda-42bf-b87f-62e9387872dc","Type":"ContainerDied","Data":"caaa8c3026e26a461969dcd0072e64b967bad560f796286792a28a1bcac0bece"} Jul 02 13:48:29.971455 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:29.971374 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9dd8f84df-2kc75" event={"ID":"d2e7b7d2-3bda-42bf-b87f-62e9387872dc","Type":"ContainerDied","Data":"fdb0b1343282c8e00e72e65a66ee7daa2af451069e57e9c6ce34194ceebd43ce"} Jul 02 13:48:29.971455 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:29.971395 2563 scope.go:117] "RemoveContainer" containerID="caaa8c3026e26a461969dcd0072e64b967bad560f796286792a28a1bcac0bece" Jul 02 13:48:29.980277 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:29.980259 2563 scope.go:117] "RemoveContainer" containerID="caaa8c3026e26a461969dcd0072e64b967bad560f796286792a28a1bcac0bece" Jul 02 13:48:29.980530 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:48:29.980512 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"caaa8c3026e26a461969dcd0072e64b967bad560f796286792a28a1bcac0bece\": container with ID starting with caaa8c3026e26a461969dcd0072e64b967bad560f796286792a28a1bcac0bece not found: ID does not exist" containerID="caaa8c3026e26a461969dcd0072e64b967bad560f796286792a28a1bcac0bece" Jul 02 13:48:29.980586 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:29.980540 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caaa8c3026e26a461969dcd0072e64b967bad560f796286792a28a1bcac0bece"} err="failed to get container status \"caaa8c3026e26a461969dcd0072e64b967bad560f796286792a28a1bcac0bece\": rpc error: code = NotFound desc = could not find container \"caaa8c3026e26a461969dcd0072e64b967bad560f796286792a28a1bcac0bece\": container with ID starting with caaa8c3026e26a461969dcd0072e64b967bad560f796286792a28a1bcac0bece not found: ID does not exist" Jul 02 13:48:29.991395 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:29.991367 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9dd8f84df-2kc75"] Jul 02 13:48:29.995749 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:29.995730 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-9dd8f84df-2kc75"] Jul 02 13:48:30.137174 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:48:30.137143 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2e7b7d2-3bda-42bf-b87f-62e9387872dc" path="/var/lib/kubelet/pods/d2e7b7d2-3bda-42bf-b87f-62e9387872dc/volumes" Jul 02 13:49:02.110376 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.110342 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 13:49:02.110820 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.110610 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1ee8cd2-0adc-401e-b978-c149a7a7b026" containerName="console" Jul 02 13:49:02.110820 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.110621 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1ee8cd2-0adc-401e-b978-c149a7a7b026" containerName="console" Jul 02 13:49:02.110820 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.110639 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2e7b7d2-3bda-42bf-b87f-62e9387872dc" containerName="registry" Jul 02 13:49:02.110820 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.110645 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2e7b7d2-3bda-42bf-b87f-62e9387872dc" containerName="registry" Jul 02 13:49:02.110820 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.110690 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2e7b7d2-3bda-42bf-b87f-62e9387872dc" containerName="registry" Jul 02 13:49:02.110820 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.110701 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1ee8cd2-0adc-401e-b978-c149a7a7b026" containerName="console" Jul 02 13:49:02.115241 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.115225 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.119183 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.119160 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 02 13:49:02.119322 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.119164 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 02 13:49:02.119513 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.119496 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6bhhc\"" Jul 02 13:49:02.120688 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.120665 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 02 13:49:02.120815 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.120688 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 02 13:49:02.120815 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.120714 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 02 13:49:02.121241 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.121130 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 02 13:49:02.121241 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.121154 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 02 13:49:02.121241 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.121178 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 02 13:49:02.124798 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.124780 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 02 13:49:02.137441 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.137415 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 13:49:02.188220 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.188187 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1997733f-7b3c-4e2c-b03b-651bcdecbd88-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.188220 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.188219 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1997733f-7b3c-4e2c-b03b-651bcdecbd88-config-out\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.188418 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.188259 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1997733f-7b3c-4e2c-b03b-651bcdecbd88-web-config\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.188418 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.188281 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1997733f-7b3c-4e2c-b03b-651bcdecbd88-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.188418 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.188302 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1997733f-7b3c-4e2c-b03b-651bcdecbd88-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.188418 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.188319 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1997733f-7b3c-4e2c-b03b-651bcdecbd88-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.188418 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.188378 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1997733f-7b3c-4e2c-b03b-651bcdecbd88-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.188418 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.188396 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgtmc\" (UniqueName: \"kubernetes.io/projected/1997733f-7b3c-4e2c-b03b-651bcdecbd88-kube-api-access-dgtmc\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.188418 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.188413 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1997733f-7b3c-4e2c-b03b-651bcdecbd88-config-volume\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.188778 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.188463 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1997733f-7b3c-4e2c-b03b-651bcdecbd88-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.188778 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.188485 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1997733f-7b3c-4e2c-b03b-651bcdecbd88-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.188778 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.188503 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1997733f-7b3c-4e2c-b03b-651bcdecbd88-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.188778 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.188538 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1997733f-7b3c-4e2c-b03b-651bcdecbd88-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.288841 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.288801 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1997733f-7b3c-4e2c-b03b-651bcdecbd88-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.288841 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.288840 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgtmc\" (UniqueName: \"kubernetes.io/projected/1997733f-7b3c-4e2c-b03b-651bcdecbd88-kube-api-access-dgtmc\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.289101 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.288859 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1997733f-7b3c-4e2c-b03b-651bcdecbd88-config-volume\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.289101 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.288880 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1997733f-7b3c-4e2c-b03b-651bcdecbd88-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.289101 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.288905 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1997733f-7b3c-4e2c-b03b-651bcdecbd88-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.289101 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.288952 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1997733f-7b3c-4e2c-b03b-651bcdecbd88-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.289101 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.288982 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1997733f-7b3c-4e2c-b03b-651bcdecbd88-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.289101 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.289022 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1997733f-7b3c-4e2c-b03b-651bcdecbd88-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.289101 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.289039 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1997733f-7b3c-4e2c-b03b-651bcdecbd88-config-out\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.289101 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.289078 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1997733f-7b3c-4e2c-b03b-651bcdecbd88-web-config\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.289101 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.289104 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1997733f-7b3c-4e2c-b03b-651bcdecbd88-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.289578 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.289129 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1997733f-7b3c-4e2c-b03b-651bcdecbd88-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.289578 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.289144 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1997733f-7b3c-4e2c-b03b-651bcdecbd88-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.289578 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.289511 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1997733f-7b3c-4e2c-b03b-651bcdecbd88-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.290124 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.289850 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1997733f-7b3c-4e2c-b03b-651bcdecbd88-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.290635 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.290588 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1997733f-7b3c-4e2c-b03b-651bcdecbd88-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.292963 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.292903 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1997733f-7b3c-4e2c-b03b-651bcdecbd88-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.292963 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.292916 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1997733f-7b3c-4e2c-b03b-651bcdecbd88-web-config\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.293124 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.293017 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1997733f-7b3c-4e2c-b03b-651bcdecbd88-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.293124 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.293055 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1997733f-7b3c-4e2c-b03b-651bcdecbd88-config-volume\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.293229 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.293208 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1997733f-7b3c-4e2c-b03b-651bcdecbd88-config-out\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.293496 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.293473 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1997733f-7b3c-4e2c-b03b-651bcdecbd88-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.293496 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.293487 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1997733f-7b3c-4e2c-b03b-651bcdecbd88-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.293962 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.293918 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1997733f-7b3c-4e2c-b03b-651bcdecbd88-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.294303 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.294281 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1997733f-7b3c-4e2c-b03b-651bcdecbd88-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.298051 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.298033 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgtmc\" (UniqueName: \"kubernetes.io/projected/1997733f-7b3c-4e2c-b03b-651bcdecbd88-kube-api-access-dgtmc\") pod \"alertmanager-main-0\" (UID: \"1997733f-7b3c-4e2c-b03b-651bcdecbd88\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.425057 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.424960 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.572097 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:02.572067 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 13:49:02.576627 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:49:02.576600 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1997733f_7b3c_4e2c_b03b_651bcdecbd88.slice/crio-cd9b24b89723b44ae209b378f70ccbe5d751aecf443a7fd161a268d60784fef1 WatchSource:0}: Error finding container cd9b24b89723b44ae209b378f70ccbe5d751aecf443a7fd161a268d60784fef1: Status 404 returned error can't find the container with id cd9b24b89723b44ae209b378f70ccbe5d751aecf443a7fd161a268d60784fef1 Jul 02 13:49:03.095423 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:03.095395 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1997733f-7b3c-4e2c-b03b-651bcdecbd88","Type":"ContainerStarted","Data":"cd9b24b89723b44ae209b378f70ccbe5d751aecf443a7fd161a268d60784fef1"} Jul 02 13:49:03.918212 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:03.918178 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-775d8ff859-mrjvq"] Jul 02 13:49:03.921415 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:03.921400 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-775d8ff859-mrjvq" Jul 02 13:49:03.924394 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:03.924371 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 02 13:49:03.924514 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:03.924443 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 02 13:49:03.925115 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:03.925096 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 02 13:49:03.925183 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:03.925122 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 02 13:49:03.925232 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:03.925196 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 02 13:49:03.925232 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:03.925198 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-rv6km\"" Jul 02 13:49:03.929793 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:03.929774 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 02 13:49:03.938444 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:03.938420 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-775d8ff859-mrjvq"] Jul 02 13:49:03.999784 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:03.999754 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2zxj\" (UniqueName: \"kubernetes.io/projected/cca9a0ed-994e-404c-82da-296705acc98e-kube-api-access-w2zxj\") pod \"telemeter-client-775d8ff859-mrjvq\" (UID: \"cca9a0ed-994e-404c-82da-296705acc98e\") " pod="openshift-monitoring/telemeter-client-775d8ff859-mrjvq" Jul 02 13:49:03.999784 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:03.999789 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cca9a0ed-994e-404c-82da-296705acc98e-secret-telemeter-client\") pod \"telemeter-client-775d8ff859-mrjvq\" (UID: \"cca9a0ed-994e-404c-82da-296705acc98e\") " pod="openshift-monitoring/telemeter-client-775d8ff859-mrjvq" Jul 02 13:49:04.000020 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:03.999822 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cca9a0ed-994e-404c-82da-296705acc98e-telemeter-client-tls\") pod \"telemeter-client-775d8ff859-mrjvq\" (UID: \"cca9a0ed-994e-404c-82da-296705acc98e\") " pod="openshift-monitoring/telemeter-client-775d8ff859-mrjvq" Jul 02 13:49:04.000020 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:03.999876 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cca9a0ed-994e-404c-82da-296705acc98e-federate-client-tls\") pod \"telemeter-client-775d8ff859-mrjvq\" (UID: \"cca9a0ed-994e-404c-82da-296705acc98e\") " pod="openshift-monitoring/telemeter-client-775d8ff859-mrjvq" Jul 02 13:49:04.000020 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:03.999916 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cca9a0ed-994e-404c-82da-296705acc98e-serving-certs-ca-bundle\") pod \"telemeter-client-775d8ff859-mrjvq\" (UID: \"cca9a0ed-994e-404c-82da-296705acc98e\") " pod="openshift-monitoring/telemeter-client-775d8ff859-mrjvq" Jul 02 13:49:04.000020 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:03.999990 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cca9a0ed-994e-404c-82da-296705acc98e-metrics-client-ca\") pod \"telemeter-client-775d8ff859-mrjvq\" (UID: \"cca9a0ed-994e-404c-82da-296705acc98e\") " pod="openshift-monitoring/telemeter-client-775d8ff859-mrjvq" Jul 02 13:49:04.000020 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:04.000009 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cca9a0ed-994e-404c-82da-296705acc98e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-775d8ff859-mrjvq\" (UID: \"cca9a0ed-994e-404c-82da-296705acc98e\") " pod="openshift-monitoring/telemeter-client-775d8ff859-mrjvq" Jul 02 13:49:04.000176 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:04.000061 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cca9a0ed-994e-404c-82da-296705acc98e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-775d8ff859-mrjvq\" (UID: \"cca9a0ed-994e-404c-82da-296705acc98e\") " pod="openshift-monitoring/telemeter-client-775d8ff859-mrjvq" Jul 02 13:49:04.099947 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:04.099909 2563 generic.go:356] "Generic (PLEG): container finished" podID="1997733f-7b3c-4e2c-b03b-651bcdecbd88" containerID="f2c77d9fdbb1deec9553c1e745934d08bf65451650325fa5be0f7fdb90e98bdb" exitCode=0 Jul 02 13:49:04.100111 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:04.099997 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1997733f-7b3c-4e2c-b03b-651bcdecbd88","Type":"ContainerDied","Data":"f2c77d9fdbb1deec9553c1e745934d08bf65451650325fa5be0f7fdb90e98bdb"} Jul 02 13:49:04.100454 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:04.100437 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cca9a0ed-994e-404c-82da-296705acc98e-metrics-client-ca\") pod \"telemeter-client-775d8ff859-mrjvq\" (UID: \"cca9a0ed-994e-404c-82da-296705acc98e\") " pod="openshift-monitoring/telemeter-client-775d8ff859-mrjvq" Jul 02 13:49:04.100493 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:04.100462 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cca9a0ed-994e-404c-82da-296705acc98e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-775d8ff859-mrjvq\" (UID: \"cca9a0ed-994e-404c-82da-296705acc98e\") " pod="openshift-monitoring/telemeter-client-775d8ff859-mrjvq" Jul 02 13:49:04.100526 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:04.100499 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cca9a0ed-994e-404c-82da-296705acc98e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-775d8ff859-mrjvq\" (UID: \"cca9a0ed-994e-404c-82da-296705acc98e\") " pod="openshift-monitoring/telemeter-client-775d8ff859-mrjvq" Jul 02 13:49:04.100559 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:04.100539 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2zxj\" (UniqueName: \"kubernetes.io/projected/cca9a0ed-994e-404c-82da-296705acc98e-kube-api-access-w2zxj\") pod \"telemeter-client-775d8ff859-mrjvq\" (UID: \"cca9a0ed-994e-404c-82da-296705acc98e\") " pod="openshift-monitoring/telemeter-client-775d8ff859-mrjvq" Jul 02 13:49:04.100606 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:04.100567 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cca9a0ed-994e-404c-82da-296705acc98e-secret-telemeter-client\") pod \"telemeter-client-775d8ff859-mrjvq\" (UID: \"cca9a0ed-994e-404c-82da-296705acc98e\") " pod="openshift-monitoring/telemeter-client-775d8ff859-mrjvq" Jul 02 13:49:04.100659 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:04.100626 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cca9a0ed-994e-404c-82da-296705acc98e-telemeter-client-tls\") pod \"telemeter-client-775d8ff859-mrjvq\" (UID: \"cca9a0ed-994e-404c-82da-296705acc98e\") " pod="openshift-monitoring/telemeter-client-775d8ff859-mrjvq" Jul 02 13:49:04.100803 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:04.100756 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cca9a0ed-994e-404c-82da-296705acc98e-federate-client-tls\") pod \"telemeter-client-775d8ff859-mrjvq\" (UID: \"cca9a0ed-994e-404c-82da-296705acc98e\") " pod="openshift-monitoring/telemeter-client-775d8ff859-mrjvq" Jul 02 13:49:04.100860 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:04.100800 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cca9a0ed-994e-404c-82da-296705acc98e-serving-certs-ca-bundle\") pod \"telemeter-client-775d8ff859-mrjvq\" (UID: \"cca9a0ed-994e-404c-82da-296705acc98e\") " pod="openshift-monitoring/telemeter-client-775d8ff859-mrjvq" Jul 02 13:49:04.101550 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:04.101355 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cca9a0ed-994e-404c-82da-296705acc98e-metrics-client-ca\") pod \"telemeter-client-775d8ff859-mrjvq\" (UID: \"cca9a0ed-994e-404c-82da-296705acc98e\") " pod="openshift-monitoring/telemeter-client-775d8ff859-mrjvq" Jul 02 13:49:04.101550 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:04.101479 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cca9a0ed-994e-404c-82da-296705acc98e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-775d8ff859-mrjvq\" (UID: \"cca9a0ed-994e-404c-82da-296705acc98e\") " pod="openshift-monitoring/telemeter-client-775d8ff859-mrjvq" Jul 02 13:49:04.102126 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:04.102064 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cca9a0ed-994e-404c-82da-296705acc98e-serving-certs-ca-bundle\") pod \"telemeter-client-775d8ff859-mrjvq\" (UID: \"cca9a0ed-994e-404c-82da-296705acc98e\") " pod="openshift-monitoring/telemeter-client-775d8ff859-mrjvq" Jul 02 13:49:04.104061 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:04.103849 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cca9a0ed-994e-404c-82da-296705acc98e-secret-telemeter-client\") pod \"telemeter-client-775d8ff859-mrjvq\" (UID: \"cca9a0ed-994e-404c-82da-296705acc98e\") " pod="openshift-monitoring/telemeter-client-775d8ff859-mrjvq" Jul 02 13:49:04.104061 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:04.104038 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cca9a0ed-994e-404c-82da-296705acc98e-federate-client-tls\") pod \"telemeter-client-775d8ff859-mrjvq\" (UID: \"cca9a0ed-994e-404c-82da-296705acc98e\") " pod="openshift-monitoring/telemeter-client-775d8ff859-mrjvq" Jul 02 13:49:04.104207 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:04.104092 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cca9a0ed-994e-404c-82da-296705acc98e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-775d8ff859-mrjvq\" (UID: \"cca9a0ed-994e-404c-82da-296705acc98e\") " pod="openshift-monitoring/telemeter-client-775d8ff859-mrjvq" Jul 02 13:49:04.104207 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:04.104105 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cca9a0ed-994e-404c-82da-296705acc98e-telemeter-client-tls\") pod \"telemeter-client-775d8ff859-mrjvq\" (UID: \"cca9a0ed-994e-404c-82da-296705acc98e\") " pod="openshift-monitoring/telemeter-client-775d8ff859-mrjvq" Jul 02 13:49:04.109759 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:04.109738 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2zxj\" (UniqueName: \"kubernetes.io/projected/cca9a0ed-994e-404c-82da-296705acc98e-kube-api-access-w2zxj\") pod \"telemeter-client-775d8ff859-mrjvq\" (UID: \"cca9a0ed-994e-404c-82da-296705acc98e\") " pod="openshift-monitoring/telemeter-client-775d8ff859-mrjvq" Jul 02 13:49:04.243446 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:04.243417 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-775d8ff859-mrjvq" Jul 02 13:49:04.380660 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:04.380637 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-775d8ff859-mrjvq"] Jul 02 13:49:04.382365 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:49:04.382341 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcca9a0ed_994e_404c_82da_296705acc98e.slice/crio-d22f274fe8a9d8d212a1730c39f6505d4f89a6a058cd96f6e94e3d20b47dd1b8 WatchSource:0}: Error finding container d22f274fe8a9d8d212a1730c39f6505d4f89a6a058cd96f6e94e3d20b47dd1b8: Status 404 returned error can't find the container with id d22f274fe8a9d8d212a1730c39f6505d4f89a6a058cd96f6e94e3d20b47dd1b8 Jul 02 13:49:05.104426 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:05.104391 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-775d8ff859-mrjvq" event={"ID":"cca9a0ed-994e-404c-82da-296705acc98e","Type":"ContainerStarted","Data":"d22f274fe8a9d8d212a1730c39f6505d4f89a6a058cd96f6e94e3d20b47dd1b8"} Jul 02 13:49:06.111215 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:06.111186 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1997733f-7b3c-4e2c-b03b-651bcdecbd88","Type":"ContainerStarted","Data":"915186f2b7edb15ac098edf4713129d35d0a0e0d8799c6552634d2092b53a5a0"} Jul 02 13:49:06.111542 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:06.111256 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1997733f-7b3c-4e2c-b03b-651bcdecbd88","Type":"ContainerStarted","Data":"2702da5f41e5e47fe444b5c4c35476847f65450813fc166c7d0d32763b7b0d1e"} Jul 02 13:49:06.111542 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:06.111287 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1997733f-7b3c-4e2c-b03b-651bcdecbd88","Type":"ContainerStarted","Data":"4febedad7b6f4d1d6264d0af8a9928f88c167fdb26444880650c3ee1c8ce0b2d"} Jul 02 13:49:07.118610 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:07.118561 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1997733f-7b3c-4e2c-b03b-651bcdecbd88","Type":"ContainerStarted","Data":"7f85126f158b7faf0c0702e9f45a2708f2e1aaee5c70b1ee0de00ecd615523d6"} Jul 02 13:49:07.119103 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:07.118652 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1997733f-7b3c-4e2c-b03b-651bcdecbd88","Type":"ContainerStarted","Data":"903f701b0d4c9adfc48145f6b85162677d6c5453fdfd1236ee8f7f98feee1ff8"} Jul 02 13:49:07.119103 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:07.118692 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1997733f-7b3c-4e2c-b03b-651bcdecbd88","Type":"ContainerStarted","Data":"a3f672dcbd9fcce60bcaf3d8ee5968afbb7b960fd2042c52f7ecf48ab03050e8"} Jul 02 13:49:07.120633 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:07.120607 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-775d8ff859-mrjvq" event={"ID":"cca9a0ed-994e-404c-82da-296705acc98e","Type":"ContainerStarted","Data":"ea703cf409e163abe41f602cafed944f570f63060cadf2e762ef6e957958a472"} Jul 02 13:49:07.120751 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:07.120649 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-775d8ff859-mrjvq" event={"ID":"cca9a0ed-994e-404c-82da-296705acc98e","Type":"ContainerStarted","Data":"d500a5294517cf5be779523368c12041817570b220f1452a3ee5c137eaac0028"} Jul 02 13:49:07.120751 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:07.120668 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-775d8ff859-mrjvq" event={"ID":"cca9a0ed-994e-404c-82da-296705acc98e","Type":"ContainerStarted","Data":"c2b5a32441a70afe098cb84f31fed2002e8b97ebb2e829496fa98a0759ffe58c"} Jul 02 13:49:07.148217 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:07.148155 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.219140985 podStartE2EDuration="5.148134849s" totalImagesPullingTime="2.913112543s" totalInitContainerRuntime="15.881321ms" isStatefulPod=false podCreationTimestamp="2026-07-02 13:49:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:49:07.148055147 +0000 UTC m=+255.428309720" watchObservedRunningTime="2026-07-02 13:49:07.148134849 +0000 UTC m=+255.428389381" Jul 02 13:49:07.174063 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:07.174006 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-775d8ff859-mrjvq" podStartSLOduration=1.89026521 podStartE2EDuration="4.173988705s" totalImagesPullingTime="2.283723495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:49:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:49:07.171880769 +0000 UTC m=+255.452135333" watchObservedRunningTime="2026-07-02 13:49:07.173988705 +0000 UTC m=+255.454243235" Jul 02 13:49:18.957714 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:18.957636 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d8b66bb7f-zngn9"] Jul 02 13:49:43.978614 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:43.978549 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-d8b66bb7f-zngn9" podUID="f18e6c98-f0e3-473d-8ec1-57ec4db432d2" containerName="console" containerID="cri-o://faf74bf0d142a912f491fccb61bac1eededb86f9874966f2a107de18e113af15" gracePeriod=15 Jul 02 13:49:44.216834 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:44.216805 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d8b66bb7f-zngn9" Jul 02 13:49:44.267023 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:44.266924 2563 generic.go:356] "Generic (PLEG): container finished" podID="f18e6c98-f0e3-473d-8ec1-57ec4db432d2" containerID="faf74bf0d142a912f491fccb61bac1eededb86f9874966f2a107de18e113af15" exitCode=0 Jul 02 13:49:44.267023 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:44.266986 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d8b66bb7f-zngn9" Jul 02 13:49:44.267189 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:44.266989 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d8b66bb7f-zngn9" event={"ID":"f18e6c98-f0e3-473d-8ec1-57ec4db432d2","Type":"ContainerDied","Data":"faf74bf0d142a912f491fccb61bac1eededb86f9874966f2a107de18e113af15"} Jul 02 13:49:44.267189 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:44.267113 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d8b66bb7f-zngn9" event={"ID":"f18e6c98-f0e3-473d-8ec1-57ec4db432d2","Type":"ContainerDied","Data":"4b5ab601457c75e3ffb124447ae62da40c610703844c8bb31a6834946aea206b"} Jul 02 13:49:44.267189 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:44.267137 2563 scope.go:117] "RemoveContainer" containerID="faf74bf0d142a912f491fccb61bac1eededb86f9874966f2a107de18e113af15" Jul 02 13:49:44.277256 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:44.277239 2563 scope.go:117] "RemoveContainer" containerID="faf74bf0d142a912f491fccb61bac1eededb86f9874966f2a107de18e113af15" Jul 02 13:49:44.277511 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:49:44.277493 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"faf74bf0d142a912f491fccb61bac1eededb86f9874966f2a107de18e113af15\": container with ID starting with faf74bf0d142a912f491fccb61bac1eededb86f9874966f2a107de18e113af15 not found: ID does not exist" containerID="faf74bf0d142a912f491fccb61bac1eededb86f9874966f2a107de18e113af15" Jul 02 13:49:44.277565 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:44.277520 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"faf74bf0d142a912f491fccb61bac1eededb86f9874966f2a107de18e113af15"} err="failed to get container status \"faf74bf0d142a912f491fccb61bac1eededb86f9874966f2a107de18e113af15\": rpc error: code = NotFound desc = could not find container \"faf74bf0d142a912f491fccb61bac1eededb86f9874966f2a107de18e113af15\": container with ID starting with faf74bf0d142a912f491fccb61bac1eededb86f9874966f2a107de18e113af15 not found: ID does not exist" Jul 02 13:49:44.312902 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:44.312879 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77z5m\" (UniqueName: \"kubernetes.io/projected/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-kube-api-access-77z5m\") pod \"f18e6c98-f0e3-473d-8ec1-57ec4db432d2\" (UID: \"f18e6c98-f0e3-473d-8ec1-57ec4db432d2\") " Jul 02 13:49:44.313005 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:44.312944 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-trusted-ca-bundle\") pod \"f18e6c98-f0e3-473d-8ec1-57ec4db432d2\" (UID: \"f18e6c98-f0e3-473d-8ec1-57ec4db432d2\") " Jul 02 13:49:44.313005 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:44.312982 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-console-serving-cert\") pod \"f18e6c98-f0e3-473d-8ec1-57ec4db432d2\" (UID: \"f18e6c98-f0e3-473d-8ec1-57ec4db432d2\") " Jul 02 13:49:44.313005 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:44.313001 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-oauth-serving-cert\") pod \"f18e6c98-f0e3-473d-8ec1-57ec4db432d2\" (UID: \"f18e6c98-f0e3-473d-8ec1-57ec4db432d2\") " Jul 02 13:49:44.313115 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:44.313018 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-service-ca\") pod \"f18e6c98-f0e3-473d-8ec1-57ec4db432d2\" (UID: \"f18e6c98-f0e3-473d-8ec1-57ec4db432d2\") " Jul 02 13:49:44.313115 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:44.313057 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-console-config\") pod \"f18e6c98-f0e3-473d-8ec1-57ec4db432d2\" (UID: \"f18e6c98-f0e3-473d-8ec1-57ec4db432d2\") " Jul 02 13:49:44.313217 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:44.313161 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-console-oauth-config\") pod \"f18e6c98-f0e3-473d-8ec1-57ec4db432d2\" (UID: \"f18e6c98-f0e3-473d-8ec1-57ec4db432d2\") " Jul 02 13:49:44.313445 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:44.313423 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-console-config" (OuterVolumeSpecName: "console-config") pod "f18e6c98-f0e3-473d-8ec1-57ec4db432d2" (UID: "f18e6c98-f0e3-473d-8ec1-57ec4db432d2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:49:44.313545 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:44.313431 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f18e6c98-f0e3-473d-8ec1-57ec4db432d2" (UID: "f18e6c98-f0e3-473d-8ec1-57ec4db432d2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:49:44.313545 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:44.313440 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-service-ca" (OuterVolumeSpecName: "service-ca") pod "f18e6c98-f0e3-473d-8ec1-57ec4db432d2" (UID: "f18e6c98-f0e3-473d-8ec1-57ec4db432d2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:49:44.313545 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:44.313454 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f18e6c98-f0e3-473d-8ec1-57ec4db432d2" (UID: "f18e6c98-f0e3-473d-8ec1-57ec4db432d2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:49:44.315300 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:44.315268 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-kube-api-access-77z5m" (OuterVolumeSpecName: "kube-api-access-77z5m") pod "f18e6c98-f0e3-473d-8ec1-57ec4db432d2" (UID: "f18e6c98-f0e3-473d-8ec1-57ec4db432d2"). InnerVolumeSpecName "kube-api-access-77z5m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:49:44.315389 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:44.315327 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f18e6c98-f0e3-473d-8ec1-57ec4db432d2" (UID: "f18e6c98-f0e3-473d-8ec1-57ec4db432d2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:49:44.315389 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:44.315348 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f18e6c98-f0e3-473d-8ec1-57ec4db432d2" (UID: "f18e6c98-f0e3-473d-8ec1-57ec4db432d2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:49:44.414410 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:44.414381 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-console-config\") on node \"ip-10-0-136-90.ec2.internal\" DevicePath \"\"" Jul 02 13:49:44.414410 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:44.414407 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-console-oauth-config\") on node \"ip-10-0-136-90.ec2.internal\" DevicePath \"\"" Jul 02 13:49:44.414571 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:44.414421 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77z5m\" (UniqueName: \"kubernetes.io/projected/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-kube-api-access-77z5m\") on node \"ip-10-0-136-90.ec2.internal\" DevicePath \"\"" Jul 02 13:49:44.414571 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:44.414434 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-trusted-ca-bundle\") on node \"ip-10-0-136-90.ec2.internal\" DevicePath \"\"" Jul 02 13:49:44.414571 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:44.414446 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-console-serving-cert\") on node \"ip-10-0-136-90.ec2.internal\" DevicePath \"\"" Jul 02 13:49:44.414571 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:44.414458 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-oauth-serving-cert\") on node \"ip-10-0-136-90.ec2.internal\" DevicePath \"\"" Jul 02 13:49:44.414571 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:44.414469 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f18e6c98-f0e3-473d-8ec1-57ec4db432d2-service-ca\") on node \"ip-10-0-136-90.ec2.internal\" DevicePath \"\"" Jul 02 13:49:44.590832 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:44.590791 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d8b66bb7f-zngn9"] Jul 02 13:49:44.594529 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:44.594472 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d8b66bb7f-zngn9"] Jul 02 13:49:46.137635 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:46.137601 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f18e6c98-f0e3-473d-8ec1-57ec4db432d2" path="/var/lib/kubelet/pods/f18e6c98-f0e3-473d-8ec1-57ec4db432d2/volumes" Jul 02 13:49:52.080168 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:52.080139 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwl25_5e965a2b-30ed-4337-aaa5-c3dd9744cafc/ovn-acl-logging/0.log" Jul 02 13:49:52.083910 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:52.083886 2563 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 13:49:52.085309 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:49:52.085287 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwl25_5e965a2b-30ed-4337-aaa5-c3dd9744cafc/ovn-acl-logging/0.log" Jul 02 13:50:17.869205 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:17.869171 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f978888dd-mhlpf"] Jul 02 13:50:17.871374 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:17.869470 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f18e6c98-f0e3-473d-8ec1-57ec4db432d2" containerName="console" Jul 02 13:50:17.871374 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:17.869481 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f18e6c98-f0e3-473d-8ec1-57ec4db432d2" containerName="console" Jul 02 13:50:17.871374 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:17.869535 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f18e6c98-f0e3-473d-8ec1-57ec4db432d2" containerName="console" Jul 02 13:50:17.872201 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:17.872183 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f978888dd-mhlpf" Jul 02 13:50:17.875074 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:17.875048 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 02 13:50:17.875236 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:17.875220 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hlnlb\"" Jul 02 13:50:17.875341 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:17.875325 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 02 13:50:17.875857 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:17.875772 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 02 13:50:17.875857 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:17.875811 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 02 13:50:17.876405 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:17.876389 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 02 13:50:17.876508 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:17.876492 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 02 13:50:17.876759 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:17.876741 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 02 13:50:17.881346 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:17.881322 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 02 13:50:17.887211 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:17.887192 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f978888dd-mhlpf"] Jul 02 13:50:17.976657 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:17.976626 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-console-config\") pod \"console-6f978888dd-mhlpf\" (UID: \"4872f90e-4f4a-4625-8bcb-68abb14ca9a3\") " pod="openshift-console/console-6f978888dd-mhlpf" Jul 02 13:50:17.976657 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:17.976661 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-service-ca\") pod \"console-6f978888dd-mhlpf\" (UID: \"4872f90e-4f4a-4625-8bcb-68abb14ca9a3\") " pod="openshift-console/console-6f978888dd-mhlpf" Jul 02 13:50:17.976875 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:17.976684 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-console-oauth-config\") pod \"console-6f978888dd-mhlpf\" (UID: \"4872f90e-4f4a-4625-8bcb-68abb14ca9a3\") " pod="openshift-console/console-6f978888dd-mhlpf" Jul 02 13:50:17.976875 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:17.976733 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-oauth-serving-cert\") pod \"console-6f978888dd-mhlpf\" (UID: \"4872f90e-4f4a-4625-8bcb-68abb14ca9a3\") " pod="openshift-console/console-6f978888dd-mhlpf" Jul 02 13:50:17.976875 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:17.976759 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-console-serving-cert\") pod \"console-6f978888dd-mhlpf\" (UID: \"4872f90e-4f4a-4625-8bcb-68abb14ca9a3\") " pod="openshift-console/console-6f978888dd-mhlpf" Jul 02 13:50:17.976875 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:17.976810 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-trusted-ca-bundle\") pod \"console-6f978888dd-mhlpf\" (UID: \"4872f90e-4f4a-4625-8bcb-68abb14ca9a3\") " pod="openshift-console/console-6f978888dd-mhlpf" Jul 02 13:50:17.976875 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:17.976834 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdsr4\" (UniqueName: \"kubernetes.io/projected/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-kube-api-access-zdsr4\") pod \"console-6f978888dd-mhlpf\" (UID: \"4872f90e-4f4a-4625-8bcb-68abb14ca9a3\") " pod="openshift-console/console-6f978888dd-mhlpf" Jul 02 13:50:18.077749 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:18.077719 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-console-config\") pod \"console-6f978888dd-mhlpf\" (UID: \"4872f90e-4f4a-4625-8bcb-68abb14ca9a3\") " pod="openshift-console/console-6f978888dd-mhlpf" Jul 02 13:50:18.077749 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:18.077753 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-service-ca\") pod \"console-6f978888dd-mhlpf\" (UID: \"4872f90e-4f4a-4625-8bcb-68abb14ca9a3\") " pod="openshift-console/console-6f978888dd-mhlpf" Jul 02 13:50:18.078006 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:18.077777 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-console-oauth-config\") pod \"console-6f978888dd-mhlpf\" (UID: \"4872f90e-4f4a-4625-8bcb-68abb14ca9a3\") " pod="openshift-console/console-6f978888dd-mhlpf" Jul 02 13:50:18.078006 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:18.077799 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-oauth-serving-cert\") pod \"console-6f978888dd-mhlpf\" (UID: \"4872f90e-4f4a-4625-8bcb-68abb14ca9a3\") " pod="openshift-console/console-6f978888dd-mhlpf" Jul 02 13:50:18.078006 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:18.077977 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-console-serving-cert\") pod \"console-6f978888dd-mhlpf\" (UID: \"4872f90e-4f4a-4625-8bcb-68abb14ca9a3\") " pod="openshift-console/console-6f978888dd-mhlpf" Jul 02 13:50:18.078149 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:18.078026 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-trusted-ca-bundle\") pod \"console-6f978888dd-mhlpf\" (UID: \"4872f90e-4f4a-4625-8bcb-68abb14ca9a3\") " pod="openshift-console/console-6f978888dd-mhlpf" Jul 02 13:50:18.078149 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:18.078050 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdsr4\" (UniqueName: \"kubernetes.io/projected/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-kube-api-access-zdsr4\") pod \"console-6f978888dd-mhlpf\" (UID: \"4872f90e-4f4a-4625-8bcb-68abb14ca9a3\") " pod="openshift-console/console-6f978888dd-mhlpf" Jul 02 13:50:18.078624 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:18.078601 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-service-ca\") pod \"console-6f978888dd-mhlpf\" (UID: \"4872f90e-4f4a-4625-8bcb-68abb14ca9a3\") " pod="openshift-console/console-6f978888dd-mhlpf" Jul 02 13:50:18.078843 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:18.078811 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-console-config\") pod \"console-6f978888dd-mhlpf\" (UID: \"4872f90e-4f4a-4625-8bcb-68abb14ca9a3\") " pod="openshift-console/console-6f978888dd-mhlpf" Jul 02 13:50:18.078954 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:18.078845 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-oauth-serving-cert\") pod \"console-6f978888dd-mhlpf\" (UID: \"4872f90e-4f4a-4625-8bcb-68abb14ca9a3\") " pod="openshift-console/console-6f978888dd-mhlpf" Jul 02 13:50:18.079040 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:18.079024 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-trusted-ca-bundle\") pod \"console-6f978888dd-mhlpf\" (UID: \"4872f90e-4f4a-4625-8bcb-68abb14ca9a3\") " pod="openshift-console/console-6f978888dd-mhlpf" Jul 02 13:50:18.080572 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:18.080550 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-console-oauth-config\") pod \"console-6f978888dd-mhlpf\" (UID: \"4872f90e-4f4a-4625-8bcb-68abb14ca9a3\") " pod="openshift-console/console-6f978888dd-mhlpf" Jul 02 13:50:18.080572 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:18.080564 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-console-serving-cert\") pod \"console-6f978888dd-mhlpf\" (UID: \"4872f90e-4f4a-4625-8bcb-68abb14ca9a3\") " pod="openshift-console/console-6f978888dd-mhlpf" Jul 02 13:50:18.086642 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:18.086611 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdsr4\" (UniqueName: \"kubernetes.io/projected/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-kube-api-access-zdsr4\") pod \"console-6f978888dd-mhlpf\" (UID: \"4872f90e-4f4a-4625-8bcb-68abb14ca9a3\") " pod="openshift-console/console-6f978888dd-mhlpf" Jul 02 13:50:18.182224 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:18.182154 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f978888dd-mhlpf" Jul 02 13:50:18.314318 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:18.314288 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f978888dd-mhlpf"] Jul 02 13:50:18.317270 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:50:18.317241 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4872f90e_4f4a_4625_8bcb_68abb14ca9a3.slice/crio-5510a9935b383f7fac884d81dbcac3d61398c3b07a8369386f1ff4c23011d7c4 WatchSource:0}: Error finding container 5510a9935b383f7fac884d81dbcac3d61398c3b07a8369386f1ff4c23011d7c4: Status 404 returned error can't find the container with id 5510a9935b383f7fac884d81dbcac3d61398c3b07a8369386f1ff4c23011d7c4 Jul 02 13:50:18.396194 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:18.396157 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f978888dd-mhlpf" event={"ID":"4872f90e-4f4a-4625-8bcb-68abb14ca9a3","Type":"ContainerStarted","Data":"b8173172cb5e1d86fa831cece457248c5c79efd5c8a18abaa28f8ee7d6099ace"} Jul 02 13:50:18.396368 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:18.396245 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f978888dd-mhlpf" event={"ID":"4872f90e-4f4a-4625-8bcb-68abb14ca9a3","Type":"ContainerStarted","Data":"5510a9935b383f7fac884d81dbcac3d61398c3b07a8369386f1ff4c23011d7c4"} Jul 02 13:50:18.417073 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:18.416985 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f978888dd-mhlpf" podStartSLOduration=1.416970685 podStartE2EDuration="1.416970685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:50:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:50:18.415988676 +0000 UTC m=+326.696243223" watchObservedRunningTime="2026-07-02 13:50:18.416970685 +0000 UTC m=+326.697225268" Jul 02 13:50:28.182875 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:28.182843 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f978888dd-mhlpf" Jul 02 13:50:28.183411 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:28.182908 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f978888dd-mhlpf" Jul 02 13:50:28.187574 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:28.187552 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f978888dd-mhlpf" Jul 02 13:50:28.440165 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:50:28.440087 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f978888dd-mhlpf" Jul 02 13:52:42.175141 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:42.175109 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-nrmk4"] Jul 02 13:52:42.178061 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:42.178047 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-nrmk4" Jul 02 13:52:42.181333 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:42.181313 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 02 13:52:42.181447 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:42.181317 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 02 13:52:42.181871 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:42.181854 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 02 13:52:42.181979 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:42.181911 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-gl87g\"" Jul 02 13:52:42.241584 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:42.241560 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-nrmk4"] Jul 02 13:52:42.268424 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:42.268393 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rflbn\" (UniqueName: \"kubernetes.io/projected/95306662-43a7-4430-ac1a-475b98053e51-kube-api-access-rflbn\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-nrmk4\" (UID: \"95306662-43a7-4430-ac1a-475b98053e51\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-nrmk4" Jul 02 13:52:42.268535 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:42.268434 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/95306662-43a7-4430-ac1a-475b98053e51-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-nrmk4\" (UID: \"95306662-43a7-4430-ac1a-475b98053e51\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-nrmk4" Jul 02 13:52:42.369316 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:42.369286 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rflbn\" (UniqueName: \"kubernetes.io/projected/95306662-43a7-4430-ac1a-475b98053e51-kube-api-access-rflbn\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-nrmk4\" (UID: \"95306662-43a7-4430-ac1a-475b98053e51\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-nrmk4" Jul 02 13:52:42.369457 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:42.369327 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/95306662-43a7-4430-ac1a-475b98053e51-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-nrmk4\" (UID: \"95306662-43a7-4430-ac1a-475b98053e51\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-nrmk4" Jul 02 13:52:42.371712 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:42.371691 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/95306662-43a7-4430-ac1a-475b98053e51-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-nrmk4\" (UID: \"95306662-43a7-4430-ac1a-475b98053e51\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-nrmk4" Jul 02 13:52:42.378920 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:42.378899 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rflbn\" (UniqueName: \"kubernetes.io/projected/95306662-43a7-4430-ac1a-475b98053e51-kube-api-access-rflbn\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-nrmk4\" (UID: \"95306662-43a7-4430-ac1a-475b98053e51\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-nrmk4" Jul 02 13:52:42.487721 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:42.487629 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-nrmk4" Jul 02 13:52:42.623276 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:42.623233 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-nrmk4"] Jul 02 13:52:42.627608 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:52:42.627584 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95306662_43a7_4430_ac1a_475b98053e51.slice/crio-de91abbf481bbdc4ef967161158c8f107cfd1220977301a366cf15fe18918338 WatchSource:0}: Error finding container de91abbf481bbdc4ef967161158c8f107cfd1220977301a366cf15fe18918338: Status 404 returned error can't find the container with id de91abbf481bbdc4ef967161158c8f107cfd1220977301a366cf15fe18918338 Jul 02 13:52:42.629549 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:42.629521 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 13:52:42.955745 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:42.955711 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-nrmk4" event={"ID":"95306662-43a7-4430-ac1a-475b98053e51","Type":"ContainerStarted","Data":"de91abbf481bbdc4ef967161158c8f107cfd1220977301a366cf15fe18918338"} Jul 02 13:52:46.982556 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:46.982513 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-nrmk4" event={"ID":"95306662-43a7-4430-ac1a-475b98053e51","Type":"ContainerStarted","Data":"d830b42d9f44bc20beeeece7cb2770055580f8a5dfc4eca9c37b8b1bc7647191"} Jul 02 13:52:46.982950 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:46.982585 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-nrmk4" Jul 02 13:52:47.015095 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:47.015051 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-nrmk4" podStartSLOduration=1.364547282 podStartE2EDuration="5.015037263s" totalImagesPullingTime="3.650489981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:52:47.010777539 +0000 UTC m=+475.291032069" watchObservedRunningTime="2026-07-02 13:52:47.015037263 +0000 UTC m=+475.295291793" Jul 02 13:52:47.112781 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:47.112752 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-68bff59c-szlz8"] Jul 02 13:52:47.115940 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:47.115907 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-szlz8" Jul 02 13:52:47.122220 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:47.122197 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 02 13:52:47.122296 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:47.122208 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-6grx7\"" Jul 02 13:52:47.122296 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:47.122270 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 02 13:52:47.134742 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:47.134723 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-szlz8"] Jul 02 13:52:47.213011 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:47.212986 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/7d50a11a-6836-4dc6-87eb-5e84b60052e0-certificates\") pod \"keda-operator-68bff59c-szlz8\" (UID: \"7d50a11a-6836-4dc6-87eb-5e84b60052e0\") " pod="openshift-keda/keda-operator-68bff59c-szlz8" Jul 02 13:52:47.213153 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:47.213016 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/7d50a11a-6836-4dc6-87eb-5e84b60052e0-cabundle0\") pod \"keda-operator-68bff59c-szlz8\" (UID: \"7d50a11a-6836-4dc6-87eb-5e84b60052e0\") " pod="openshift-keda/keda-operator-68bff59c-szlz8" Jul 02 13:52:47.213153 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:47.213045 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj2ws\" (UniqueName: \"kubernetes.io/projected/7d50a11a-6836-4dc6-87eb-5e84b60052e0-kube-api-access-pj2ws\") pod \"keda-operator-68bff59c-szlz8\" (UID: \"7d50a11a-6836-4dc6-87eb-5e84b60052e0\") " pod="openshift-keda/keda-operator-68bff59c-szlz8" Jul 02 13:52:47.313570 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:47.313502 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/7d50a11a-6836-4dc6-87eb-5e84b60052e0-certificates\") pod \"keda-operator-68bff59c-szlz8\" (UID: \"7d50a11a-6836-4dc6-87eb-5e84b60052e0\") " pod="openshift-keda/keda-operator-68bff59c-szlz8" Jul 02 13:52:47.313570 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:47.313532 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/7d50a11a-6836-4dc6-87eb-5e84b60052e0-cabundle0\") pod \"keda-operator-68bff59c-szlz8\" (UID: \"7d50a11a-6836-4dc6-87eb-5e84b60052e0\") " pod="openshift-keda/keda-operator-68bff59c-szlz8" Jul 02 13:52:47.313570 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:47.313549 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj2ws\" (UniqueName: \"kubernetes.io/projected/7d50a11a-6836-4dc6-87eb-5e84b60052e0-kube-api-access-pj2ws\") pod \"keda-operator-68bff59c-szlz8\" (UID: \"7d50a11a-6836-4dc6-87eb-5e84b60052e0\") " pod="openshift-keda/keda-operator-68bff59c-szlz8" Jul 02 13:52:47.313747 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:52:47.313641 2563 secret.go:281] references non-existent secret key: ca.crt Jul 02 13:52:47.313747 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:52:47.313657 2563 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 02 13:52:47.313747 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:52:47.313665 2563 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-szlz8: references non-existent secret key: ca.crt Jul 02 13:52:47.313747 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:52:47.313719 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d50a11a-6836-4dc6-87eb-5e84b60052e0-certificates podName:7d50a11a-6836-4dc6-87eb-5e84b60052e0 nodeName:}" failed. No retries permitted until 2026-07-02 13:52:47.813704715 +0000 UTC m=+476.093959224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/7d50a11a-6836-4dc6-87eb-5e84b60052e0-certificates") pod "keda-operator-68bff59c-szlz8" (UID: "7d50a11a-6836-4dc6-87eb-5e84b60052e0") : references non-existent secret key: ca.crt Jul 02 13:52:47.314203 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:47.314185 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/7d50a11a-6836-4dc6-87eb-5e84b60052e0-cabundle0\") pod \"keda-operator-68bff59c-szlz8\" (UID: \"7d50a11a-6836-4dc6-87eb-5e84b60052e0\") " pod="openshift-keda/keda-operator-68bff59c-szlz8" Jul 02 13:52:47.323744 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:47.323722 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj2ws\" (UniqueName: \"kubernetes.io/projected/7d50a11a-6836-4dc6-87eb-5e84b60052e0-kube-api-access-pj2ws\") pod \"keda-operator-68bff59c-szlz8\" (UID: \"7d50a11a-6836-4dc6-87eb-5e84b60052e0\") " pod="openshift-keda/keda-operator-68bff59c-szlz8" Jul 02 13:52:47.818015 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:47.817984 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/7d50a11a-6836-4dc6-87eb-5e84b60052e0-certificates\") pod \"keda-operator-68bff59c-szlz8\" (UID: \"7d50a11a-6836-4dc6-87eb-5e84b60052e0\") " pod="openshift-keda/keda-operator-68bff59c-szlz8" Jul 02 13:52:47.820485 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:47.820453 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/7d50a11a-6836-4dc6-87eb-5e84b60052e0-certificates\") pod \"keda-operator-68bff59c-szlz8\" (UID: \"7d50a11a-6836-4dc6-87eb-5e84b60052e0\") " pod="openshift-keda/keda-operator-68bff59c-szlz8" Jul 02 13:52:47.824438 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:47.824416 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-qv658"] Jul 02 13:52:47.827706 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:47.827689 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-qv658" Jul 02 13:52:47.830897 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:47.830878 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 02 13:52:47.838751 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:47.838728 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-qv658"] Jul 02 13:52:47.918852 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:47.918826 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shsrr\" (UniqueName: \"kubernetes.io/projected/0eb2b1af-181a-4e98-93f0-544f55ea1792-kube-api-access-shsrr\") pod \"keda-metrics-apiserver-559f75f947-qv658\" (UID: \"0eb2b1af-181a-4e98-93f0-544f55ea1792\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-qv658" Jul 02 13:52:47.918986 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:47.918881 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/0eb2b1af-181a-4e98-93f0-544f55ea1792-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-qv658\" (UID: \"0eb2b1af-181a-4e98-93f0-544f55ea1792\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-qv658" Jul 02 13:52:47.918986 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:47.918959 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0eb2b1af-181a-4e98-93f0-544f55ea1792-certificates\") pod \"keda-metrics-apiserver-559f75f947-qv658\" (UID: \"0eb2b1af-181a-4e98-93f0-544f55ea1792\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-qv658" Jul 02 13:52:47.992981 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:47.992952 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-hhhsn"] Jul 02 13:52:47.996089 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:47.996071 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-hhhsn" Jul 02 13:52:47.999144 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:47.999126 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 02 13:52:48.007196 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:48.007175 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-hhhsn"] Jul 02 13:52:48.019512 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:48.019477 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shsrr\" (UniqueName: \"kubernetes.io/projected/0eb2b1af-181a-4e98-93f0-544f55ea1792-kube-api-access-shsrr\") pod \"keda-metrics-apiserver-559f75f947-qv658\" (UID: \"0eb2b1af-181a-4e98-93f0-544f55ea1792\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-qv658" Jul 02 13:52:48.019637 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:48.019546 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/0eb2b1af-181a-4e98-93f0-544f55ea1792-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-qv658\" (UID: \"0eb2b1af-181a-4e98-93f0-544f55ea1792\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-qv658" Jul 02 13:52:48.019637 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:48.019592 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0eb2b1af-181a-4e98-93f0-544f55ea1792-certificates\") pod \"keda-metrics-apiserver-559f75f947-qv658\" (UID: \"0eb2b1af-181a-4e98-93f0-544f55ea1792\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-qv658" Jul 02 13:52:48.019956 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:48.019918 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/0eb2b1af-181a-4e98-93f0-544f55ea1792-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-qv658\" (UID: \"0eb2b1af-181a-4e98-93f0-544f55ea1792\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-qv658" Jul 02 13:52:48.022318 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:48.022297 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0eb2b1af-181a-4e98-93f0-544f55ea1792-certificates\") pod \"keda-metrics-apiserver-559f75f947-qv658\" (UID: \"0eb2b1af-181a-4e98-93f0-544f55ea1792\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-qv658" Jul 02 13:52:48.025995 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:48.025971 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-szlz8" Jul 02 13:52:48.030786 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:48.030758 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shsrr\" (UniqueName: \"kubernetes.io/projected/0eb2b1af-181a-4e98-93f0-544f55ea1792-kube-api-access-shsrr\") pod \"keda-metrics-apiserver-559f75f947-qv658\" (UID: \"0eb2b1af-181a-4e98-93f0-544f55ea1792\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-qv658" Jul 02 13:52:48.126898 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:48.126857 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/da7d96d2-aa9a-4bcc-a665-8d1512bbf15a-certificates\") pod \"keda-admission-5fbd5c4644-hhhsn\" (UID: \"da7d96d2-aa9a-4bcc-a665-8d1512bbf15a\") " pod="openshift-keda/keda-admission-5fbd5c4644-hhhsn" Jul 02 13:52:48.126898 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:48.126890 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49p5l\" (UniqueName: \"kubernetes.io/projected/da7d96d2-aa9a-4bcc-a665-8d1512bbf15a-kube-api-access-49p5l\") pod \"keda-admission-5fbd5c4644-hhhsn\" (UID: \"da7d96d2-aa9a-4bcc-a665-8d1512bbf15a\") " pod="openshift-keda/keda-admission-5fbd5c4644-hhhsn" Jul 02 13:52:48.138511 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:48.138476 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-qv658" Jul 02 13:52:48.161993 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:48.161855 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-szlz8"] Jul 02 13:52:48.164141 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:52:48.164117 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d50a11a_6836_4dc6_87eb_5e84b60052e0.slice/crio-33ec7545d93efb160ec2f82aaa6d641565e8e84cae70085b81d59adb6c7e66f1 WatchSource:0}: Error finding container 33ec7545d93efb160ec2f82aaa6d641565e8e84cae70085b81d59adb6c7e66f1: Status 404 returned error can't find the container with id 33ec7545d93efb160ec2f82aaa6d641565e8e84cae70085b81d59adb6c7e66f1 Jul 02 13:52:48.227523 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:48.227491 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/da7d96d2-aa9a-4bcc-a665-8d1512bbf15a-certificates\") pod \"keda-admission-5fbd5c4644-hhhsn\" (UID: \"da7d96d2-aa9a-4bcc-a665-8d1512bbf15a\") " pod="openshift-keda/keda-admission-5fbd5c4644-hhhsn" Jul 02 13:52:48.227665 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:48.227537 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49p5l\" (UniqueName: \"kubernetes.io/projected/da7d96d2-aa9a-4bcc-a665-8d1512bbf15a-kube-api-access-49p5l\") pod \"keda-admission-5fbd5c4644-hhhsn\" (UID: \"da7d96d2-aa9a-4bcc-a665-8d1512bbf15a\") " pod="openshift-keda/keda-admission-5fbd5c4644-hhhsn" Jul 02 13:52:48.227726 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:52:48.227665 2563 projected.go:266] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: secret "keda-admission-webhooks-certs" not found Jul 02 13:52:48.227762 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:52:48.227695 2563 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-5fbd5c4644-hhhsn: secret "keda-admission-webhooks-certs" not found Jul 02 13:52:48.227807 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:52:48.227794 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da7d96d2-aa9a-4bcc-a665-8d1512bbf15a-certificates podName:da7d96d2-aa9a-4bcc-a665-8d1512bbf15a nodeName:}" failed. No retries permitted until 2026-07-02 13:52:48.727769841 +0000 UTC m=+477.008024369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/da7d96d2-aa9a-4bcc-a665-8d1512bbf15a-certificates") pod "keda-admission-5fbd5c4644-hhhsn" (UID: "da7d96d2-aa9a-4bcc-a665-8d1512bbf15a") : secret "keda-admission-webhooks-certs" not found Jul 02 13:52:48.239343 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:48.239318 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49p5l\" (UniqueName: \"kubernetes.io/projected/da7d96d2-aa9a-4bcc-a665-8d1512bbf15a-kube-api-access-49p5l\") pod \"keda-admission-5fbd5c4644-hhhsn\" (UID: \"da7d96d2-aa9a-4bcc-a665-8d1512bbf15a\") " pod="openshift-keda/keda-admission-5fbd5c4644-hhhsn" Jul 02 13:52:48.276587 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:48.276564 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-qv658"] Jul 02 13:52:48.278914 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:52:48.278895 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eb2b1af_181a_4e98_93f0_544f55ea1792.slice/crio-45712aac27a03c02fefa91c0462ed9f79e7a270797318a6368538d1035304a33 WatchSource:0}: Error finding container 45712aac27a03c02fefa91c0462ed9f79e7a270797318a6368538d1035304a33: Status 404 returned error can't find the container with id 45712aac27a03c02fefa91c0462ed9f79e7a270797318a6368538d1035304a33 Jul 02 13:52:48.732894 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:48.732860 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/da7d96d2-aa9a-4bcc-a665-8d1512bbf15a-certificates\") pod \"keda-admission-5fbd5c4644-hhhsn\" (UID: \"da7d96d2-aa9a-4bcc-a665-8d1512bbf15a\") " pod="openshift-keda/keda-admission-5fbd5c4644-hhhsn" Jul 02 13:52:48.735533 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:48.735514 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/da7d96d2-aa9a-4bcc-a665-8d1512bbf15a-certificates\") pod \"keda-admission-5fbd5c4644-hhhsn\" (UID: \"da7d96d2-aa9a-4bcc-a665-8d1512bbf15a\") " pod="openshift-keda/keda-admission-5fbd5c4644-hhhsn" Jul 02 13:52:48.906082 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:48.906047 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-hhhsn" Jul 02 13:52:48.994552 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:48.994468 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-qv658" event={"ID":"0eb2b1af-181a-4e98-93f0-544f55ea1792","Type":"ContainerStarted","Data":"45712aac27a03c02fefa91c0462ed9f79e7a270797318a6368538d1035304a33"} Jul 02 13:52:48.996105 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:48.996078 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-szlz8" event={"ID":"7d50a11a-6836-4dc6-87eb-5e84b60052e0","Type":"ContainerStarted","Data":"33ec7545d93efb160ec2f82aaa6d641565e8e84cae70085b81d59adb6c7e66f1"} Jul 02 13:52:49.066006 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:49.065891 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-hhhsn"] Jul 02 13:52:49.069487 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:52:49.069454 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda7d96d2_aa9a_4bcc_a665_8d1512bbf15a.slice/crio-33d1a2f6422b708acc5df8ebdd295b487a8b6c0ec82958126d5fd3075b80bab0 WatchSource:0}: Error finding container 33d1a2f6422b708acc5df8ebdd295b487a8b6c0ec82958126d5fd3075b80bab0: Status 404 returned error can't find the container with id 33d1a2f6422b708acc5df8ebdd295b487a8b6c0ec82958126d5fd3075b80bab0 Jul 02 13:52:50.004108 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:50.004036 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-hhhsn" event={"ID":"da7d96d2-aa9a-4bcc-a665-8d1512bbf15a","Type":"ContainerStarted","Data":"33d1a2f6422b708acc5df8ebdd295b487a8b6c0ec82958126d5fd3075b80bab0"} Jul 02 13:52:53.025442 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:53.025408 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-hhhsn" event={"ID":"da7d96d2-aa9a-4bcc-a665-8d1512bbf15a","Type":"ContainerStarted","Data":"fba385b239bbefce6b5b6a4b0d5fe4e34f6e63eea4626ea9a28ebffe25d10d1a"} Jul 02 13:52:53.025881 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:53.025501 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-5fbd5c4644-hhhsn" Jul 02 13:52:53.026799 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:53.026763 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-qv658" event={"ID":"0eb2b1af-181a-4e98-93f0-544f55ea1792","Type":"ContainerStarted","Data":"82c9636fcee462051c0b17d4809ef405044f247c38a4fdc018e3c8386738f962"} Jul 02 13:52:53.026906 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:53.026870 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-qv658" Jul 02 13:52:53.028217 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:53.028196 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-szlz8" event={"ID":"7d50a11a-6836-4dc6-87eb-5e84b60052e0","Type":"ContainerStarted","Data":"09dba3e41511499b8eb679992156a79bdcb19273cd24be718fdeb8916f0cb356"} Jul 02 13:52:53.028315 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:53.028246 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-68bff59c-szlz8" Jul 02 13:52:53.045167 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:53.045132 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-5fbd5c4644-hhhsn" podStartSLOduration=2.748737927 podStartE2EDuration="6.045119481s" totalImagesPullingTime="3.296381554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:52:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:52:53.044435442 +0000 UTC m=+481.324690003" watchObservedRunningTime="2026-07-02 13:52:53.045119481 +0000 UTC m=+481.325373989" Jul 02 13:52:53.065306 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:53.065267 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-68bff59c-szlz8" podStartSLOduration=1.924925767 podStartE2EDuration="6.065253944s" totalImagesPullingTime="4.140328177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:52:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:52:53.063278242 +0000 UTC m=+481.343532774" watchObservedRunningTime="2026-07-02 13:52:53.065253944 +0000 UTC m=+481.345508473" Jul 02 13:52:53.095134 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:52:53.095100 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-559f75f947-qv658" podStartSLOduration=2.069669583 podStartE2EDuration="6.095087218s" totalImagesPullingTime="4.025417635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:52:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:52:53.093649358 +0000 UTC m=+481.373903887" watchObservedRunningTime="2026-07-02 13:52:53.095087218 +0000 UTC m=+481.375341748" Jul 02 13:53:04.036924 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:53:04.036892 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-qv658" Jul 02 13:53:07.989627 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:53:07.989594 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-nrmk4" Jul 02 13:53:14.034620 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:53:14.034589 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-68bff59c-szlz8" Jul 02 13:53:14.035195 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:53:14.034655 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-5fbd5c4644-hhhsn" Jul 02 13:53:58.883058 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:53:58.882975 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-x7bx4"] Jul 02 13:53:58.885628 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:53:58.885609 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-x7bx4" Jul 02 13:53:58.888710 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:53:58.888689 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-97d78\"" Jul 02 13:53:58.888821 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:53:58.888689 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 02 13:53:58.889816 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:53:58.889796 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 02 13:53:58.889816 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:53:58.889806 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 02 13:53:58.898700 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:53:58.898671 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-x7bx4"] Jul 02 13:53:58.903013 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:53:58.902990 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4c6411b4-56ea-4986-971d-9768db74406a-data\") pod \"seaweedfs-64568bcd49-x7bx4\" (UID: \"4c6411b4-56ea-4986-971d-9768db74406a\") " pod="kserve/seaweedfs-64568bcd49-x7bx4" Jul 02 13:53:58.903113 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:53:58.903075 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcjqh\" (UniqueName: \"kubernetes.io/projected/4c6411b4-56ea-4986-971d-9768db74406a-kube-api-access-gcjqh\") pod \"seaweedfs-64568bcd49-x7bx4\" (UID: \"4c6411b4-56ea-4986-971d-9768db74406a\") " pod="kserve/seaweedfs-64568bcd49-x7bx4" Jul 02 13:53:59.003903 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:53:59.003871 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcjqh\" (UniqueName: \"kubernetes.io/projected/4c6411b4-56ea-4986-971d-9768db74406a-kube-api-access-gcjqh\") pod \"seaweedfs-64568bcd49-x7bx4\" (UID: \"4c6411b4-56ea-4986-971d-9768db74406a\") " pod="kserve/seaweedfs-64568bcd49-x7bx4" Jul 02 13:53:59.004096 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:53:59.003979 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4c6411b4-56ea-4986-971d-9768db74406a-data\") pod \"seaweedfs-64568bcd49-x7bx4\" (UID: \"4c6411b4-56ea-4986-971d-9768db74406a\") " pod="kserve/seaweedfs-64568bcd49-x7bx4" Jul 02 13:53:59.004352 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:53:59.004335 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4c6411b4-56ea-4986-971d-9768db74406a-data\") pod \"seaweedfs-64568bcd49-x7bx4\" (UID: \"4c6411b4-56ea-4986-971d-9768db74406a\") " pod="kserve/seaweedfs-64568bcd49-x7bx4" Jul 02 13:53:59.013682 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:53:59.013657 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcjqh\" (UniqueName: \"kubernetes.io/projected/4c6411b4-56ea-4986-971d-9768db74406a-kube-api-access-gcjqh\") pod \"seaweedfs-64568bcd49-x7bx4\" (UID: \"4c6411b4-56ea-4986-971d-9768db74406a\") " pod="kserve/seaweedfs-64568bcd49-x7bx4" Jul 02 13:53:59.194526 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:53:59.194457 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-x7bx4" Jul 02 13:53:59.336791 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:53:59.336769 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-x7bx4"] Jul 02 13:53:59.339401 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:53:59.339372 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c6411b4_56ea_4986_971d_9768db74406a.slice/crio-3b846ba18ae4fee5cb6f77f6b63beaa8f9216ecbb4f6a248fb2ebe9c693cdae6 WatchSource:0}: Error finding container 3b846ba18ae4fee5cb6f77f6b63beaa8f9216ecbb4f6a248fb2ebe9c693cdae6: Status 404 returned error can't find the container with id 3b846ba18ae4fee5cb6f77f6b63beaa8f9216ecbb4f6a248fb2ebe9c693cdae6 Jul 02 13:54:00.309499 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:54:00.309455 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-x7bx4" event={"ID":"4c6411b4-56ea-4986-971d-9768db74406a","Type":"ContainerStarted","Data":"3b846ba18ae4fee5cb6f77f6b63beaa8f9216ecbb4f6a248fb2ebe9c693cdae6"} Jul 02 13:54:03.325353 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:54:03.325314 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-x7bx4" event={"ID":"4c6411b4-56ea-4986-971d-9768db74406a","Type":"ContainerStarted","Data":"e94f738dd5eebe8e9e3e24c067c27002a5e5dfcf74e4fc36f3f50532f4eaa466"} Jul 02 13:54:03.325788 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:54:03.325391 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-x7bx4" Jul 02 13:54:03.347703 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:54:03.347658 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-x7bx4" podStartSLOduration=2.057132393 podStartE2EDuration="5.347640667s" totalImagesPullingTime="3.290508274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:53:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:54:03.345838478 +0000 UTC m=+551.626093030" watchObservedRunningTime="2026-07-02 13:54:03.347640667 +0000 UTC m=+551.627895195" Jul 02 13:54:09.336982 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:54:09.336949 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-x7bx4" Jul 02 13:54:52.113823 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:54:52.113793 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwl25_5e965a2b-30ed-4337-aaa5-c3dd9744cafc/ovn-acl-logging/0.log" Jul 02 13:54:52.116282 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:54:52.116254 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwl25_5e965a2b-30ed-4337-aaa5-c3dd9744cafc/ovn-acl-logging/0.log" Jul 02 13:55:09.151411 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:09.151380 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-fd65d7d6-qwvns"] Jul 02 13:55:09.154144 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:09.154128 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-qwvns" Jul 02 13:55:09.156892 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:09.156870 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\"" Jul 02 13:55:09.157166 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:09.157151 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-4c2lg\"" Jul 02 13:55:09.168018 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:09.167996 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-qwvns"] Jul 02 13:55:09.174627 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:09.174599 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sddl4\" (UniqueName: \"kubernetes.io/projected/09c40729-64df-4680-bc9d-124264eb63d6-kube-api-access-sddl4\") pod \"model-serving-api-fd65d7d6-qwvns\" (UID: \"09c40729-64df-4680-bc9d-124264eb63d6\") " pod="kserve/model-serving-api-fd65d7d6-qwvns" Jul 02 13:55:09.174724 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:09.174707 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09c40729-64df-4680-bc9d-124264eb63d6-tls-certs\") pod \"model-serving-api-fd65d7d6-qwvns\" (UID: \"09c40729-64df-4680-bc9d-124264eb63d6\") " pod="kserve/model-serving-api-fd65d7d6-qwvns" Jul 02 13:55:09.174766 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:09.174743 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-84b54b7f97-j4hg9"] Jul 02 13:55:09.177673 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:09.177657 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-j4hg9" Jul 02 13:55:09.180473 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:09.180456 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\"" Jul 02 13:55:09.180546 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:09.180490 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-2lt82\"" Jul 02 13:55:09.186083 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:09.186061 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-j4hg9"] Jul 02 13:55:09.275198 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:09.275173 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cnsw\" (UniqueName: \"kubernetes.io/projected/21ee67a6-5e92-48bc-ad16-1502a44fd4bf-kube-api-access-7cnsw\") pod \"odh-model-controller-84b54b7f97-j4hg9\" (UID: \"21ee67a6-5e92-48bc-ad16-1502a44fd4bf\") " pod="kserve/odh-model-controller-84b54b7f97-j4hg9" Jul 02 13:55:09.275359 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:09.275234 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21ee67a6-5e92-48bc-ad16-1502a44fd4bf-cert\") pod \"odh-model-controller-84b54b7f97-j4hg9\" (UID: \"21ee67a6-5e92-48bc-ad16-1502a44fd4bf\") " pod="kserve/odh-model-controller-84b54b7f97-j4hg9" Jul 02 13:55:09.275359 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:09.275278 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09c40729-64df-4680-bc9d-124264eb63d6-tls-certs\") pod \"model-serving-api-fd65d7d6-qwvns\" (UID: \"09c40729-64df-4680-bc9d-124264eb63d6\") " pod="kserve/model-serving-api-fd65d7d6-qwvns" Jul 02 13:55:09.275359 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:09.275351 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sddl4\" (UniqueName: \"kubernetes.io/projected/09c40729-64df-4680-bc9d-124264eb63d6-kube-api-access-sddl4\") pod \"model-serving-api-fd65d7d6-qwvns\" (UID: \"09c40729-64df-4680-bc9d-124264eb63d6\") " pod="kserve/model-serving-api-fd65d7d6-qwvns" Jul 02 13:55:09.275491 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:55:09.275363 2563 secret.go:189] Couldn't get secret kserve/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 02 13:55:09.276078 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:55:09.276054 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09c40729-64df-4680-bc9d-124264eb63d6-tls-certs podName:09c40729-64df-4680-bc9d-124264eb63d6 nodeName:}" failed. No retries permitted until 2026-07-02 13:55:09.776028008 +0000 UTC m=+618.056282522 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/09c40729-64df-4680-bc9d-124264eb63d6-tls-certs") pod "model-serving-api-fd65d7d6-qwvns" (UID: "09c40729-64df-4680-bc9d-124264eb63d6") : secret "model-serving-api-tls" not found Jul 02 13:55:09.285853 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:09.285824 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sddl4\" (UniqueName: \"kubernetes.io/projected/09c40729-64df-4680-bc9d-124264eb63d6-kube-api-access-sddl4\") pod \"model-serving-api-fd65d7d6-qwvns\" (UID: \"09c40729-64df-4680-bc9d-124264eb63d6\") " pod="kserve/model-serving-api-fd65d7d6-qwvns" Jul 02 13:55:09.376401 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:09.376374 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cnsw\" (UniqueName: \"kubernetes.io/projected/21ee67a6-5e92-48bc-ad16-1502a44fd4bf-kube-api-access-7cnsw\") pod \"odh-model-controller-84b54b7f97-j4hg9\" (UID: \"21ee67a6-5e92-48bc-ad16-1502a44fd4bf\") " pod="kserve/odh-model-controller-84b54b7f97-j4hg9" Jul 02 13:55:09.376519 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:09.376423 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21ee67a6-5e92-48bc-ad16-1502a44fd4bf-cert\") pod \"odh-model-controller-84b54b7f97-j4hg9\" (UID: \"21ee67a6-5e92-48bc-ad16-1502a44fd4bf\") " pod="kserve/odh-model-controller-84b54b7f97-j4hg9" Jul 02 13:55:09.378782 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:09.378753 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21ee67a6-5e92-48bc-ad16-1502a44fd4bf-cert\") pod \"odh-model-controller-84b54b7f97-j4hg9\" (UID: \"21ee67a6-5e92-48bc-ad16-1502a44fd4bf\") " pod="kserve/odh-model-controller-84b54b7f97-j4hg9" Jul 02 13:55:09.385825 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:09.385798 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cnsw\" (UniqueName: \"kubernetes.io/projected/21ee67a6-5e92-48bc-ad16-1502a44fd4bf-kube-api-access-7cnsw\") pod \"odh-model-controller-84b54b7f97-j4hg9\" (UID: \"21ee67a6-5e92-48bc-ad16-1502a44fd4bf\") " pod="kserve/odh-model-controller-84b54b7f97-j4hg9" Jul 02 13:55:09.488177 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:09.488096 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-j4hg9" Jul 02 13:55:09.619909 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:09.619885 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-j4hg9"] Jul 02 13:55:09.622150 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:55:09.622124 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21ee67a6_5e92_48bc_ad16_1502a44fd4bf.slice/crio-3fd3bd26470cf274feb1125d2a156afcedf9cef4a684165c2b25381e0994dcbc WatchSource:0}: Error finding container 3fd3bd26470cf274feb1125d2a156afcedf9cef4a684165c2b25381e0994dcbc: Status 404 returned error can't find the container with id 3fd3bd26470cf274feb1125d2a156afcedf9cef4a684165c2b25381e0994dcbc Jul 02 13:55:09.780442 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:09.780366 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09c40729-64df-4680-bc9d-124264eb63d6-tls-certs\") pod \"model-serving-api-fd65d7d6-qwvns\" (UID: \"09c40729-64df-4680-bc9d-124264eb63d6\") " pod="kserve/model-serving-api-fd65d7d6-qwvns" Jul 02 13:55:09.782712 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:09.782694 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09c40729-64df-4680-bc9d-124264eb63d6-tls-certs\") pod \"model-serving-api-fd65d7d6-qwvns\" (UID: \"09c40729-64df-4680-bc9d-124264eb63d6\") " pod="kserve/model-serving-api-fd65d7d6-qwvns" Jul 02 13:55:10.065046 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:10.064925 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-qwvns" Jul 02 13:55:10.208370 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:10.208338 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-qwvns"] Jul 02 13:55:10.211913 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:55:10.211883 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09c40729_64df_4680_bc9d_124264eb63d6.slice/crio-b868766dca215e62356db21544bc38de1dd1653360f83a29ba4dfda3ad3740fa WatchSource:0}: Error finding container b868766dca215e62356db21544bc38de1dd1653360f83a29ba4dfda3ad3740fa: Status 404 returned error can't find the container with id b868766dca215e62356db21544bc38de1dd1653360f83a29ba4dfda3ad3740fa Jul 02 13:55:10.610244 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:10.610204 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-j4hg9" event={"ID":"21ee67a6-5e92-48bc-ad16-1502a44fd4bf","Type":"ContainerStarted","Data":"3fd3bd26470cf274feb1125d2a156afcedf9cef4a684165c2b25381e0994dcbc"} Jul 02 13:55:10.611714 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:10.611691 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-qwvns" event={"ID":"09c40729-64df-4680-bc9d-124264eb63d6","Type":"ContainerStarted","Data":"b868766dca215e62356db21544bc38de1dd1653360f83a29ba4dfda3ad3740fa"} Jul 02 13:55:13.629322 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:13.629276 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-j4hg9" event={"ID":"21ee67a6-5e92-48bc-ad16-1502a44fd4bf","Type":"ContainerStarted","Data":"986a36697686c1c63a95f84f7d6b1ab855ec7b15fc544b441c9c31b47b0f4f6d"} Jul 02 13:55:13.629761 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:13.629409 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-84b54b7f97-j4hg9" Jul 02 13:55:13.634433 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:13.634405 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-qwvns" event={"ID":"09c40729-64df-4680-bc9d-124264eb63d6","Type":"ContainerStarted","Data":"3ebe238aa8164393d3d4909b05d1661728bbe88733a4973231f2bfafbff268e2"} Jul 02 13:55:13.634819 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:13.634796 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-fd65d7d6-qwvns" Jul 02 13:55:13.649611 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:13.649564 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-84b54b7f97-j4hg9" podStartSLOduration=0.822895758 podStartE2EDuration="4.649550684s" totalImagesPullingTime="3.826654926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:55:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:55:13.647676203 +0000 UTC m=+621.927930731" watchObservedRunningTime="2026-07-02 13:55:13.649550684 +0000 UTC m=+621.929805212" Jul 02 13:55:13.666408 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:13.666369 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-fd65d7d6-qwvns" podStartSLOduration=1.397844434 podStartE2EDuration="4.666355703s" totalImagesPullingTime="3.268511269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:55:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:55:13.665028125 +0000 UTC m=+621.945282676" watchObservedRunningTime="2026-07-02 13:55:13.666355703 +0000 UTC m=+621.946610240" Jul 02 13:55:24.641432 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:24.641402 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-84b54b7f97-j4hg9" Jul 02 13:55:24.643307 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:55:24.643289 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-fd65d7d6-qwvns" Jul 02 13:56:45.436438 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:45.436330 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-6fk2t"] Jul 02 13:56:45.439900 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:45.439878 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-6fk2t" Jul 02 13:56:45.442864 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:45.442839 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\"" Jul 02 13:56:45.446047 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:45.446023 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-6fk2t"] Jul 02 13:56:45.590364 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:45.590327 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/98d58d64-1848-4bae-96a3-1858674911dd-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-6fk2t\" (UID: \"98d58d64-1848-4bae-96a3-1858674911dd\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-6fk2t" Jul 02 13:56:45.590565 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:45.590373 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skvmb\" (UniqueName: \"kubernetes.io/projected/98d58d64-1848-4bae-96a3-1858674911dd-kube-api-access-skvmb\") pod \"seaweedfs-tls-custom-6644bf5d6c-6fk2t\" (UID: \"98d58d64-1848-4bae-96a3-1858674911dd\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-6fk2t" Jul 02 13:56:45.691805 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:45.691717 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/98d58d64-1848-4bae-96a3-1858674911dd-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-6fk2t\" (UID: \"98d58d64-1848-4bae-96a3-1858674911dd\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-6fk2t" Jul 02 13:56:45.691805 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:45.691762 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skvmb\" (UniqueName: \"kubernetes.io/projected/98d58d64-1848-4bae-96a3-1858674911dd-kube-api-access-skvmb\") pod \"seaweedfs-tls-custom-6644bf5d6c-6fk2t\" (UID: \"98d58d64-1848-4bae-96a3-1858674911dd\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-6fk2t" Jul 02 13:56:45.692192 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:45.692165 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/98d58d64-1848-4bae-96a3-1858674911dd-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-6fk2t\" (UID: \"98d58d64-1848-4bae-96a3-1858674911dd\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-6fk2t" Jul 02 13:56:45.700832 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:45.700810 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skvmb\" (UniqueName: \"kubernetes.io/projected/98d58d64-1848-4bae-96a3-1858674911dd-kube-api-access-skvmb\") pod \"seaweedfs-tls-custom-6644bf5d6c-6fk2t\" (UID: \"98d58d64-1848-4bae-96a3-1858674911dd\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-6fk2t" Jul 02 13:56:45.749633 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:45.749589 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-6fk2t" Jul 02 13:56:45.878191 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:45.878157 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-6fk2t"] Jul 02 13:56:45.881494 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:56:45.881468 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98d58d64_1848_4bae_96a3_1858674911dd.slice/crio-218fc31912de41ed96d8c86240fe519e1bf0ea9b042435adb9d285a5dc1df812 WatchSource:0}: Error finding container 218fc31912de41ed96d8c86240fe519e1bf0ea9b042435adb9d285a5dc1df812: Status 404 returned error can't find the container with id 218fc31912de41ed96d8c86240fe519e1bf0ea9b042435adb9d285a5dc1df812 Jul 02 13:56:46.043920 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:46.043828 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-6fk2t" event={"ID":"98d58d64-1848-4bae-96a3-1858674911dd","Type":"ContainerStarted","Data":"218fc31912de41ed96d8c86240fe519e1bf0ea9b042435adb9d285a5dc1df812"} Jul 02 13:56:47.049849 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:47.049810 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-6fk2t" event={"ID":"98d58d64-1848-4bae-96a3-1858674911dd","Type":"ContainerStarted","Data":"2bab92a2640f4b9394065de8608603774c561831219e4bc3595746a83883c88b"} Jul 02 13:56:47.074429 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:47.074383 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-6fk2t" podStartSLOduration=1.792582801 podStartE2EDuration="2.074368662s" totalImagesPullingTime="281.785861ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:56:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:56:47.071844253 +0000 UTC m=+715.352098784" watchObservedRunningTime="2026-07-02 13:56:47.074368662 +0000 UTC m=+715.354623191" Jul 02 13:56:48.076837 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:48.076806 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-6fk2t"] Jul 02 13:56:49.062203 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:49.062161 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-6fk2t" podUID="98d58d64-1848-4bae-96a3-1858674911dd" containerName="seaweedfs-tls-custom" containerID="cri-o://2bab92a2640f4b9394065de8608603774c561831219e4bc3595746a83883c88b" gracePeriod=30 Jul 02 13:56:50.297266 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:50.297237 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-6fk2t" Jul 02 13:56:50.330982 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:50.330878 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/98d58d64-1848-4bae-96a3-1858674911dd-data\") pod \"98d58d64-1848-4bae-96a3-1858674911dd\" (UID: \"98d58d64-1848-4bae-96a3-1858674911dd\") " Jul 02 13:56:50.330982 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:50.330950 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-skvmb\" (UniqueName: \"kubernetes.io/projected/98d58d64-1848-4bae-96a3-1858674911dd-kube-api-access-skvmb\") pod \"98d58d64-1848-4bae-96a3-1858674911dd\" (UID: \"98d58d64-1848-4bae-96a3-1858674911dd\") " Jul 02 13:56:50.331799 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:50.331773 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98d58d64-1848-4bae-96a3-1858674911dd-data" (OuterVolumeSpecName: "data") pod "98d58d64-1848-4bae-96a3-1858674911dd" (UID: "98d58d64-1848-4bae-96a3-1858674911dd"). InnerVolumeSpecName "data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 13:56:50.333232 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:50.333202 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98d58d64-1848-4bae-96a3-1858674911dd-kube-api-access-skvmb" (OuterVolumeSpecName: "kube-api-access-skvmb") pod "98d58d64-1848-4bae-96a3-1858674911dd" (UID: "98d58d64-1848-4bae-96a3-1858674911dd"). InnerVolumeSpecName "kube-api-access-skvmb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:56:50.431665 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:50.431614 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skvmb\" (UniqueName: \"kubernetes.io/projected/98d58d64-1848-4bae-96a3-1858674911dd-kube-api-access-skvmb\") on node \"ip-10-0-136-90.ec2.internal\" DevicePath \"\"" Jul 02 13:56:50.431665 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:50.431659 2563 reconciler_common.go:299] "Volume detached for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/98d58d64-1848-4bae-96a3-1858674911dd-data\") on node \"ip-10-0-136-90.ec2.internal\" DevicePath \"\"" Jul 02 13:56:51.072918 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:51.072884 2563 generic.go:356] "Generic (PLEG): container finished" podID="98d58d64-1848-4bae-96a3-1858674911dd" containerID="2bab92a2640f4b9394065de8608603774c561831219e4bc3595746a83883c88b" exitCode=0 Jul 02 13:56:51.073142 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:51.072954 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-6fk2t" Jul 02 13:56:51.073142 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:51.072975 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-6fk2t" event={"ID":"98d58d64-1848-4bae-96a3-1858674911dd","Type":"ContainerDied","Data":"2bab92a2640f4b9394065de8608603774c561831219e4bc3595746a83883c88b"} Jul 02 13:56:51.073142 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:51.073025 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-6fk2t" event={"ID":"98d58d64-1848-4bae-96a3-1858674911dd","Type":"ContainerDied","Data":"218fc31912de41ed96d8c86240fe519e1bf0ea9b042435adb9d285a5dc1df812"} Jul 02 13:56:51.073142 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:51.073047 2563 scope.go:117] "RemoveContainer" containerID="2bab92a2640f4b9394065de8608603774c561831219e4bc3595746a83883c88b" Jul 02 13:56:51.083144 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:51.083128 2563 scope.go:117] "RemoveContainer" containerID="2bab92a2640f4b9394065de8608603774c561831219e4bc3595746a83883c88b" Jul 02 13:56:51.083379 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:56:51.083360 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bab92a2640f4b9394065de8608603774c561831219e4bc3595746a83883c88b\": container with ID starting with 2bab92a2640f4b9394065de8608603774c561831219e4bc3595746a83883c88b not found: ID does not exist" containerID="2bab92a2640f4b9394065de8608603774c561831219e4bc3595746a83883c88b" Jul 02 13:56:51.083427 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:51.083389 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bab92a2640f4b9394065de8608603774c561831219e4bc3595746a83883c88b"} err="failed to get container status \"2bab92a2640f4b9394065de8608603774c561831219e4bc3595746a83883c88b\": rpc error: code = NotFound desc = could not find container \"2bab92a2640f4b9394065de8608603774c561831219e4bc3595746a83883c88b\": container with ID starting with 2bab92a2640f4b9394065de8608603774c561831219e4bc3595746a83883c88b not found: ID does not exist" Jul 02 13:56:51.096570 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:51.096548 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-6fk2t"] Jul 02 13:56:51.100516 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:51.100494 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-6fk2t"] Jul 02 13:56:51.126476 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:51.126452 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-2q4tn"] Jul 02 13:56:51.126801 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:51.126790 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98d58d64-1848-4bae-96a3-1858674911dd" containerName="seaweedfs-tls-custom" Jul 02 13:56:51.126842 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:51.126803 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="98d58d64-1848-4bae-96a3-1858674911dd" containerName="seaweedfs-tls-custom" Jul 02 13:56:51.126875 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:51.126858 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="98d58d64-1848-4bae-96a3-1858674911dd" containerName="seaweedfs-tls-custom" Jul 02 13:56:51.134679 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:51.134653 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-8b44d767d-2q4tn" Jul 02 13:56:51.136634 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:51.136603 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/218f6251-5e81-4f26-9b0d-e2d0eb47dd0c-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-2q4tn\" (UID: \"218f6251-5e81-4f26-9b0d-e2d0eb47dd0c\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-2q4tn" Jul 02 13:56:51.136756 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:51.136655 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/218f6251-5e81-4f26-9b0d-e2d0eb47dd0c-data\") pod \"seaweedfs-tls-custom-8b44d767d-2q4tn\" (UID: \"218f6251-5e81-4f26-9b0d-e2d0eb47dd0c\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-2q4tn" Jul 02 13:56:51.136756 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:51.136680 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsmfb\" (UniqueName: \"kubernetes.io/projected/218f6251-5e81-4f26-9b0d-e2d0eb47dd0c-kube-api-access-jsmfb\") pod \"seaweedfs-tls-custom-8b44d767d-2q4tn\" (UID: \"218f6251-5e81-4f26-9b0d-e2d0eb47dd0c\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-2q4tn" Jul 02 13:56:51.138112 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:51.138088 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\"" Jul 02 13:56:51.138219 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:51.138135 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom\"" Jul 02 13:56:51.138999 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:51.138978 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-2q4tn"] Jul 02 13:56:51.237281 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:51.237248 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/218f6251-5e81-4f26-9b0d-e2d0eb47dd0c-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-2q4tn\" (UID: \"218f6251-5e81-4f26-9b0d-e2d0eb47dd0c\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-2q4tn" Jul 02 13:56:51.237281 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:51.237281 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/218f6251-5e81-4f26-9b0d-e2d0eb47dd0c-data\") pod \"seaweedfs-tls-custom-8b44d767d-2q4tn\" (UID: \"218f6251-5e81-4f26-9b0d-e2d0eb47dd0c\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-2q4tn" Jul 02 13:56:51.237528 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:51.237296 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsmfb\" (UniqueName: \"kubernetes.io/projected/218f6251-5e81-4f26-9b0d-e2d0eb47dd0c-kube-api-access-jsmfb\") pod \"seaweedfs-tls-custom-8b44d767d-2q4tn\" (UID: \"218f6251-5e81-4f26-9b0d-e2d0eb47dd0c\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-2q4tn" Jul 02 13:56:51.237676 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:51.237652 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/218f6251-5e81-4f26-9b0d-e2d0eb47dd0c-data\") pod \"seaweedfs-tls-custom-8b44d767d-2q4tn\" (UID: \"218f6251-5e81-4f26-9b0d-e2d0eb47dd0c\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-2q4tn" Jul 02 13:56:51.239735 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:51.239719 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/218f6251-5e81-4f26-9b0d-e2d0eb47dd0c-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-2q4tn\" (UID: \"218f6251-5e81-4f26-9b0d-e2d0eb47dd0c\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-2q4tn" Jul 02 13:56:51.247077 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:51.247055 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsmfb\" (UniqueName: \"kubernetes.io/projected/218f6251-5e81-4f26-9b0d-e2d0eb47dd0c-kube-api-access-jsmfb\") pod \"seaweedfs-tls-custom-8b44d767d-2q4tn\" (UID: \"218f6251-5e81-4f26-9b0d-e2d0eb47dd0c\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-2q4tn" Jul 02 13:56:51.445088 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:51.445058 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-8b44d767d-2q4tn" Jul 02 13:56:51.574613 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:51.574592 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-2q4tn"] Jul 02 13:56:51.576462 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:56:51.576436 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod218f6251_5e81_4f26_9b0d_e2d0eb47dd0c.slice/crio-edfbacd0cb24bb332f648e5e4fe7066c0c3035a4cba0de870150882a3521f550 WatchSource:0}: Error finding container edfbacd0cb24bb332f648e5e4fe7066c0c3035a4cba0de870150882a3521f550: Status 404 returned error can't find the container with id edfbacd0cb24bb332f648e5e4fe7066c0c3035a4cba0de870150882a3521f550 Jul 02 13:56:52.081319 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:52.081287 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-8b44d767d-2q4tn" event={"ID":"218f6251-5e81-4f26-9b0d-e2d0eb47dd0c","Type":"ContainerStarted","Data":"ff86546443e4e643f60cc536c6eeb5ffc6ac6246e978dc87c9e6f1635c41d8bb"} Jul 02 13:56:52.081480 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:52.081338 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-8b44d767d-2q4tn" event={"ID":"218f6251-5e81-4f26-9b0d-e2d0eb47dd0c","Type":"ContainerStarted","Data":"edfbacd0cb24bb332f648e5e4fe7066c0c3035a4cba0de870150882a3521f550"} Jul 02 13:56:52.102030 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:52.101973 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-custom-8b44d767d-2q4tn" podStartSLOduration=0.811851289 podStartE2EDuration="1.101923682s" totalImagesPullingTime="290.072393ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:56:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:56:52.099411027 +0000 UTC m=+720.379665560" watchObservedRunningTime="2026-07-02 13:56:52.101923682 +0000 UTC m=+720.382178227" Jul 02 13:56:52.140608 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:56:52.140533 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98d58d64-1848-4bae-96a3-1858674911dd" path="/var/lib/kubelet/pods/98d58d64-1848-4bae-96a3-1858674911dd/volumes" Jul 02 13:57:06.337665 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:57:06.337628 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-j5qzs"] Jul 02 13:57:06.341044 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:57:06.341024 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-serving-67b7477c6d-j5qzs" Jul 02 13:57:06.343879 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:57:06.343854 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving\"" Jul 02 13:57:06.343879 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:57:06.343875 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving-artifact\"" Jul 02 13:57:06.350810 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:57:06.350780 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-j5qzs"] Jul 02 13:57:06.457123 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:57:06.457084 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/ddd0583d-571d-4793-a4f7-e07051af378f-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-j5qzs\" (UID: \"ddd0583d-571d-4793-a4f7-e07051af378f\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-j5qzs" Jul 02 13:57:06.457123 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:57:06.457125 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tghpw\" (UniqueName: \"kubernetes.io/projected/ddd0583d-571d-4793-a4f7-e07051af378f-kube-api-access-tghpw\") pod \"seaweedfs-tls-serving-67b7477c6d-j5qzs\" (UID: \"ddd0583d-571d-4793-a4f7-e07051af378f\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-j5qzs" Jul 02 13:57:06.457353 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:57:06.457145 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ddd0583d-571d-4793-a4f7-e07051af378f-data\") pod \"seaweedfs-tls-serving-67b7477c6d-j5qzs\" (UID: \"ddd0583d-571d-4793-a4f7-e07051af378f\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-j5qzs" Jul 02 13:57:06.558084 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:57:06.558037 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/ddd0583d-571d-4793-a4f7-e07051af378f-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-j5qzs\" (UID: \"ddd0583d-571d-4793-a4f7-e07051af378f\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-j5qzs" Jul 02 13:57:06.558084 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:57:06.558083 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tghpw\" (UniqueName: \"kubernetes.io/projected/ddd0583d-571d-4793-a4f7-e07051af378f-kube-api-access-tghpw\") pod \"seaweedfs-tls-serving-67b7477c6d-j5qzs\" (UID: \"ddd0583d-571d-4793-a4f7-e07051af378f\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-j5qzs" Jul 02 13:57:06.558084 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:57:06.558102 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ddd0583d-571d-4793-a4f7-e07051af378f-data\") pod \"seaweedfs-tls-serving-67b7477c6d-j5qzs\" (UID: \"ddd0583d-571d-4793-a4f7-e07051af378f\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-j5qzs" Jul 02 13:57:06.558425 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:57:06.558407 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ddd0583d-571d-4793-a4f7-e07051af378f-data\") pod \"seaweedfs-tls-serving-67b7477c6d-j5qzs\" (UID: \"ddd0583d-571d-4793-a4f7-e07051af378f\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-j5qzs" Jul 02 13:57:06.560625 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:57:06.560607 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/ddd0583d-571d-4793-a4f7-e07051af378f-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-j5qzs\" (UID: \"ddd0583d-571d-4793-a4f7-e07051af378f\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-j5qzs" Jul 02 13:57:06.568425 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:57:06.568405 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tghpw\" (UniqueName: \"kubernetes.io/projected/ddd0583d-571d-4793-a4f7-e07051af378f-kube-api-access-tghpw\") pod \"seaweedfs-tls-serving-67b7477c6d-j5qzs\" (UID: \"ddd0583d-571d-4793-a4f7-e07051af378f\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-j5qzs" Jul 02 13:57:06.651571 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:57:06.651532 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-serving-67b7477c6d-j5qzs" Jul 02 13:57:06.789335 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:57:06.789309 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-j5qzs"] Jul 02 13:57:06.791723 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:57:06.791695 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddd0583d_571d_4793_a4f7_e07051af378f.slice/crio-3d11c7b94c4745f7a61f5015a93fe70f5c100e2e4ae8a4d0e927c39835a103c2 WatchSource:0}: Error finding container 3d11c7b94c4745f7a61f5015a93fe70f5c100e2e4ae8a4d0e927c39835a103c2: Status 404 returned error can't find the container with id 3d11c7b94c4745f7a61f5015a93fe70f5c100e2e4ae8a4d0e927c39835a103c2 Jul 02 13:57:07.155078 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:57:07.155039 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-serving-67b7477c6d-j5qzs" event={"ID":"ddd0583d-571d-4793-a4f7-e07051af378f","Type":"ContainerStarted","Data":"a9ba0858131f7fe525006efcf811e9f705f70c688a2191d26f22dd1a5a7b0745"} Jul 02 13:57:07.155078 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:57:07.155088 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-serving-67b7477c6d-j5qzs" event={"ID":"ddd0583d-571d-4793-a4f7-e07051af378f","Type":"ContainerStarted","Data":"3d11c7b94c4745f7a61f5015a93fe70f5c100e2e4ae8a4d0e927c39835a103c2"} Jul 02 13:57:07.172295 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:57:07.172235 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-serving-67b7477c6d-j5qzs" podStartSLOduration=0.912290486 podStartE2EDuration="1.1722128s" totalImagesPullingTime="259.922314ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:57:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:57:07.17215624 +0000 UTC m=+735.452410781" watchObservedRunningTime="2026-07-02 13:57:07.1722128 +0000 UTC m=+735.452467335" Jul 02 13:59:18.507410 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:18.507369 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74d48b9bfb-t89v9"] Jul 02 13:59:18.510335 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:18.510317 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74d48b9bfb-t89v9" Jul 02 13:59:18.523577 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:18.523551 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74d48b9bfb-t89v9"] Jul 02 13:59:18.631045 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:18.630965 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de14483d-7f66-4bc0-825b-39a0576ccc78-oauth-serving-cert\") pod \"console-74d48b9bfb-t89v9\" (UID: \"de14483d-7f66-4bc0-825b-39a0576ccc78\") " pod="openshift-console/console-74d48b9bfb-t89v9" Jul 02 13:59:18.631241 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:18.631074 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de14483d-7f66-4bc0-825b-39a0576ccc78-service-ca\") pod \"console-74d48b9bfb-t89v9\" (UID: \"de14483d-7f66-4bc0-825b-39a0576ccc78\") " pod="openshift-console/console-74d48b9bfb-t89v9" Jul 02 13:59:18.631241 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:18.631131 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de14483d-7f66-4bc0-825b-39a0576ccc78-console-serving-cert\") pod \"console-74d48b9bfb-t89v9\" (UID: \"de14483d-7f66-4bc0-825b-39a0576ccc78\") " pod="openshift-console/console-74d48b9bfb-t89v9" Jul 02 13:59:18.631241 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:18.631150 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de14483d-7f66-4bc0-825b-39a0576ccc78-console-config\") pod \"console-74d48b9bfb-t89v9\" (UID: \"de14483d-7f66-4bc0-825b-39a0576ccc78\") " pod="openshift-console/console-74d48b9bfb-t89v9" Jul 02 13:59:18.631241 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:18.631168 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fghn6\" (UniqueName: \"kubernetes.io/projected/de14483d-7f66-4bc0-825b-39a0576ccc78-kube-api-access-fghn6\") pod \"console-74d48b9bfb-t89v9\" (UID: \"de14483d-7f66-4bc0-825b-39a0576ccc78\") " pod="openshift-console/console-74d48b9bfb-t89v9" Jul 02 13:59:18.631241 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:18.631188 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de14483d-7f66-4bc0-825b-39a0576ccc78-trusted-ca-bundle\") pod \"console-74d48b9bfb-t89v9\" (UID: \"de14483d-7f66-4bc0-825b-39a0576ccc78\") " pod="openshift-console/console-74d48b9bfb-t89v9" Jul 02 13:59:18.631241 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:18.631210 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de14483d-7f66-4bc0-825b-39a0576ccc78-console-oauth-config\") pod \"console-74d48b9bfb-t89v9\" (UID: \"de14483d-7f66-4bc0-825b-39a0576ccc78\") " pod="openshift-console/console-74d48b9bfb-t89v9" Jul 02 13:59:18.732691 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:18.732643 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fghn6\" (UniqueName: \"kubernetes.io/projected/de14483d-7f66-4bc0-825b-39a0576ccc78-kube-api-access-fghn6\") pod \"console-74d48b9bfb-t89v9\" (UID: \"de14483d-7f66-4bc0-825b-39a0576ccc78\") " pod="openshift-console/console-74d48b9bfb-t89v9" Jul 02 13:59:18.732691 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:18.732693 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de14483d-7f66-4bc0-825b-39a0576ccc78-trusted-ca-bundle\") pod \"console-74d48b9bfb-t89v9\" (UID: \"de14483d-7f66-4bc0-825b-39a0576ccc78\") " pod="openshift-console/console-74d48b9bfb-t89v9" Jul 02 13:59:18.732978 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:18.732715 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de14483d-7f66-4bc0-825b-39a0576ccc78-console-oauth-config\") pod \"console-74d48b9bfb-t89v9\" (UID: \"de14483d-7f66-4bc0-825b-39a0576ccc78\") " pod="openshift-console/console-74d48b9bfb-t89v9" Jul 02 13:59:18.732978 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:18.732746 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de14483d-7f66-4bc0-825b-39a0576ccc78-oauth-serving-cert\") pod \"console-74d48b9bfb-t89v9\" (UID: \"de14483d-7f66-4bc0-825b-39a0576ccc78\") " pod="openshift-console/console-74d48b9bfb-t89v9" Jul 02 13:59:18.732978 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:18.732784 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de14483d-7f66-4bc0-825b-39a0576ccc78-service-ca\") pod \"console-74d48b9bfb-t89v9\" (UID: \"de14483d-7f66-4bc0-825b-39a0576ccc78\") " pod="openshift-console/console-74d48b9bfb-t89v9" Jul 02 13:59:18.732978 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:18.732963 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de14483d-7f66-4bc0-825b-39a0576ccc78-console-serving-cert\") pod \"console-74d48b9bfb-t89v9\" (UID: \"de14483d-7f66-4bc0-825b-39a0576ccc78\") " pod="openshift-console/console-74d48b9bfb-t89v9" Jul 02 13:59:18.733219 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:18.733001 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de14483d-7f66-4bc0-825b-39a0576ccc78-console-config\") pod \"console-74d48b9bfb-t89v9\" (UID: \"de14483d-7f66-4bc0-825b-39a0576ccc78\") " pod="openshift-console/console-74d48b9bfb-t89v9" Jul 02 13:59:18.733612 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:18.733590 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de14483d-7f66-4bc0-825b-39a0576ccc78-service-ca\") pod \"console-74d48b9bfb-t89v9\" (UID: \"de14483d-7f66-4bc0-825b-39a0576ccc78\") " pod="openshift-console/console-74d48b9bfb-t89v9" Jul 02 13:59:18.733712 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:18.733672 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de14483d-7f66-4bc0-825b-39a0576ccc78-oauth-serving-cert\") pod \"console-74d48b9bfb-t89v9\" (UID: \"de14483d-7f66-4bc0-825b-39a0576ccc78\") " pod="openshift-console/console-74d48b9bfb-t89v9" Jul 02 13:59:18.733712 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:18.733690 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de14483d-7f66-4bc0-825b-39a0576ccc78-console-config\") pod \"console-74d48b9bfb-t89v9\" (UID: \"de14483d-7f66-4bc0-825b-39a0576ccc78\") " pod="openshift-console/console-74d48b9bfb-t89v9" Jul 02 13:59:18.733908 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:18.733889 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de14483d-7f66-4bc0-825b-39a0576ccc78-trusted-ca-bundle\") pod \"console-74d48b9bfb-t89v9\" (UID: \"de14483d-7f66-4bc0-825b-39a0576ccc78\") " pod="openshift-console/console-74d48b9bfb-t89v9" Jul 02 13:59:18.735408 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:18.735383 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de14483d-7f66-4bc0-825b-39a0576ccc78-console-oauth-config\") pod \"console-74d48b9bfb-t89v9\" (UID: \"de14483d-7f66-4bc0-825b-39a0576ccc78\") " pod="openshift-console/console-74d48b9bfb-t89v9" Jul 02 13:59:18.735648 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:18.735626 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de14483d-7f66-4bc0-825b-39a0576ccc78-console-serving-cert\") pod \"console-74d48b9bfb-t89v9\" (UID: \"de14483d-7f66-4bc0-825b-39a0576ccc78\") " pod="openshift-console/console-74d48b9bfb-t89v9" Jul 02 13:59:18.750200 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:18.750169 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fghn6\" (UniqueName: \"kubernetes.io/projected/de14483d-7f66-4bc0-825b-39a0576ccc78-kube-api-access-fghn6\") pod \"console-74d48b9bfb-t89v9\" (UID: \"de14483d-7f66-4bc0-825b-39a0576ccc78\") " pod="openshift-console/console-74d48b9bfb-t89v9" Jul 02 13:59:18.819992 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:18.819874 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74d48b9bfb-t89v9" Jul 02 13:59:18.966667 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:18.966641 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74d48b9bfb-t89v9"] Jul 02 13:59:18.969022 ip-10-0-136-90 kubenswrapper[2563]: W0702 13:59:18.968994 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde14483d_7f66_4bc0_825b_39a0576ccc78.slice/crio-a94b28358194bbd40ecf821f7de3376b1728102dee3c40fec46c67f9f304fe11 WatchSource:0}: Error finding container a94b28358194bbd40ecf821f7de3376b1728102dee3c40fec46c67f9f304fe11: Status 404 returned error can't find the container with id a94b28358194bbd40ecf821f7de3376b1728102dee3c40fec46c67f9f304fe11 Jul 02 13:59:19.776956 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:19.776909 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74d48b9bfb-t89v9" event={"ID":"de14483d-7f66-4bc0-825b-39a0576ccc78","Type":"ContainerStarted","Data":"2d79f427a200aa828c5aba3f9da8b82646591a6ee67e1e14ff37489754fe3c38"} Jul 02 13:59:19.777415 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:19.776973 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74d48b9bfb-t89v9" event={"ID":"de14483d-7f66-4bc0-825b-39a0576ccc78","Type":"ContainerStarted","Data":"a94b28358194bbd40ecf821f7de3376b1728102dee3c40fec46c67f9f304fe11"} Jul 02 13:59:19.814647 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:19.814596 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74d48b9bfb-t89v9" podStartSLOduration=1.814579771 podStartE2EDuration="1.814579771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:59:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:59:19.813069393 +0000 UTC m=+868.093323941" watchObservedRunningTime="2026-07-02 13:59:19.814579771 +0000 UTC m=+868.094834296" Jul 02 13:59:28.820758 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:28.820709 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74d48b9bfb-t89v9" Jul 02 13:59:28.821241 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:28.820785 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74d48b9bfb-t89v9" Jul 02 13:59:28.825951 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:28.825904 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74d48b9bfb-t89v9" Jul 02 13:59:29.825854 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:29.825825 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74d48b9bfb-t89v9" Jul 02 13:59:29.870333 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:29.870301 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f978888dd-mhlpf"] Jul 02 13:59:52.146369 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:52.146292 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwl25_5e965a2b-30ed-4337-aaa5-c3dd9744cafc/ovn-acl-logging/0.log" Jul 02 13:59:52.146369 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:52.146296 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwl25_5e965a2b-30ed-4337-aaa5-c3dd9744cafc/ovn-acl-logging/0.log" Jul 02 13:59:54.891273 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:54.891210 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6f978888dd-mhlpf" podUID="4872f90e-4f4a-4625-8bcb-68abb14ca9a3" containerName="console" containerID="cri-o://b8173172cb5e1d86fa831cece457248c5c79efd5c8a18abaa28f8ee7d6099ace" gracePeriod=15 Jul 02 13:59:55.139194 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:55.139168 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f978888dd-mhlpf" Jul 02 13:59:55.243111 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:55.243014 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-console-config\") pod \"4872f90e-4f4a-4625-8bcb-68abb14ca9a3\" (UID: \"4872f90e-4f4a-4625-8bcb-68abb14ca9a3\") " Jul 02 13:59:55.243111 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:55.243067 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-service-ca\") pod \"4872f90e-4f4a-4625-8bcb-68abb14ca9a3\" (UID: \"4872f90e-4f4a-4625-8bcb-68abb14ca9a3\") " Jul 02 13:59:55.243111 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:55.243101 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-oauth-serving-cert\") pod \"4872f90e-4f4a-4625-8bcb-68abb14ca9a3\" (UID: \"4872f90e-4f4a-4625-8bcb-68abb14ca9a3\") " Jul 02 13:59:55.243370 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:55.243133 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-trusted-ca-bundle\") pod \"4872f90e-4f4a-4625-8bcb-68abb14ca9a3\" (UID: \"4872f90e-4f4a-4625-8bcb-68abb14ca9a3\") " Jul 02 13:59:55.243370 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:55.243165 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-console-serving-cert\") pod \"4872f90e-4f4a-4625-8bcb-68abb14ca9a3\" (UID: \"4872f90e-4f4a-4625-8bcb-68abb14ca9a3\") " Jul 02 13:59:55.243370 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:55.243199 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdsr4\" (UniqueName: \"kubernetes.io/projected/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-kube-api-access-zdsr4\") pod \"4872f90e-4f4a-4625-8bcb-68abb14ca9a3\" (UID: \"4872f90e-4f4a-4625-8bcb-68abb14ca9a3\") " Jul 02 13:59:55.243370 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:55.243239 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-console-oauth-config\") pod \"4872f90e-4f4a-4625-8bcb-68abb14ca9a3\" (UID: \"4872f90e-4f4a-4625-8bcb-68abb14ca9a3\") " Jul 02 13:59:55.243562 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:55.243497 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-service-ca" (OuterVolumeSpecName: "service-ca") pod "4872f90e-4f4a-4625-8bcb-68abb14ca9a3" (UID: "4872f90e-4f4a-4625-8bcb-68abb14ca9a3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:59:55.243562 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:55.243506 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-console-config" (OuterVolumeSpecName: "console-config") pod "4872f90e-4f4a-4625-8bcb-68abb14ca9a3" (UID: "4872f90e-4f4a-4625-8bcb-68abb14ca9a3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:59:55.243562 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:55.243518 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4872f90e-4f4a-4625-8bcb-68abb14ca9a3" (UID: "4872f90e-4f4a-4625-8bcb-68abb14ca9a3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:59:55.243728 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:55.243707 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-oauth-serving-cert\") on node \"ip-10-0-136-90.ec2.internal\" DevicePath \"\"" Jul 02 13:59:55.243840 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:55.243726 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-console-config\") on node \"ip-10-0-136-90.ec2.internal\" DevicePath \"\"" Jul 02 13:59:55.243840 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:55.243740 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-service-ca\") on node \"ip-10-0-136-90.ec2.internal\" DevicePath \"\"" Jul 02 13:59:55.243840 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:55.243740 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4872f90e-4f4a-4625-8bcb-68abb14ca9a3" (UID: "4872f90e-4f4a-4625-8bcb-68abb14ca9a3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:59:55.245598 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:55.245572 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4872f90e-4f4a-4625-8bcb-68abb14ca9a3" (UID: "4872f90e-4f4a-4625-8bcb-68abb14ca9a3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:59:55.245702 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:55.245651 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-kube-api-access-zdsr4" (OuterVolumeSpecName: "kube-api-access-zdsr4") pod "4872f90e-4f4a-4625-8bcb-68abb14ca9a3" (UID: "4872f90e-4f4a-4625-8bcb-68abb14ca9a3"). InnerVolumeSpecName "kube-api-access-zdsr4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:59:55.245702 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:55.245676 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4872f90e-4f4a-4625-8bcb-68abb14ca9a3" (UID: "4872f90e-4f4a-4625-8bcb-68abb14ca9a3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:59:55.345145 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:55.345096 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-trusted-ca-bundle\") on node \"ip-10-0-136-90.ec2.internal\" DevicePath \"\"" Jul 02 13:59:55.345145 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:55.345138 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-console-serving-cert\") on node \"ip-10-0-136-90.ec2.internal\" DevicePath \"\"" Jul 02 13:59:55.345379 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:55.345149 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdsr4\" (UniqueName: \"kubernetes.io/projected/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-kube-api-access-zdsr4\") on node \"ip-10-0-136-90.ec2.internal\" DevicePath \"\"" Jul 02 13:59:55.345379 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:55.345208 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4872f90e-4f4a-4625-8bcb-68abb14ca9a3-console-oauth-config\") on node \"ip-10-0-136-90.ec2.internal\" DevicePath \"\"" Jul 02 13:59:55.945093 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:55.945058 2563 generic.go:356] "Generic (PLEG): container finished" podID="4872f90e-4f4a-4625-8bcb-68abb14ca9a3" containerID="b8173172cb5e1d86fa831cece457248c5c79efd5c8a18abaa28f8ee7d6099ace" exitCode=0 Jul 02 13:59:55.945529 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:55.945105 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f978888dd-mhlpf" Jul 02 13:59:55.945529 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:55.945106 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f978888dd-mhlpf" event={"ID":"4872f90e-4f4a-4625-8bcb-68abb14ca9a3","Type":"ContainerDied","Data":"b8173172cb5e1d86fa831cece457248c5c79efd5c8a18abaa28f8ee7d6099ace"} Jul 02 13:59:55.945529 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:55.945230 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f978888dd-mhlpf" event={"ID":"4872f90e-4f4a-4625-8bcb-68abb14ca9a3","Type":"ContainerDied","Data":"5510a9935b383f7fac884d81dbcac3d61398c3b07a8369386f1ff4c23011d7c4"} Jul 02 13:59:55.945529 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:55.945258 2563 scope.go:117] "RemoveContainer" containerID="b8173172cb5e1d86fa831cece457248c5c79efd5c8a18abaa28f8ee7d6099ace" Jul 02 13:59:55.955028 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:55.955009 2563 scope.go:117] "RemoveContainer" containerID="b8173172cb5e1d86fa831cece457248c5c79efd5c8a18abaa28f8ee7d6099ace" Jul 02 13:59:55.955324 ip-10-0-136-90 kubenswrapper[2563]: E0702 13:59:55.955304 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8173172cb5e1d86fa831cece457248c5c79efd5c8a18abaa28f8ee7d6099ace\": container with ID starting with b8173172cb5e1d86fa831cece457248c5c79efd5c8a18abaa28f8ee7d6099ace not found: ID does not exist" containerID="b8173172cb5e1d86fa831cece457248c5c79efd5c8a18abaa28f8ee7d6099ace" Jul 02 13:59:55.955388 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:55.955337 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8173172cb5e1d86fa831cece457248c5c79efd5c8a18abaa28f8ee7d6099ace"} err="failed to get container status \"b8173172cb5e1d86fa831cece457248c5c79efd5c8a18abaa28f8ee7d6099ace\": rpc error: code = NotFound desc = could not find container \"b8173172cb5e1d86fa831cece457248c5c79efd5c8a18abaa28f8ee7d6099ace\": container with ID starting with b8173172cb5e1d86fa831cece457248c5c79efd5c8a18abaa28f8ee7d6099ace not found: ID does not exist" Jul 02 13:59:55.968479 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:55.968445 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f978888dd-mhlpf"] Jul 02 13:59:55.972766 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:55.972744 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f978888dd-mhlpf"] Jul 02 13:59:56.138299 ip-10-0-136-90 kubenswrapper[2563]: I0702 13:59:56.138264 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4872f90e-4f4a-4625-8bcb-68abb14ca9a3" path="/var/lib/kubelet/pods/4872f90e-4f4a-4625-8bcb-68abb14ca9a3/volumes" Jul 02 14:04:52.177687 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:04:52.177657 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwl25_5e965a2b-30ed-4337-aaa5-c3dd9744cafc/ovn-acl-logging/0.log" Jul 02 14:04:52.179672 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:04:52.179654 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwl25_5e965a2b-30ed-4337-aaa5-c3dd9744cafc/ovn-acl-logging/0.log" Jul 02 14:09:52.205400 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:09:52.205367 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwl25_5e965a2b-30ed-4337-aaa5-c3dd9744cafc/ovn-acl-logging/0.log" Jul 02 14:09:52.208887 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:09:52.208866 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwl25_5e965a2b-30ed-4337-aaa5-c3dd9744cafc/ovn-acl-logging/0.log" Jul 02 14:13:07.087581 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:07.087550 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pvpks_6b2943b8-7b87-46b4-8141-cfe5464bc8ad/global-pull-secret-syncer/0.log" Jul 02 14:13:07.098016 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:07.097997 2563 ???:1] "http: TLS handshake error from 10.0.137.226:47696: EOF" Jul 02 14:13:07.259767 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:07.259733 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-msksl_ec310ba1-2060-44e4-afc5-0d8689c0879d/konnectivity-agent/0.log" Jul 02 14:13:07.321857 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:07.321829 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-90.ec2.internal_beb4cae7aa98a7b51e62919b1f06ca53/haproxy/0.log" Jul 02 14:13:11.447610 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:11.447581 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1997733f-7b3c-4e2c-b03b-651bcdecbd88/alertmanager/0.log" Jul 02 14:13:11.476381 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:11.476355 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1997733f-7b3c-4e2c-b03b-651bcdecbd88/config-reloader/0.log" Jul 02 14:13:11.501964 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:11.501923 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1997733f-7b3c-4e2c-b03b-651bcdecbd88/kube-rbac-proxy-web/0.log" Jul 02 14:13:11.527816 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:11.527780 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1997733f-7b3c-4e2c-b03b-651bcdecbd88/kube-rbac-proxy/0.log" Jul 02 14:13:11.552112 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:11.552084 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1997733f-7b3c-4e2c-b03b-651bcdecbd88/kube-rbac-proxy-metric/0.log" Jul 02 14:13:11.575440 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:11.575413 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1997733f-7b3c-4e2c-b03b-651bcdecbd88/prom-label-proxy/0.log" Jul 02 14:13:11.606412 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:11.606384 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1997733f-7b3c-4e2c-b03b-651bcdecbd88/init-config-reloader/0.log" Jul 02 14:13:11.821334 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:11.821243 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-cd8656b8-zqjj8_57320423-1f32-4113-972c-1511902243a8/monitoring-plugin/0.log" Jul 02 14:13:11.855007 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:11.854972 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gtlvt_3a5dfa19-40b6-42b3-9723-830f449d7aa4/node-exporter/0.log" Jul 02 14:13:11.877128 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:11.877104 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gtlvt_3a5dfa19-40b6-42b3-9723-830f449d7aa4/kube-rbac-proxy/0.log" Jul 02 14:13:11.906021 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:11.905996 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gtlvt_3a5dfa19-40b6-42b3-9723-830f449d7aa4/init-textfile/0.log" Jul 02 14:13:12.505657 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:12.505584 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7ddc8784d4-cg6rh_4f37713f-5148-4f50-a054-532a34660de9/prometheus-operator-admission-webhook/0.log" Jul 02 14:13:12.545290 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:12.545266 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-775d8ff859-mrjvq_cca9a0ed-994e-404c-82da-296705acc98e/telemeter-client/0.log" Jul 02 14:13:12.573024 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:12.572988 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-775d8ff859-mrjvq_cca9a0ed-994e-404c-82da-296705acc98e/reload/0.log" Jul 02 14:13:12.603805 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:12.603777 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-775d8ff859-mrjvq_cca9a0ed-994e-404c-82da-296705acc98e/kube-rbac-proxy/0.log" Jul 02 14:13:12.634792 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:12.634749 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f4dfb4495-wxnwj_13a96d5b-9754-47a9-8d66-5bb826b3be73/thanos-query/0.log" Jul 02 14:13:12.665050 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:12.665025 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f4dfb4495-wxnwj_13a96d5b-9754-47a9-8d66-5bb826b3be73/kube-rbac-proxy-web/0.log" Jul 02 14:13:12.697821 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:12.697796 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f4dfb4495-wxnwj_13a96d5b-9754-47a9-8d66-5bb826b3be73/kube-rbac-proxy/0.log" Jul 02 14:13:12.736463 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:12.736438 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f4dfb4495-wxnwj_13a96d5b-9754-47a9-8d66-5bb826b3be73/prom-label-proxy/0.log" Jul 02 14:13:12.777194 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:12.777121 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f4dfb4495-wxnwj_13a96d5b-9754-47a9-8d66-5bb826b3be73/kube-rbac-proxy-rules/0.log" Jul 02 14:13:12.808464 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:12.808440 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f4dfb4495-wxnwj_13a96d5b-9754-47a9-8d66-5bb826b3be73/kube-rbac-proxy-metrics/0.log" Jul 02 14:13:14.018658 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:14.018626 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cdb5968b9-nzf6t_d7ef52a0-3953-48ec-a8ae-25617d72c722/networking-console-plugin/0.log" Jul 02 14:13:14.953901 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:14.953866 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-74d48b9bfb-t89v9_de14483d-7f66-4bc0-825b-39a0576ccc78/console/0.log" Jul 02 14:13:15.697078 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:15.697039 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hs76s/perf-node-gather-daemonset-mm87d"] Jul 02 14:13:15.697656 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:15.697635 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4872f90e-4f4a-4625-8bcb-68abb14ca9a3" containerName="console" Jul 02 14:13:15.697752 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:15.697660 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4872f90e-4f4a-4625-8bcb-68abb14ca9a3" containerName="console" Jul 02 14:13:15.697803 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:15.697767 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4872f90e-4f4a-4625-8bcb-68abb14ca9a3" containerName="console" Jul 02 14:13:15.700165 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:15.700144 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-mm87d" Jul 02 14:13:15.705277 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:15.705258 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hs76s\"/\"kube-root-ca.crt\"" Jul 02 14:13:15.705369 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:15.705262 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hs76s\"/\"default-dockercfg-2gmp6\"" Jul 02 14:13:15.705600 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:15.705560 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hs76s\"/\"openshift-service-ca.crt\"" Jul 02 14:13:15.711170 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:15.711149 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hs76s/perf-node-gather-daemonset-mm87d"] Jul 02 14:13:15.803458 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:15.803427 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/00315579-3eb1-448c-bd36-b44860dd61c4-proc\") pod \"perf-node-gather-daemonset-mm87d\" (UID: \"00315579-3eb1-448c-bd36-b44860dd61c4\") " pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-mm87d" Jul 02 14:13:15.803621 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:15.803474 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/00315579-3eb1-448c-bd36-b44860dd61c4-podres\") pod \"perf-node-gather-daemonset-mm87d\" (UID: \"00315579-3eb1-448c-bd36-b44860dd61c4\") " pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-mm87d" Jul 02 14:13:15.803621 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:15.803553 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00315579-3eb1-448c-bd36-b44860dd61c4-sys\") pod \"perf-node-gather-daemonset-mm87d\" (UID: \"00315579-3eb1-448c-bd36-b44860dd61c4\") " pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-mm87d" Jul 02 14:13:15.803621 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:15.803607 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/00315579-3eb1-448c-bd36-b44860dd61c4-lib-modules\") pod \"perf-node-gather-daemonset-mm87d\" (UID: \"00315579-3eb1-448c-bd36-b44860dd61c4\") " pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-mm87d" Jul 02 14:13:15.803724 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:15.803653 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xjq7\" (UniqueName: \"kubernetes.io/projected/00315579-3eb1-448c-bd36-b44860dd61c4-kube-api-access-4xjq7\") pod \"perf-node-gather-daemonset-mm87d\" (UID: \"00315579-3eb1-448c-bd36-b44860dd61c4\") " pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-mm87d" Jul 02 14:13:15.904901 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:15.904861 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/00315579-3eb1-448c-bd36-b44860dd61c4-proc\") pod \"perf-node-gather-daemonset-mm87d\" (UID: \"00315579-3eb1-448c-bd36-b44860dd61c4\") " pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-mm87d" Jul 02 14:13:15.905105 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:15.904952 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/00315579-3eb1-448c-bd36-b44860dd61c4-podres\") pod \"perf-node-gather-daemonset-mm87d\" (UID: \"00315579-3eb1-448c-bd36-b44860dd61c4\") " pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-mm87d" Jul 02 14:13:15.905105 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:15.905008 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/00315579-3eb1-448c-bd36-b44860dd61c4-proc\") pod \"perf-node-gather-daemonset-mm87d\" (UID: \"00315579-3eb1-448c-bd36-b44860dd61c4\") " pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-mm87d" Jul 02 14:13:15.905105 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:15.905008 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00315579-3eb1-448c-bd36-b44860dd61c4-sys\") pod \"perf-node-gather-daemonset-mm87d\" (UID: \"00315579-3eb1-448c-bd36-b44860dd61c4\") " pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-mm87d" Jul 02 14:13:15.905105 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:15.905067 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/00315579-3eb1-448c-bd36-b44860dd61c4-lib-modules\") pod \"perf-node-gather-daemonset-mm87d\" (UID: \"00315579-3eb1-448c-bd36-b44860dd61c4\") " pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-mm87d" Jul 02 14:13:15.905105 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:15.905098 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xjq7\" (UniqueName: \"kubernetes.io/projected/00315579-3eb1-448c-bd36-b44860dd61c4-kube-api-access-4xjq7\") pod \"perf-node-gather-daemonset-mm87d\" (UID: \"00315579-3eb1-448c-bd36-b44860dd61c4\") " pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-mm87d" Jul 02 14:13:15.905317 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:15.905126 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/00315579-3eb1-448c-bd36-b44860dd61c4-podres\") pod \"perf-node-gather-daemonset-mm87d\" (UID: \"00315579-3eb1-448c-bd36-b44860dd61c4\") " pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-mm87d" Jul 02 14:13:15.905317 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:15.905068 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00315579-3eb1-448c-bd36-b44860dd61c4-sys\") pod \"perf-node-gather-daemonset-mm87d\" (UID: \"00315579-3eb1-448c-bd36-b44860dd61c4\") " pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-mm87d" Jul 02 14:13:15.905317 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:15.905179 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/00315579-3eb1-448c-bd36-b44860dd61c4-lib-modules\") pod \"perf-node-gather-daemonset-mm87d\" (UID: \"00315579-3eb1-448c-bd36-b44860dd61c4\") " pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-mm87d" Jul 02 14:13:15.917305 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:15.917279 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xjq7\" (UniqueName: \"kubernetes.io/projected/00315579-3eb1-448c-bd36-b44860dd61c4-kube-api-access-4xjq7\") pod \"perf-node-gather-daemonset-mm87d\" (UID: \"00315579-3eb1-448c-bd36-b44860dd61c4\") " pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-mm87d" Jul 02 14:13:16.010653 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:16.010578 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-mm87d" Jul 02 14:13:16.147250 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:16.147228 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hs76s/perf-node-gather-daemonset-mm87d"] Jul 02 14:13:16.149220 ip-10-0-136-90 kubenswrapper[2563]: W0702 14:13:16.149196 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod00315579_3eb1_448c_bd36_b44860dd61c4.slice/crio-892ce0c0ae6ad222c751797da121045ea4b9c76a86e34e5fb3660d5f7780d020 WatchSource:0}: Error finding container 892ce0c0ae6ad222c751797da121045ea4b9c76a86e34e5fb3660d5f7780d020: Status 404 returned error can't find the container with id 892ce0c0ae6ad222c751797da121045ea4b9c76a86e34e5fb3660d5f7780d020 Jul 02 14:13:16.661571 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:16.661527 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dmq79_888590ed-3122-4425-816a-1292d70e3086/dns/0.log" Jul 02 14:13:16.665138 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:16.665109 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-mm87d" event={"ID":"00315579-3eb1-448c-bd36-b44860dd61c4","Type":"ContainerStarted","Data":"6e9459c1cd17927b0ffa5ea881149def02577776c037082f9a4addb29785e42b"} Jul 02 14:13:16.665263 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:16.665184 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-mm87d" event={"ID":"00315579-3eb1-448c-bd36-b44860dd61c4","Type":"ContainerStarted","Data":"892ce0c0ae6ad222c751797da121045ea4b9c76a86e34e5fb3660d5f7780d020"} Jul 02 14:13:16.665314 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:16.665277 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-mm87d" Jul 02 14:13:16.691225 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:16.691200 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dmq79_888590ed-3122-4425-816a-1292d70e3086/kube-rbac-proxy/0.log" Jul 02 14:13:16.719038 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:16.719011 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ct2sf_edf38c8b-844c-4ac9-983b-e9395bb86adc/dns-node-resolver/0.log" Jul 02 14:13:17.464518 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:17.464489 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w222x_76001f3c-96f1-4e94-a8cd-0b7d575b2c4a/node-ca/0.log" Jul 02 14:13:18.697399 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:18.697365 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m7v6r_69f44293-335f-4e2b-a89a-043917f44a10/serve-healthcheck-canary/0.log" Jul 02 14:13:19.136383 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:19.136313 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9brbm_12dc36c3-9cca-4bdb-a9c5-1406643510b5/kube-rbac-proxy/0.log" Jul 02 14:13:19.159372 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:19.159341 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9brbm_12dc36c3-9cca-4bdb-a9c5-1406643510b5/exporter/0.log" Jul 02 14:13:19.183986 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:19.183957 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9brbm_12dc36c3-9cca-4bdb-a9c5-1406643510b5/extractor/0.log" Jul 02 14:13:21.585203 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:21.585174 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-fd65d7d6-qwvns_09c40729-64df-4680-bc9d-124264eb63d6/server/0.log" Jul 02 14:13:21.684869 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:21.684835 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-84b54b7f97-j4hg9_21ee67a6-5e92-48bc-ad16-1502a44fd4bf/manager/0.log" Jul 02 14:13:21.899818 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:21.899792 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-x7bx4_4c6411b4-56ea-4986-971d-9768db74406a/seaweedfs/0.log" Jul 02 14:13:21.933166 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:21.933141 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-tls-custom-8b44d767d-2q4tn_218f6251-5e81-4f26-9b0d-e2d0eb47dd0c/seaweedfs-tls-custom/0.log" Jul 02 14:13:21.958772 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:21.958744 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-tls-serving-67b7477c6d-j5qzs_ddd0583d-571d-4793-a4f7-e07051af378f/seaweedfs-tls-serving/0.log" Jul 02 14:13:22.680309 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:22.680280 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-mm87d" Jul 02 14:13:22.701874 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:22.701821 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-mm87d" podStartSLOduration=7.701808565 podStartE2EDuration="7.701808565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:13:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:13:16.687580246 +0000 UTC m=+1704.967834776" watchObservedRunningTime="2026-07-02 14:13:22.701808565 +0000 UTC m=+1710.982063106" Jul 02 14:13:26.784996 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:26.784964 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-6q84g_8216e3d5-395e-435f-92e3-e3a872349527/kube-storage-version-migrator-operator/1.log" Jul 02 14:13:26.786593 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:26.786561 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-6q84g_8216e3d5-395e-435f-92e3-e3a872349527/kube-storage-version-migrator-operator/0.log" Jul 02 14:13:28.270763 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:28.270733 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z97rv_3bea862f-27c7-4c10-aa1f-6324199447b4/kube-multus-additional-cni-plugins/0.log" Jul 02 14:13:28.302194 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:28.302166 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z97rv_3bea862f-27c7-4c10-aa1f-6324199447b4/egress-router-binary-copy/0.log" Jul 02 14:13:28.331190 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:28.331167 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z97rv_3bea862f-27c7-4c10-aa1f-6324199447b4/cni-plugins/0.log" Jul 02 14:13:28.359384 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:28.359356 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z97rv_3bea862f-27c7-4c10-aa1f-6324199447b4/bond-cni-plugin/0.log" Jul 02 14:13:28.383988 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:28.383962 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z97rv_3bea862f-27c7-4c10-aa1f-6324199447b4/routeoverride-cni/0.log" Jul 02 14:13:28.409242 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:28.409212 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z97rv_3bea862f-27c7-4c10-aa1f-6324199447b4/whereabouts-cni-bincopy/0.log" Jul 02 14:13:28.437457 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:28.437428 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z97rv_3bea862f-27c7-4c10-aa1f-6324199447b4/whereabouts-cni/0.log" Jul 02 14:13:28.478112 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:28.478073 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-cww8g_225d1975-2316-4234-aca6-24f98acf4484/kube-multus/0.log" Jul 02 14:13:28.533855 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:28.533747 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5wdg2_74ca80fe-9892-41a5-9066-89f77be19c4c/network-metrics-daemon/0.log" Jul 02 14:13:28.560065 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:28.560027 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5wdg2_74ca80fe-9892-41a5-9066-89f77be19c4c/kube-rbac-proxy/0.log" Jul 02 14:13:29.777855 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:29.777826 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwl25_5e965a2b-30ed-4337-aaa5-c3dd9744cafc/ovn-controller/0.log" Jul 02 14:13:29.797261 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:29.797236 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwl25_5e965a2b-30ed-4337-aaa5-c3dd9744cafc/ovn-acl-logging/0.log" Jul 02 14:13:29.797427 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:29.797321 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwl25_5e965a2b-30ed-4337-aaa5-c3dd9744cafc/ovn-acl-logging/1.log" Jul 02 14:13:29.821283 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:29.821257 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwl25_5e965a2b-30ed-4337-aaa5-c3dd9744cafc/kube-rbac-proxy-node/0.log" Jul 02 14:13:29.844038 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:29.844016 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwl25_5e965a2b-30ed-4337-aaa5-c3dd9744cafc/kube-rbac-proxy-ovn-metrics/0.log" Jul 02 14:13:29.865613 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:29.865577 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwl25_5e965a2b-30ed-4337-aaa5-c3dd9744cafc/northd/0.log" Jul 02 14:13:29.890479 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:29.890458 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwl25_5e965a2b-30ed-4337-aaa5-c3dd9744cafc/nbdb/0.log" Jul 02 14:13:29.915009 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:29.914983 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwl25_5e965a2b-30ed-4337-aaa5-c3dd9744cafc/sbdb/0.log" Jul 02 14:13:29.980975 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:29.980946 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwl25_5e965a2b-30ed-4337-aaa5-c3dd9744cafc/ovnkube-controller/0.log" Jul 02 14:13:31.292224 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:31.292193 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-56499946bc-6ddkj_212bc0a0-107e-4f1e-80d9-2ee22c8dc9ad/check-endpoints/0.log" Jul 02 14:13:31.390892 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:31.390857 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-cmpgv_43b79ed9-acd0-4973-828a-6b97b5ea8e0e/network-check-target-container/0.log" Jul 02 14:13:32.489057 ip-10-0-136-90 kubenswrapper[2563]: I0702 14:13:32.489033 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-q47w9_531d4bde-e94d-4141-99d9-661b3b40d081/iptables-alerter/0.log"