Jul 21 19:35:14.565791 ip-10-0-137-5 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 21 19:35:14.565804 ip-10-0-137-5 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 21 19:35:14.565813 ip-10-0-137-5 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 21 19:35:14.566141 ip-10-0-137-5 systemd[1]: Failed to start Kubernetes Kubelet. Jul 21 19:35:24.687597 ip-10-0-137-5 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 21 19:35:24.687615 ip-10-0-137-5 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 61974c2da0e04daa88089fca8e58e784 -- Jul 21 19:37:13.306294 ip-10-0-137-5 systemd[1]: Starting Kubernetes Kubelet... Jul 21 19:37:13.660597 ip-10-0-137-5 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 19:37:13.660597 ip-10-0-137-5 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 21 19:37:13.660597 ip-10-0-137-5 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 19:37:13.660597 ip-10-0-137-5 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 21 19:37:13.660597 ip-10-0-137-5 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 19:37:13.661358 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.661283 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 21 19:37:13.665902 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.665888 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 19:37:13.665902 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.665902 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 19:37:13.665963 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.665907 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 21 19:37:13.665963 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.665910 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 19:37:13.665963 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.665913 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 19:37:13.665963 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.665917 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 19:37:13.665963 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.665920 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 19:37:13.665963 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.665922 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 19:37:13.665963 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.665925 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 19:37:13.665963 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.665931 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 19:37:13.665963 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.665935 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 19:37:13.665963 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.665938 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 19:37:13.665963 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.665941 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 19:37:13.665963 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.665945 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 19:37:13.665963 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.665947 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 19:37:13.665963 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.665950 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 19:37:13.665963 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.665953 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 19:37:13.665963 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.665955 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 19:37:13.665963 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.665958 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 19:37:13.665963 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.665961 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 19:37:13.665963 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.665963 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 19:37:13.666409 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.665966 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 19:37:13.666409 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.665969 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 19:37:13.666409 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.665972 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 19:37:13.666409 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.665982 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 19:37:13.666409 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.665985 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 19:37:13.666409 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.665988 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 19:37:13.666409 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.665990 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 19:37:13.666409 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.665993 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 19:37:13.666409 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.665995 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 19:37:13.666409 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.665998 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 19:37:13.666409 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666001 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 19:37:13.666409 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666004 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 19:37:13.666409 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666006 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 19:37:13.666409 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666009 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 19:37:13.666409 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666011 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 19:37:13.666409 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666014 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 19:37:13.666409 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666017 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 19:37:13.666409 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666032 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 19:37:13.666409 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666035 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 19:37:13.666409 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666037 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 19:37:13.666869 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666040 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 19:37:13.666869 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666044 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 19:37:13.666869 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666046 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 19:37:13.666869 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666049 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 19:37:13.666869 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666051 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 19:37:13.666869 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666055 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 19:37:13.666869 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666060 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 19:37:13.666869 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666063 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 19:37:13.666869 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666065 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 19:37:13.666869 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666068 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 19:37:13.666869 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666070 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 19:37:13.666869 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666073 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 19:37:13.666869 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666076 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 19:37:13.666869 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666080 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 19:37:13.666869 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666083 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 19:37:13.666869 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666085 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 19:37:13.666869 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666088 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 19:37:13.666869 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666091 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 19:37:13.666869 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666093 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 19:37:13.666869 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666097 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 19:37:13.667352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666099 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 19:37:13.667352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666102 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 19:37:13.667352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666105 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 19:37:13.667352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666107 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 19:37:13.667352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666110 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 19:37:13.667352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666113 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 19:37:13.667352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666115 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 19:37:13.667352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666118 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 19:37:13.667352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666120 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 19:37:13.667352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666123 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 19:37:13.667352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666126 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 19:37:13.667352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666128 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 19:37:13.667352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666132 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 19:37:13.667352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666135 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 19:37:13.667352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666137 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 19:37:13.667352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666140 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 19:37:13.667352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666142 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 19:37:13.667352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666145 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 19:37:13.667352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666148 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 19:37:13.667352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666151 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 19:37:13.667825 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666154 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 19:37:13.667825 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666156 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 19:37:13.667825 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666159 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 19:37:13.667825 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666161 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 19:37:13.667825 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666164 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 19:37:13.667825 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666167 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 19:37:13.667825 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666169 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 19:37:13.667825 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666172 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 19:37:13.667825 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666175 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 19:37:13.667825 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666177 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 19:37:13.667825 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666180 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 19:37:13.667825 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666182 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 19:37:13.667825 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666187 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 19:37:13.667825 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666190 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 19:37:13.667825 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666193 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 19:37:13.667825 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666196 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 19:37:13.667825 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666199 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 19:37:13.667825 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666203 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 19:37:13.667825 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666919 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 19:37:13.667825 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666925 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 19:37:13.668318 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666929 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 19:37:13.668318 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666932 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 19:37:13.668318 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666936 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 19:37:13.668318 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666939 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 19:37:13.668318 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666942 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 19:37:13.668318 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666945 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 19:37:13.668318 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666947 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 19:37:13.668318 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666950 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 19:37:13.668318 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666953 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 19:37:13.668318 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666955 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 19:37:13.668318 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666958 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 19:37:13.668318 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666961 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 19:37:13.668318 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666964 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 19:37:13.668318 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666966 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 19:37:13.668318 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666969 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 19:37:13.668318 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666972 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 19:37:13.668318 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666975 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 19:37:13.668318 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666979 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 19:37:13.668318 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666981 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 19:37:13.668318 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666984 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 19:37:13.668800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666987 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 19:37:13.668800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666990 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 19:37:13.668800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666992 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 19:37:13.668800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666995 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 19:37:13.668800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.666998 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 19:37:13.668800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667000 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 19:37:13.668800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667003 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 19:37:13.668800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667006 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 19:37:13.668800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667008 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 19:37:13.668800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667011 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 19:37:13.668800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667014 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 19:37:13.668800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667016 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 19:37:13.668800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667019 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 19:37:13.668800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667036 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 19:37:13.668800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667039 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 19:37:13.668800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667041 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 19:37:13.668800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667044 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 19:37:13.668800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667047 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 19:37:13.668800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667049 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 19:37:13.668800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667052 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 19:37:13.669309 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667056 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 19:37:13.669309 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667058 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 19:37:13.669309 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667061 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 19:37:13.669309 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667065 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 19:37:13.669309 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667069 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 19:37:13.669309 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667073 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 19:37:13.669309 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667077 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 19:37:13.669309 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667080 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 19:37:13.669309 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667083 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 19:37:13.669309 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667086 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 19:37:13.669309 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667089 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 19:37:13.669309 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667092 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 19:37:13.669309 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667095 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 19:37:13.669309 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667098 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 19:37:13.669309 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667101 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 19:37:13.669309 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667104 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 19:37:13.669309 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667107 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 19:37:13.669309 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667110 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 19:37:13.669309 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667113 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 19:37:13.669800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667115 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 19:37:13.669800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667118 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 19:37:13.669800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667121 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 21 19:37:13.669800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667124 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 19:37:13.669800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667126 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 19:37:13.669800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667130 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 19:37:13.669800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667134 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 19:37:13.669800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667137 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 19:37:13.669800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667139 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 19:37:13.669800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667142 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 19:37:13.669800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667144 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 19:37:13.669800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667147 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 19:37:13.669800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667149 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 19:37:13.669800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667152 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 19:37:13.669800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667154 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 19:37:13.669800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667157 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 19:37:13.669800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667159 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 19:37:13.669800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667162 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 19:37:13.669800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667165 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 19:37:13.669800 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667167 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 19:37:13.670293 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667170 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 19:37:13.670293 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667173 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 19:37:13.670293 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667176 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 19:37:13.670293 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667179 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 19:37:13.670293 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667182 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 19:37:13.670293 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667184 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 19:37:13.670293 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667187 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 19:37:13.670293 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667189 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 19:37:13.670293 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667192 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 19:37:13.670293 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667195 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 19:37:13.670293 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667197 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 19:37:13.670293 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667200 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 19:37:13.670293 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667202 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 19:37:13.670293 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667205 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 19:37:13.670293 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667207 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 19:37:13.670293 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667210 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 19:37:13.670293 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667212 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 19:37:13.670293 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667215 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 19:37:13.670293 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667564 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 19:37:13.670739 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667568 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 19:37:13.670739 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667571 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 19:37:13.670739 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667574 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 19:37:13.670739 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667576 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 19:37:13.670739 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667579 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 19:37:13.670739 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667582 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 19:37:13.670739 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667585 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 19:37:13.670739 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667587 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 19:37:13.670739 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667590 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 19:37:13.670739 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667593 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 19:37:13.670739 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667595 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 19:37:13.670739 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667601 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 19:37:13.670739 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667604 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 19:37:13.670739 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667607 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 19:37:13.670739 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667610 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 19:37:13.670739 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667613 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 19:37:13.670739 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667615 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 19:37:13.670739 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667618 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 19:37:13.670739 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667620 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 19:37:13.670739 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667623 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 19:37:13.671244 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667626 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 19:37:13.671244 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667628 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 19:37:13.671244 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667631 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 19:37:13.671244 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667634 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 19:37:13.671244 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667636 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 19:37:13.671244 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667639 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 19:37:13.671244 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667642 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 19:37:13.671244 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667644 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 19:37:13.671244 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667647 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 19:37:13.671244 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667649 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 19:37:13.671244 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667652 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 19:37:13.671244 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667654 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 19:37:13.671244 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667657 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 19:37:13.671244 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667661 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 19:37:13.671244 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667665 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 21 19:37:13.671244 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667668 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 19:37:13.671244 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667672 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 19:37:13.671244 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667675 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 19:37:13.671244 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667678 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 19:37:13.671686 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667681 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 19:37:13.671686 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667684 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 19:37:13.671686 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667687 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 19:37:13.671686 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667690 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 19:37:13.671686 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667693 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 19:37:13.671686 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667696 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 19:37:13.671686 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667699 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 19:37:13.671686 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667702 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 19:37:13.671686 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667704 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 19:37:13.671686 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667707 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 19:37:13.671686 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667710 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 19:37:13.671686 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667713 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 19:37:13.671686 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667716 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 19:37:13.671686 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667718 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 19:37:13.671686 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667720 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 19:37:13.671686 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667725 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 19:37:13.671686 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667728 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 19:37:13.671686 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667730 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 19:37:13.671686 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667733 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 19:37:13.671686 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667735 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 19:37:13.672156 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667738 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 19:37:13.672156 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667740 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 19:37:13.672156 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667743 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 19:37:13.672156 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667745 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 19:37:13.672156 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667749 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 19:37:13.672156 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667752 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 19:37:13.672156 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667755 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 19:37:13.672156 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667758 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 19:37:13.672156 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667761 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 19:37:13.672156 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667763 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 19:37:13.672156 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667766 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 19:37:13.672156 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667768 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 19:37:13.672156 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667771 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 19:37:13.672156 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667774 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 19:37:13.672156 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667777 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 19:37:13.672156 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667779 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 19:37:13.672156 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667782 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 19:37:13.672156 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667784 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 19:37:13.672156 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667787 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 19:37:13.672626 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667790 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 19:37:13.672626 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667792 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 19:37:13.672626 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667795 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 19:37:13.672626 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667798 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 19:37:13.672626 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667800 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 19:37:13.672626 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667803 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 19:37:13.672626 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667805 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 19:37:13.672626 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667809 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 19:37:13.672626 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667813 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 19:37:13.672626 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667815 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 19:37:13.672626 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667818 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 19:37:13.672626 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667821 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 19:37:13.672626 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667823 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 19:37:13.672626 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667826 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 19:37:13.672626 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667828 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 19:37:13.672626 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667831 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 19:37:13.672626 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667834 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 19:37:13.672626 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667837 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 19:37:13.672626 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667840 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 19:37:13.672626 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.667842 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 19:37:13.673125 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.667909 2581 flags.go:64] FLAG: --address="0.0.0.0" Jul 21 19:37:13.673125 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.667916 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 21 19:37:13.673125 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.667922 2581 flags.go:64] FLAG: --anonymous-auth="true" Jul 21 19:37:13.673125 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.667927 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 21 19:37:13.673125 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.667931 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 21 19:37:13.673125 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.667935 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 21 19:37:13.673125 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.667939 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 21 19:37:13.673125 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.667943 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 21 19:37:13.673125 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.667946 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 21 19:37:13.673125 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.667949 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 21 19:37:13.673125 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.667952 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 21 19:37:13.673125 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.667956 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 21 19:37:13.673125 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.667959 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 21 19:37:13.673125 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.667963 2581 flags.go:64] FLAG: --cgroup-root="" Jul 21 19:37:13.673125 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.667966 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 21 19:37:13.673125 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.667969 2581 flags.go:64] FLAG: --client-ca-file="" Jul 21 19:37:13.673125 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.667971 2581 flags.go:64] FLAG: --cloud-provider="external" Jul 21 19:37:13.673125 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.667974 2581 flags.go:64] FLAG: --cluster-dns="[]" Jul 21 19:37:13.673125 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.667978 2581 flags.go:64] FLAG: --cluster-domain="" Jul 21 19:37:13.673125 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.667981 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 21 19:37:13.673125 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.667989 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 21 19:37:13.673125 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.667993 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 21 19:37:13.673125 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.667996 2581 flags.go:64] FLAG: --container-log-max-files="5" Jul 21 19:37:13.673125 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668000 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 21 19:37:13.673724 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668002 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 21 19:37:13.673724 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668005 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 21 19:37:13.673724 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668009 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 21 19:37:13.673724 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668012 2581 flags.go:64] FLAG: --contention-profiling="false" Jul 21 19:37:13.673724 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668015 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 21 19:37:13.673724 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668018 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 21 19:37:13.673724 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668035 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 21 19:37:13.673724 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668038 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 21 19:37:13.673724 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668042 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 21 19:37:13.673724 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668046 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 21 19:37:13.673724 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668048 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 21 19:37:13.673724 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668051 2581 flags.go:64] FLAG: --enable-load-reader="false" Jul 21 19:37:13.673724 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668054 2581 flags.go:64] FLAG: --enable-server="true" Jul 21 19:37:13.673724 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668057 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 21 19:37:13.673724 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668062 2581 flags.go:64] FLAG: --event-burst="100" Jul 21 19:37:13.673724 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668065 2581 flags.go:64] FLAG: --event-qps="50" Jul 21 19:37:13.673724 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668068 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 21 19:37:13.673724 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668071 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 21 19:37:13.673724 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668074 2581 flags.go:64] FLAG: --eviction-hard="" Jul 21 19:37:13.673724 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668078 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 21 19:37:13.673724 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668081 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 21 19:37:13.673724 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668084 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 21 19:37:13.673724 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668087 2581 flags.go:64] FLAG: --eviction-soft="" Jul 21 19:37:13.673724 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668090 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 21 19:37:13.673724 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668093 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 21 19:37:13.674369 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668096 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 21 19:37:13.674369 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668099 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jul 21 19:37:13.674369 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668102 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 21 19:37:13.674369 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668106 2581 flags.go:64] FLAG: --fail-swap-on="true" Jul 21 19:37:13.674369 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668109 2581 flags.go:64] FLAG: --feature-gates="" Jul 21 19:37:13.674369 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668112 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jul 21 19:37:13.674369 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668115 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 21 19:37:13.674369 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668118 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 21 19:37:13.674369 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668121 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 21 19:37:13.674369 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668124 2581 flags.go:64] FLAG: --healthz-port="10248" Jul 21 19:37:13.674369 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668127 2581 flags.go:64] FLAG: --help="false" Jul 21 19:37:13.674369 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668130 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-137-5.ec2.internal" Jul 21 19:37:13.674369 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668133 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 21 19:37:13.674369 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668136 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jul 21 19:37:13.674369 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668139 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 21 19:37:13.674369 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668142 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 21 19:37:13.674369 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668145 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 21 19:37:13.674369 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668148 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 21 19:37:13.674369 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668151 2581 flags.go:64] FLAG: --image-service-endpoint="" Jul 21 19:37:13.674369 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668154 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 21 19:37:13.674369 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668157 2581 flags.go:64] FLAG: --kube-api-burst="100" Jul 21 19:37:13.674369 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668160 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 21 19:37:13.674369 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668163 2581 flags.go:64] FLAG: --kube-api-qps="50" Jul 21 19:37:13.674369 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668166 2581 flags.go:64] FLAG: --kube-reserved="" Jul 21 19:37:13.674949 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668169 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 21 19:37:13.674949 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668171 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 21 19:37:13.674949 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668174 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jul 21 19:37:13.674949 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668177 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 21 19:37:13.674949 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668180 2581 flags.go:64] FLAG: --lock-file="" Jul 21 19:37:13.674949 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668184 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 21 19:37:13.674949 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668187 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 21 19:37:13.674949 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668190 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 21 19:37:13.674949 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668195 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jul 21 19:37:13.674949 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668198 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 21 19:37:13.674949 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668201 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jul 21 19:37:13.674949 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668205 2581 flags.go:64] FLAG: --logging-format="text" Jul 21 19:37:13.674949 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668207 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 21 19:37:13.674949 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668211 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 21 19:37:13.674949 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668213 2581 flags.go:64] FLAG: --manifest-url="" Jul 21 19:37:13.674949 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668216 2581 flags.go:64] FLAG: --manifest-url-header="" Jul 21 19:37:13.674949 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668220 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 21 19:37:13.674949 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668223 2581 flags.go:64] FLAG: --max-open-files="1000000" Jul 21 19:37:13.674949 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668227 2581 flags.go:64] FLAG: --max-pods="110" Jul 21 19:37:13.674949 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668230 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 21 19:37:13.674949 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668233 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 21 19:37:13.674949 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668236 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jul 21 19:37:13.674949 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668239 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 21 19:37:13.674949 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668241 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 21 19:37:13.674949 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668244 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 21 19:37:13.675583 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668247 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 21 19:37:13.675583 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668259 2581 flags.go:64] FLAG: --node-status-max-images="50" Jul 21 19:37:13.675583 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668262 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 21 19:37:13.675583 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668265 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jul 21 19:37:13.675583 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668268 2581 flags.go:64] FLAG: --pod-cidr="" Jul 21 19:37:13.675583 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668271 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 21 19:37:13.675583 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668276 2581 flags.go:64] FLAG: --pod-manifest-path="" Jul 21 19:37:13.675583 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668279 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jul 21 19:37:13.675583 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668282 2581 flags.go:64] FLAG: --pods-per-core="0" Jul 21 19:37:13.675583 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668289 2581 flags.go:64] FLAG: --port="10250" Jul 21 19:37:13.675583 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668292 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 21 19:37:13.675583 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668295 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cd3f0b4038a1edf4" Jul 21 19:37:13.675583 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668298 2581 flags.go:64] FLAG: --qos-reserved="" Jul 21 19:37:13.675583 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668302 2581 flags.go:64] FLAG: --read-only-port="10255" Jul 21 19:37:13.675583 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668305 2581 flags.go:64] FLAG: --register-node="true" Jul 21 19:37:13.675583 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668308 2581 flags.go:64] FLAG: --register-with-taints="" Jul 21 19:37:13.675583 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668311 2581 flags.go:64] FLAG: --registry-burst="10" Jul 21 19:37:13.675583 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668314 2581 flags.go:64] FLAG: --registry-qps="5" Jul 21 19:37:13.675583 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668318 2581 flags.go:64] FLAG: --reserved-cpus="" Jul 21 19:37:13.675583 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668321 2581 flags.go:64] FLAG: --reserved-memory="" Jul 21 19:37:13.675583 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668326 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 21 19:37:13.675583 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668329 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 21 19:37:13.675583 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668332 2581 flags.go:64] FLAG: --rotate-certificates="false" Jul 21 19:37:13.675583 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668335 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 21 19:37:13.675583 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668337 2581 flags.go:64] FLAG: --runonce="false" Jul 21 19:37:13.676334 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668340 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 21 19:37:13.676334 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668343 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 21 19:37:13.676334 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668346 2581 flags.go:64] FLAG: --seccomp-default="false" Jul 21 19:37:13.676334 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668349 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 21 19:37:13.676334 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668352 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 21 19:37:13.676334 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668355 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 21 19:37:13.676334 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668359 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 21 19:37:13.676334 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668362 2581 flags.go:64] FLAG: --storage-driver-password="root" Jul 21 19:37:13.676334 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668365 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jul 21 19:37:13.676334 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668368 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jul 21 19:37:13.676334 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668371 2581 flags.go:64] FLAG: --storage-driver-user="root" Jul 21 19:37:13.676334 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668374 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 21 19:37:13.676334 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668377 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 21 19:37:13.676334 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668380 2581 flags.go:64] FLAG: --system-cgroups="" Jul 21 19:37:13.676334 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668382 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 21 19:37:13.676334 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668388 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 21 19:37:13.676334 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668391 2581 flags.go:64] FLAG: --tls-cert-file="" Jul 21 19:37:13.676334 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668393 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 21 19:37:13.676334 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668397 2581 flags.go:64] FLAG: --tls-min-version="" Jul 21 19:37:13.676334 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668399 2581 flags.go:64] FLAG: --tls-private-key-file="" Jul 21 19:37:13.676334 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668402 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jul 21 19:37:13.676334 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668405 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 21 19:37:13.676334 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668408 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jul 21 19:37:13.676334 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668411 2581 flags.go:64] FLAG: --v="2" Jul 21 19:37:13.676334 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668414 2581 flags.go:64] FLAG: --version="false" Jul 21 19:37:13.676927 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668420 2581 flags.go:64] FLAG: --vmodule="" Jul 21 19:37:13.676927 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668423 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 21 19:37:13.676927 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668426 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 21 19:37:13.676927 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668535 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 19:37:13.676927 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668539 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 19:37:13.676927 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668542 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 19:37:13.676927 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668545 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 19:37:13.676927 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668548 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 19:37:13.676927 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668552 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 19:37:13.676927 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668556 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 19:37:13.676927 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668559 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 19:37:13.676927 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668562 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 19:37:13.676927 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668565 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 19:37:13.676927 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668570 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 19:37:13.676927 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668573 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 19:37:13.676927 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668575 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 19:37:13.676927 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668578 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 19:37:13.676927 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668581 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 19:37:13.676927 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668583 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 19:37:13.677404 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668586 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 19:37:13.677404 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668588 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 19:37:13.677404 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668591 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 19:37:13.677404 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668593 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 19:37:13.677404 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668596 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 19:37:13.677404 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668598 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 19:37:13.677404 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668601 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 19:37:13.677404 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668604 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 19:37:13.677404 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668606 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 19:37:13.677404 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668609 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 19:37:13.677404 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668612 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 19:37:13.677404 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668616 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 19:37:13.677404 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668620 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 19:37:13.677404 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668625 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 19:37:13.677404 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668628 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 19:37:13.677404 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668631 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 19:37:13.677404 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668634 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 19:37:13.677404 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668637 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 19:37:13.677404 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668640 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 19:37:13.677856 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668643 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 21 19:37:13.677856 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668645 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 19:37:13.677856 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668648 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 19:37:13.677856 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668651 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 19:37:13.677856 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668653 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 19:37:13.677856 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668656 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 19:37:13.677856 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668659 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 19:37:13.677856 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668662 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 19:37:13.677856 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668665 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 19:37:13.677856 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668667 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 19:37:13.677856 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668670 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 19:37:13.677856 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668673 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 19:37:13.677856 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668675 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 19:37:13.677856 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668678 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 19:37:13.677856 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668680 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 19:37:13.677856 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668683 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 19:37:13.677856 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668685 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 19:37:13.677856 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668688 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 19:37:13.677856 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668691 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 19:37:13.677856 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668693 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 19:37:13.678387 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668696 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 19:37:13.678387 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668698 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 19:37:13.678387 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668701 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 19:37:13.678387 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668704 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 19:37:13.678387 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668707 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 19:37:13.678387 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668709 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 19:37:13.678387 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668714 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 19:37:13.678387 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668716 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 19:37:13.678387 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668719 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 19:37:13.678387 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668721 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 19:37:13.678387 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668724 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 19:37:13.678387 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668726 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 19:37:13.678387 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668729 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 19:37:13.678387 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668731 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 19:37:13.678387 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668734 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 19:37:13.678387 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668736 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 19:37:13.678387 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668739 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 19:37:13.678387 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668741 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 19:37:13.678387 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668744 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 19:37:13.678387 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668748 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 19:37:13.678861 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668751 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 19:37:13.678861 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668754 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 19:37:13.678861 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668756 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 19:37:13.678861 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668759 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 19:37:13.678861 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668763 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 19:37:13.678861 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668766 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 19:37:13.678861 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668769 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 19:37:13.678861 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668772 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 19:37:13.678861 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668774 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 19:37:13.678861 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668777 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 19:37:13.678861 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668779 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 19:37:13.678861 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668782 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 19:37:13.678861 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668785 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 19:37:13.678861 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668787 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 19:37:13.678861 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668790 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 19:37:13.678861 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668793 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 19:37:13.678861 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668795 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 19:37:13.678861 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668798 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 19:37:13.678861 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668802 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 19:37:13.678861 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668805 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 19:37:13.679427 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668808 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 19:37:13.679427 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668811 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 19:37:13.679427 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668813 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 19:37:13.679427 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.668816 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 19:37:13.679427 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.668821 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 19:37:13.679427 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.675157 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 21 19:37:13.679427 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.675171 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 21 19:37:13.679427 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.675189 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 21 19:37:13.679427 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.675194 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 21 19:37:13.679427 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675254 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 19:37:13.679427 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675259 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 19:37:13.679427 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675263 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 19:37:13.679427 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675266 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 19:37:13.679427 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675269 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 19:37:13.679427 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675272 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 19:37:13.679790 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675275 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 19:37:13.679790 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675278 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 19:37:13.679790 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675281 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 19:37:13.679790 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675284 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 19:37:13.679790 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675287 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 19:37:13.679790 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675290 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 19:37:13.679790 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675292 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 19:37:13.679790 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675295 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 19:37:13.679790 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675298 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 19:37:13.679790 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675301 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 19:37:13.679790 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675303 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 19:37:13.679790 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675306 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 19:37:13.679790 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675309 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 19:37:13.679790 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675312 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 19:37:13.679790 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675315 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 19:37:13.679790 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675318 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 19:37:13.679790 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675321 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 19:37:13.679790 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675323 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 19:37:13.679790 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675326 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 19:37:13.679790 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675329 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 19:37:13.680352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675332 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 19:37:13.680352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675334 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 19:37:13.680352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675337 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 19:37:13.680352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675340 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 19:37:13.680352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675343 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 19:37:13.680352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675346 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 19:37:13.680352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675348 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 19:37:13.680352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675351 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 19:37:13.680352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675354 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 19:37:13.680352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675358 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 19:37:13.680352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675361 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 19:37:13.680352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675364 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 19:37:13.680352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675367 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 19:37:13.680352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675370 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 19:37:13.680352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675373 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 19:37:13.680352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675375 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 19:37:13.680352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675378 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 19:37:13.680352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675380 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 19:37:13.680352 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675384 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 19:37:13.680809 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675387 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 19:37:13.680809 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675390 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 19:37:13.680809 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675393 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 21 19:37:13.680809 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675395 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 19:37:13.680809 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675399 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 19:37:13.680809 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675402 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 19:37:13.680809 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675404 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 19:37:13.680809 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675407 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 19:37:13.680809 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675410 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 19:37:13.680809 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675413 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 19:37:13.680809 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675415 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 19:37:13.680809 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675418 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 19:37:13.680809 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675420 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 19:37:13.680809 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675423 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 19:37:13.680809 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675425 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 19:37:13.680809 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675428 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 19:37:13.680809 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675431 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 19:37:13.680809 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675434 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 19:37:13.680809 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675437 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 19:37:13.680809 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675439 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 19:37:13.681320 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675442 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 19:37:13.681320 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675444 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 19:37:13.681320 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675447 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 19:37:13.681320 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675449 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 19:37:13.681320 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675452 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 19:37:13.681320 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675455 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 19:37:13.681320 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675458 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 19:37:13.681320 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675460 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 19:37:13.681320 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675463 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 19:37:13.681320 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675465 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 19:37:13.681320 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675468 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 19:37:13.681320 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675470 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 19:37:13.681320 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675473 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 19:37:13.681320 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675476 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 19:37:13.681320 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675478 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 19:37:13.681320 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675481 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 19:37:13.681320 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675484 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 19:37:13.681320 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675486 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 19:37:13.681320 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675489 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 19:37:13.681808 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675491 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 19:37:13.681808 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675494 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 19:37:13.681808 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675497 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 19:37:13.681808 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675500 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 19:37:13.681808 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675504 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 19:37:13.681808 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675507 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 19:37:13.681808 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675510 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 19:37:13.681808 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675512 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 19:37:13.681808 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675515 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 19:37:13.681808 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675518 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 19:37:13.681808 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675521 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 19:37:13.681808 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675523 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 19:37:13.681808 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675526 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 19:37:13.681808 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675529 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 19:37:13.681808 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675531 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 19:37:13.682237 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.675536 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 19:37:13.682237 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675643 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 19:37:13.682237 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675648 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 19:37:13.682237 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675651 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 19:37:13.682237 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675654 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 19:37:13.682237 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675657 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 19:37:13.682237 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675660 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 19:37:13.682237 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675663 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 19:37:13.682237 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675666 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 19:37:13.682237 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675669 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 19:37:13.682237 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675672 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 19:37:13.682237 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675675 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 19:37:13.682237 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675678 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 19:37:13.682237 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675680 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 19:37:13.682237 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675683 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 19:37:13.682655 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675686 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 19:37:13.682655 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675688 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 19:37:13.682655 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675691 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 19:37:13.682655 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675694 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 19:37:13.682655 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675696 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 19:37:13.682655 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675699 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 19:37:13.682655 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675702 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 19:37:13.682655 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675705 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 19:37:13.682655 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675707 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 19:37:13.682655 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675711 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 19:37:13.682655 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675713 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 19:37:13.682655 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675716 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 19:37:13.682655 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675719 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 19:37:13.682655 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675721 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 19:37:13.682655 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675724 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 19:37:13.682655 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675726 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 19:37:13.682655 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675729 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 19:37:13.682655 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675731 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 19:37:13.682655 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675734 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 19:37:13.682655 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675736 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 19:37:13.683213 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675739 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 19:37:13.683213 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675741 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 19:37:13.683213 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675744 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 19:37:13.683213 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675746 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 19:37:13.683213 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675749 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 19:37:13.683213 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675751 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 19:37:13.683213 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675754 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 19:37:13.683213 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675756 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 19:37:13.683213 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675759 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 19:37:13.683213 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675761 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 19:37:13.683213 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675764 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 19:37:13.683213 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675766 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 19:37:13.683213 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675769 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 19:37:13.683213 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675771 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 19:37:13.683213 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675774 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 19:37:13.683213 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675776 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 19:37:13.683213 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675779 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 19:37:13.683213 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675781 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 19:37:13.683213 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675784 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 19:37:13.683213 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675787 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 19:37:13.683998 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675789 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 19:37:13.683998 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675792 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 19:37:13.683998 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675795 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 19:37:13.683998 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675798 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 19:37:13.683998 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675801 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 19:37:13.683998 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675803 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 19:37:13.683998 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675806 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 19:37:13.683998 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675808 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 19:37:13.683998 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675811 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 19:37:13.683998 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675813 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 19:37:13.683998 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675816 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 19:37:13.683998 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675819 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 19:37:13.683998 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675823 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 19:37:13.683998 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675826 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 19:37:13.683998 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675829 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 19:37:13.683998 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675831 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 19:37:13.683998 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675834 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 19:37:13.683998 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675836 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 19:37:13.683998 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675839 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 19:37:13.683998 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675841 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 19:37:13.684605 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675844 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 19:37:13.684605 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675846 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 19:37:13.684605 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675849 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 19:37:13.684605 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675852 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 21 19:37:13.684605 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675856 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 19:37:13.684605 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675859 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 19:37:13.684605 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675862 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 19:37:13.684605 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675865 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 19:37:13.684605 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675867 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 19:37:13.684605 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675871 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 19:37:13.684605 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675875 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 19:37:13.684605 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675878 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 19:37:13.684605 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675881 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 19:37:13.684605 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675883 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 19:37:13.684605 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675886 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 19:37:13.684605 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675889 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 19:37:13.684605 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675891 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 19:37:13.684605 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675894 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 19:37:13.684605 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675897 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 19:37:13.685265 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675899 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 19:37:13.685265 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675902 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 19:37:13.685265 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675904 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 19:37:13.685265 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675907 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 19:37:13.685265 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675909 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 19:37:13.685265 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:13.675912 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 19:37:13.685265 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.675916 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 19:37:13.685265 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.676006 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jul 21 19:37:13.685265 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.677930 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 21 19:37:13.685265 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.679121 2581 server.go:1019] "Starting client certificate rotation" Jul 21 19:37:13.685265 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.679230 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 21 19:37:13.685265 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.679935 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 21 19:37:13.685265 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.682373 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 21 19:37:13.685855 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.685841 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 21 19:37:13.694580 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.694564 2581 log.go:25] "Validated CRI v1 runtime API" Jul 21 19:37:13.696415 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.696403 2581 log.go:25] "Validated CRI v1 image API" Jul 21 19:37:13.699668 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.699639 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 21 19:37:13.701983 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.701962 2581 fs.go:135] Filesystem UUIDs: map[5dd09ccb-30f8-417e-bfcf-0b65635b274b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a4e638a0-ee88-4a00-8c71-206a67eb7994:/dev/nvme0n1p3] Jul 21 19:37:13.702063 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.701982 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 21 19:37:13.706691 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.706583 2581 manager.go:216] Machine: {Timestamp:2026-07-21 19:37:13.706107353 +0000 UTC m=+0.290986170 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103756 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a9ce18f4d79a9ad7572382fa72f6c SystemUUID:ec2a9ce1-8f4d-79a9-ad75-72382fa72f6c BootID:61974c2d-a0e0-4daa-8808-9fca8e58e784 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:54:4d:3a:6a:19 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:54:4d:3a:6a:19 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:ea:f2:fd:fd:ca Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 21 19:37:13.706691 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.706683 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 21 19:37:13.706824 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.706749 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 21 19:37:13.709161 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.709138 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 21 19:37:13.709311 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.709162 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-5.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 21 19:37:13.709767 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.709758 2581 topology_manager.go:138] "Creating topology manager with none policy" Jul 21 19:37:13.709796 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.709770 2581 container_manager_linux.go:309] "Creating device plugin manager" Jul 21 19:37:13.709796 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.709778 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 21 19:37:13.710237 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.710227 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 21 19:37:13.711157 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.711143 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 21 19:37:13.711239 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.711230 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 21 19:37:13.713676 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.713664 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 21 19:37:13.713782 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.713773 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 21 19:37:13.713822 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.713801 2581 kubelet.go:486] "Attempting to sync node with API server" Jul 21 19:37:13.713822 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.713810 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 21 19:37:13.713822 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.713822 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 21 19:37:13.713934 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.713830 2581 kubelet.go:398] "Adding apiserver pod source" Jul 21 19:37:13.713934 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.713856 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 21 19:37:13.714214 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.714197 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 21 19:37:13.714214 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.714215 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 21 19:37:13.716114 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.716096 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 21 19:37:13.717798 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.717784 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 21 19:37:13.717842 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.717815 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 21 19:37:13.718879 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.718867 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 21 19:37:13.718879 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.718881 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 21 19:37:13.718966 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.718888 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 21 19:37:13.718966 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.718893 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 21 19:37:13.718966 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.718901 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 21 19:37:13.718966 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.718908 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 21 19:37:13.718966 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.718916 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 21 19:37:13.718966 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.718921 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 21 19:37:13.718966 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.718927 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 21 19:37:13.718966 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.718932 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 21 19:37:13.718966 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.718947 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 21 19:37:13.718966 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.718952 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 21 19:37:13.719297 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.718975 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 21 19:37:13.719297 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.718980 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 21 19:37:13.722169 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.722153 2581 server.go:1268] "Started kubelet" Jul 21 19:37:13.722244 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.722201 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 21 19:37:13.722320 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.722269 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 21 19:37:13.722372 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.722340 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 21 19:37:13.722869 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:13.722844 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 21 19:37:13.722869 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:13.722862 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-5.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 21 19:37:13.722995 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.722853 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-5.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 21 19:37:13.723010 ip-10-0-137-5 systemd[1]: Started Kubernetes Kubelet. Jul 21 19:37:13.726928 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.726907 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 21 19:37:13.727521 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:13.727501 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 21 19:37:13.728060 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.728043 2581 server.go:310] "Adding debug handlers to kubelet server" Jul 21 19:37:13.730017 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:13.729199 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-5.ec2.internal.18c46535b6e95f44 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-5.ec2.internal,UID:ip-10-0-137-5.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-5.ec2.internal,},FirstTimestamp:2026-07-21 19:37:13.721978692 +0000 UTC m=+0.306857510,LastTimestamp:2026-07-21 19:37:13.721978692 +0000 UTC m=+0.306857510,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-5.ec2.internal,}" Jul 21 19:37:13.731634 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.731617 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 21 19:37:13.731634 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.731625 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 21 19:37:13.731759 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:13.731681 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-5.ec2.internal\" not found" Jul 21 19:37:13.732123 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.732104 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 21 19:37:13.732317 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.732260 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 21 19:37:13.732317 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.732316 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 21 19:37:13.732448 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.732422 2581 reconstruct.go:97] "Volume reconstruction finished" Jul 21 19:37:13.732448 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.732433 2581 reconciler.go:29] "Reconciler: start to sync state" Jul 21 19:37:13.732543 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.732485 2581 factory.go:55] Registering systemd factory Jul 21 19:37:13.732543 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.732497 2581 factory.go:223] Registration of the systemd container factory successfully Jul 21 19:37:13.732749 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.732734 2581 factory.go:153] Registering CRI-O factory Jul 21 19:37:13.732749 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.732752 2581 factory.go:223] Registration of the crio container factory successfully Jul 21 19:37:13.732856 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.732801 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 21 19:37:13.732856 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.732825 2581 factory.go:103] Registering Raw factory Jul 21 19:37:13.732856 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.732841 2581 manager.go:1196] Started watching for new ooms in manager Jul 21 19:37:13.733269 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.733242 2581 manager.go:349] Starting recovery of all containers Jul 21 19:37:13.739920 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.739890 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 21 19:37:13.741511 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.741486 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mmv4m" Jul 21 19:37:13.741643 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:13.741623 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 21 19:37:13.741710 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:13.741694 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-5.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 21 19:37:13.743097 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.742416 2581 manager.go:354] Recovery completed Jul 21 19:37:13.744095 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:13.744070 2581 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 21 19:37:13.747206 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.747190 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mmv4m" Jul 21 19:37:13.747464 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.747452 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 19:37:13.749067 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.749053 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-5.ec2.internal" event="NodeHasSufficientMemory" Jul 21 19:37:13.749164 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.749078 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-5.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 19:37:13.749164 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.749088 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-5.ec2.internal" event="NodeHasSufficientPID" Jul 21 19:37:13.749586 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.749565 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 21 19:37:13.749586 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.749576 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 21 19:37:13.749586 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.749581 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 19:37:13.749740 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.749592 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 21 19:37:13.750180 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.750167 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-5.ec2.internal" event="NodeHasSufficientMemory" Jul 21 19:37:13.750235 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.750190 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-5.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 19:37:13.750235 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.750200 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-5.ec2.internal" event="NodeHasSufficientPID" Jul 21 19:37:13.750473 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.750461 2581 policy_none.go:49] "None policy: Start" Jul 21 19:37:13.750523 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.750478 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 21 19:37:13.750523 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.750493 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 21 19:37:13.751305 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.751291 2581 policy_none.go:47] "Start" Jul 21 19:37:13.784370 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.784358 2581 manager.go:337] "Starting Device Plugin manager" Jul 21 19:37:13.784427 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:13.784392 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 21 19:37:13.784427 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.784402 2581 server.go:87] "Starting device plugin registration server" Jul 21 19:37:13.784624 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.784614 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 21 19:37:13.784658 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.784627 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 21 19:37:13.784743 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.784724 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 21 19:37:13.784828 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.784816 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 21 19:37:13.784888 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.784829 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 21 19:37:13.785266 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:13.785248 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 21 19:37:13.785356 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:13.785298 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-5.ec2.internal\" not found" Jul 21 19:37:13.885530 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.885480 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 19:37:13.886399 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.886383 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-5.ec2.internal" event="NodeHasSufficientMemory" Jul 21 19:37:13.886456 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.886413 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-5.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 19:37:13.886456 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.886424 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-5.ec2.internal" event="NodeHasSufficientPID" Jul 21 19:37:13.886456 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.886449 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-5.ec2.internal" Jul 21 19:37:13.892875 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.892859 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-5.ec2.internal" Jul 21 19:37:13.892933 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:13.892880 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-5.ec2.internal\": node \"ip-10-0-137-5.ec2.internal\" not found" Jul 21 19:37:13.902970 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.902949 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 21 19:37:13.903059 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.902984 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 21 19:37:13.903059 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.903004 2581 kubelet.go:2448] "Starting kubelet main sync loop" Jul 21 19:37:13.903059 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:13.903045 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 21 19:37:13.905270 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:13.905252 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 19:37:13.906816 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:13.906800 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-5.ec2.internal\" not found" Jul 21 19:37:14.003336 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:14.003306 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-5.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-5.ec2.internal"] Jul 21 19:37:14.003421 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:14.003383 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 19:37:14.004652 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:14.004638 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-5.ec2.internal" event="NodeHasSufficientMemory" Jul 21 19:37:14.004703 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:14.004664 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-5.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 19:37:14.004703 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:14.004674 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-5.ec2.internal" event="NodeHasSufficientPID" Jul 21 19:37:14.005929 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:14.005918 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 19:37:14.006059 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:14.006045 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-5.ec2.internal" Jul 21 19:37:14.006103 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:14.006074 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 19:37:14.007164 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:14.007151 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-5.ec2.internal\" not found" Jul 21 19:37:14.008807 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:14.008792 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-5.ec2.internal" event="NodeHasSufficientMemory" Jul 21 19:37:14.008853 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:14.008845 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-5.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 19:37:14.008892 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:14.008856 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-5.ec2.internal" event="NodeHasSufficientPID" Jul 21 19:37:14.008892 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:14.008793 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-5.ec2.internal" event="NodeHasSufficientMemory" Jul 21 19:37:14.008957 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:14.008895 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-5.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 19:37:14.008957 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:14.008907 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-5.ec2.internal" event="NodeHasSufficientPID" Jul 21 19:37:14.010047 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:14.010016 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-5.ec2.internal" Jul 21 19:37:14.010140 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:14.010055 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 19:37:14.010685 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:14.010668 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-5.ec2.internal" event="NodeHasSufficientMemory" Jul 21 19:37:14.010752 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:14.010699 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-5.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 19:37:14.010752 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:14.010714 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-5.ec2.internal" event="NodeHasSufficientPID" Jul 21 19:37:14.034846 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:14.034825 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a3204fb4289b17b665b5abcf953c874-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-5.ec2.internal\" (UID: \"8a3204fb4289b17b665b5abcf953c874\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-5.ec2.internal" Jul 21 19:37:14.034905 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:14.034851 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a3204fb4289b17b665b5abcf953c874-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-5.ec2.internal\" (UID: \"8a3204fb4289b17b665b5abcf953c874\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-5.ec2.internal" Jul 21 19:37:14.034905 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:14.034876 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bde857cbb1c0b9ad930985637a279229-config\") pod \"kube-apiserver-proxy-ip-10-0-137-5.ec2.internal\" (UID: \"bde857cbb1c0b9ad930985637a279229\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-5.ec2.internal" Jul 21 19:37:14.038600 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:14.038583 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-5.ec2.internal\" not found" node="ip-10-0-137-5.ec2.internal" Jul 21 19:37:15.668115 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:15.667967 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-5.ec2.internal\" not found" node="ip-10-0-137-5.ec2.internal" Jul 21 19:37:15.732173 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:15.732156 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-5.ec2.internal\" not found" Jul 21 19:37:15.760709 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:15.760665 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a3204fb4289b17b665b5abcf953c874-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-5.ec2.internal\" (UID: \"8a3204fb4289b17b665b5abcf953c874\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-5.ec2.internal" Jul 21 19:37:15.760709 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:15.760687 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a3204fb4289b17b665b5abcf953c874-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-5.ec2.internal\" (UID: \"8a3204fb4289b17b665b5abcf953c874\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-5.ec2.internal" Jul 21 19:37:15.760709 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:15.760703 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bde857cbb1c0b9ad930985637a279229-config\") pod \"kube-apiserver-proxy-ip-10-0-137-5.ec2.internal\" (UID: \"bde857cbb1c0b9ad930985637a279229\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-5.ec2.internal" Jul 21 19:37:15.760829 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:15.760738 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bde857cbb1c0b9ad930985637a279229-config\") pod \"kube-apiserver-proxy-ip-10-0-137-5.ec2.internal\" (UID: \"bde857cbb1c0b9ad930985637a279229\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-5.ec2.internal" Jul 21 19:37:15.760829 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:15.760780 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a3204fb4289b17b665b5abcf953c874-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-5.ec2.internal\" (UID: \"8a3204fb4289b17b665b5abcf953c874\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-5.ec2.internal" Jul 21 19:37:15.760829 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:15.760786 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a3204fb4289b17b665b5abcf953c874-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-5.ec2.internal\" (UID: \"8a3204fb4289b17b665b5abcf953c874\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-5.ec2.internal" Jul 21 19:37:15.832933 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:15.832905 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-5.ec2.internal\" not found" Jul 21 19:37:15.933545 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:15.933512 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-5.ec2.internal\" not found" Jul 21 19:37:15.965946 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:15.965920 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-5.ec2.internal" Jul 21 19:37:15.970613 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:15.970597 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-5.ec2.internal" Jul 21 19:37:16.034098 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:16.034042 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-5.ec2.internal\" not found" Jul 21 19:37:16.134540 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:16.134512 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-5.ec2.internal\" not found" Jul 21 19:37:16.234975 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:16.234948 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-5.ec2.internal\" not found" Jul 21 19:37:16.303403 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:16.303357 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 21 19:37:16.303768 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:16.303487 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 21 19:37:16.335644 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:16.335624 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-5.ec2.internal\" not found" Jul 21 19:37:16.375898 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:16.375868 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 19:32:15 +0000 UTC" deadline="2028-02-05 05:44:50.27651903 +0000 UTC" Jul 21 19:37:16.375985 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:16.375904 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13522h7m33.900618299s" Jul 21 19:37:16.386120 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:16.386102 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 19:37:16.436356 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:16.436338 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-5.ec2.internal\" not found" Jul 21 19:37:16.531762 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:16.531738 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 19:37:16.556680 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:16.556626 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-5.ec2.internal" Jul 21 19:37:16.559983 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:16.559942 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbde857cbb1c0b9ad930985637a279229.slice/crio-aacf612599c2a6aa0f12583acaac1f22cc0f602e912141c891675f9aa5a88198 WatchSource:0}: Error finding container aacf612599c2a6aa0f12583acaac1f22cc0f602e912141c891675f9aa5a88198: Status 404 returned error can't find the container with id aacf612599c2a6aa0f12583acaac1f22cc0f602e912141c891675f9aa5a88198 Jul 21 19:37:16.560451 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:16.560430 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a3204fb4289b17b665b5abcf953c874.slice/crio-ce1b81d53073427e6018e5a11d2767da5ad58a71bb8fba8006f8741ff0754e53 WatchSource:0}: Error finding container ce1b81d53073427e6018e5a11d2767da5ad58a71bb8fba8006f8741ff0754e53: Status 404 returned error can't find the container with id ce1b81d53073427e6018e5a11d2767da5ad58a71bb8fba8006f8741ff0754e53 Jul 21 19:37:16.564504 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:16.564491 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 19:37:16.570196 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:16.570179 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 21 19:37:16.571825 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:16.571810 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-5.ec2.internal" Jul 21 19:37:16.578520 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:16.578502 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 21 19:37:16.954189 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:16.954116 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 19:37:17.110086 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.110058 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 19:37:17.340757 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.340676 2581 apiserver.go:52] "Watching apiserver" Jul 21 19:37:17.352329 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.352300 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 21 19:37:17.353288 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.353111 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-8x7vz","openshift-dns/node-resolver-6w4zf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-5.ec2.internal","openshift-multus/multus-5m4hj","openshift-multus/multus-additional-cni-plugins-2nv6g","openshift-multus/network-metrics-daemon-wzkph","openshift-network-diagnostics/network-check-target-lh2hq","kube-system/global-pull-secret-syncer-q9g56","kube-system/kube-apiserver-proxy-ip-10-0-137-5.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4fmz","openshift-image-registry/node-ca-g8vsp","openshift-network-operator/iptables-alerter-rbttl","openshift-ovn-kubernetes/ovnkube-node-gnxn2","kube-system/konnectivity-agent-kxpcf"] Jul 21 19:37:17.354838 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.354816 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh2hq" Jul 21 19:37:17.354986 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:17.354918 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lh2hq" podUID="9dfa1c3e-9a8f-4813-a991-7072ca083d84" Jul 21 19:37:17.356801 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.356771 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.357396 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.357375 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 21 19:37:17.357997 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.357965 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kxpcf" Jul 21 19:37:17.359170 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.359150 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.359696 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.359619 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 21 19:37:17.359696 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.359668 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 21 19:37:17.359696 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.359674 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 21 19:37:17.360971 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.360767 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2nv6g" Jul 21 19:37:17.361129 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.361112 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 21 19:37:17.361231 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.361212 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 21 19:37:17.361302 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.361292 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 21 19:37:17.361391 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.361351 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 21 19:37:17.361391 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.361358 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-f46tk\"" Jul 21 19:37:17.361496 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.361413 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qdwq8\"" Jul 21 19:37:17.362472 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.362209 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzkph" Jul 21 19:37:17.362472 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.362284 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 21 19:37:17.362472 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.362311 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 21 19:37:17.362472 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:17.362281 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzkph" podUID="f593837e-f6e2-4b42-aa46-5dbee27cf83a" Jul 21 19:37:17.362722 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.362487 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 21 19:37:17.362722 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.362489 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 21 19:37:17.362722 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.362539 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 21 19:37:17.362722 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.362625 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-r8xrp\"" Jul 21 19:37:17.363422 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.363400 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9g56" Jul 21 19:37:17.363519 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.363451 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6hmtr\"" Jul 21 19:37:17.363519 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:17.363481 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q9g56" podUID="dfb82dd4-3122-4ebb-aabc-84682403809d" Jul 21 19:37:17.363783 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.363638 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 21 19:37:17.363783 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.363675 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 21 19:37:17.364789 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.364767 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.366159 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.366136 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6w4zf" Jul 21 19:37:17.367073 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.367052 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9kwnh\"" Jul 21 19:37:17.367073 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.367070 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 21 19:37:17.367269 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.367057 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 21 19:37:17.367408 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.367389 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxb7h\" (UniqueName: \"kubernetes.io/projected/9dfa1c3e-9a8f-4813-a991-7072ca083d84-kube-api-access-qxb7h\") pod \"network-check-target-lh2hq\" (UID: \"9dfa1c3e-9a8f-4813-a991-7072ca083d84\") " pod="openshift-network-diagnostics/network-check-target-lh2hq" Jul 21 19:37:17.367461 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.367422 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 21 19:37:17.367513 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.367424 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-etc-openvswitch\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.367513 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.367487 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-node-log\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.367611 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.367510 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/12196bd5-b229-4551-9e02-9c040af87b59-env-overrides\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.367611 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.367533 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/12196bd5-b229-4551-9e02-9c040af87b59-ovn-node-metrics-cert\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.367611 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.367559 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-run-openvswitch\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.367611 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.367584 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-host-cni-bin\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.367611 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.367607 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-host-cni-netd\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.368033 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.367633 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.368033 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.367657 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/acc2e902-5de8-4233-8a76-1b41791e088f-konnectivity-ca\") pod \"konnectivity-agent-kxpcf\" (UID: \"acc2e902-5de8-4233-8a76-1b41791e088f\") " pod="kube-system/konnectivity-agent-kxpcf" Jul 21 19:37:17.368033 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.367701 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4fmz" Jul 21 19:37:17.368033 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.367679 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-systemd-units\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.368033 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.367732 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-host-run-netns\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.368033 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.367754 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-run-systemd\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.368033 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.367776 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-log-socket\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.368033 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.367830 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/12196bd5-b229-4551-9e02-9c040af87b59-ovnkube-config\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.368033 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.367863 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/acc2e902-5de8-4233-8a76-1b41791e088f-agent-certs\") pod \"konnectivity-agent-kxpcf\" (UID: \"acc2e902-5de8-4233-8a76-1b41791e088f\") " pod="kube-system/konnectivity-agent-kxpcf" Jul 21 19:37:17.368033 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.367904 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-host-kubelet\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.368033 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.367927 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-host-slash\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.368033 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.367950 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-var-lib-openvswitch\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.368033 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.367972 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-run-ovn\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.368033 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.368006 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-host-run-ovn-kubernetes\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.368033 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.368031 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/12196bd5-b229-4551-9e02-9c040af87b59-ovnkube-script-lib\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.368745 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.368054 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsvgc\" (UniqueName: \"kubernetes.io/projected/12196bd5-b229-4551-9e02-9c040af87b59-kube-api-access-qsvgc\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.368803 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.368767 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 21 19:37:17.369265 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.369172 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g8vsp" Jul 21 19:37:17.369265 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.369221 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 21 19:37:17.369730 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.369711 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-68cj6\"" Jul 21 19:37:17.370164 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.370144 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 21 19:37:17.370164 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.370162 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bv6wr\"" Jul 21 19:37:17.370298 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.370186 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rbttl" Jul 21 19:37:17.370903 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.370804 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 21 19:37:17.370903 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.370821 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 21 19:37:17.371628 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.371606 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 21 19:37:17.371628 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.371622 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 21 19:37:17.372271 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.372068 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7jcm2\"" Jul 21 19:37:17.372271 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.372104 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 21 19:37:17.373805 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.373501 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6jrdp\"" Jul 21 19:37:17.373805 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.373535 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 21 19:37:17.373805 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.373768 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 21 19:37:17.373805 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.373778 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 21 19:37:17.388663 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.388644 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8br79" Jul 21 19:37:17.397110 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.397089 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8br79" Jul 21 19:37:17.458765 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.458743 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 21 19:37:17.468426 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.468403 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-run-ovn\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.468532 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.468444 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nvmd\" (UniqueName: \"kubernetes.io/projected/def7fd0e-546e-453b-ab49-665ae20835fe-kube-api-access-7nvmd\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.468532 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.468474 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f45d30e4-e0ba-4f2c-a765-d2f56fad780f-system-cni-dir\") pod \"multus-additional-cni-plugins-2nv6g\" (UID: \"f45d30e4-e0ba-4f2c-a765-d2f56fad780f\") " pod="openshift-multus/multus-additional-cni-plugins-2nv6g" Jul 21 19:37:17.468532 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.468498 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-etc-sysctl-d\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.468532 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.468520 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-etc-sysctl-conf\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.468532 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.468518 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-run-ovn\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.468750 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.468560 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-etc-systemd\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.468750 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.468584 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dfb82dd4-3122-4ebb-aabc-84682403809d-kubelet-config\") pod \"global-pull-secret-syncer-q9g56\" (UID: \"dfb82dd4-3122-4ebb-aabc-84682403809d\") " pod="kube-system/global-pull-secret-syncer-q9g56" Jul 21 19:37:17.468750 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.468600 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7109dc26-f036-4ea0-9e29-6a0eb3fa9c43-registration-dir\") pod \"aws-ebs-csi-driver-node-l4fmz\" (UID: \"7109dc26-f036-4ea0-9e29-6a0eb3fa9c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4fmz" Jul 21 19:37:17.468750 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.468615 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxd9f\" (UniqueName: \"kubernetes.io/projected/bdbaf1ca-2ec1-4a58-a0c6-fac4088c2a31-kube-api-access-sxd9f\") pod \"iptables-alerter-rbttl\" (UID: \"bdbaf1ca-2ec1-4a58-a0c6-fac4088c2a31\") " pod="openshift-network-operator/iptables-alerter-rbttl" Jul 21 19:37:17.468750 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.468635 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-etc-modprobe-d\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.468750 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.468656 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-sys\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.468750 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.468671 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/926ad8ee-c7f6-43c8-bf81-908b8e6824a8-hosts-file\") pod \"node-resolver-6w4zf\" (UID: \"926ad8ee-c7f6-43c8-bf81-908b8e6824a8\") " pod="openshift-dns/node-resolver-6w4zf" Jul 21 19:37:17.468750 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.468699 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-host-cni-netd\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.468750 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.468724 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.468750 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.468742 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dfb82dd4-3122-4ebb-aabc-84682403809d-dbus\") pod \"global-pull-secret-syncer-q9g56\" (UID: \"dfb82dd4-3122-4ebb-aabc-84682403809d\") " pod="kube-system/global-pull-secret-syncer-q9g56" Jul 21 19:37:17.469112 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.468765 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpzws\" (UniqueName: \"kubernetes.io/projected/7109dc26-f036-4ea0-9e29-6a0eb3fa9c43-kube-api-access-mpzws\") pod \"aws-ebs-csi-driver-node-l4fmz\" (UID: \"7109dc26-f036-4ea0-9e29-6a0eb3fa9c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4fmz" Jul 21 19:37:17.469112 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.468772 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-host-cni-netd\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.469112 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.468788 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bdbaf1ca-2ec1-4a58-a0c6-fac4088c2a31-iptables-alerter-script\") pod \"iptables-alerter-rbttl\" (UID: \"bdbaf1ca-2ec1-4a58-a0c6-fac4088c2a31\") " pod="openshift-network-operator/iptables-alerter-rbttl" Jul 21 19:37:17.469112 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.468792 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.469112 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.468813 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/def7fd0e-546e-453b-ab49-665ae20835fe-cni-binary-copy\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.469112 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.468844 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f45d30e4-e0ba-4f2c-a765-d2f56fad780f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2nv6g\" (UID: \"f45d30e4-e0ba-4f2c-a765-d2f56fad780f\") " pod="openshift-multus/multus-additional-cni-plugins-2nv6g" Jul 21 19:37:17.469112 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.468866 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-lib-modules\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.469112 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.468905 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-log-socket\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.469112 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.468943 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-log-socket\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.469112 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.468953 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/acc2e902-5de8-4233-8a76-1b41791e088f-agent-certs\") pod \"konnectivity-agent-kxpcf\" (UID: \"acc2e902-5de8-4233-8a76-1b41791e088f\") " pod="kube-system/konnectivity-agent-kxpcf" Jul 21 19:37:17.469112 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.468987 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f593837e-f6e2-4b42-aa46-5dbee27cf83a-metrics-certs\") pod \"network-metrics-daemon-wzkph\" (UID: \"f593837e-f6e2-4b42-aa46-5dbee27cf83a\") " pod="openshift-multus/network-metrics-daemon-wzkph" Jul 21 19:37:17.469112 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469011 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ac4304f-d17a-4a74-aacb-1f47fd557e74-host\") pod \"node-ca-g8vsp\" (UID: \"8ac4304f-d17a-4a74-aacb-1f47fd557e74\") " pod="openshift-image-registry/node-ca-g8vsp" Jul 21 19:37:17.469112 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469033 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-system-cni-dir\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.469112 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469056 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-os-release\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.469112 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469079 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-host-var-lib-kubelet\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.469112 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469105 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-host-run-multus-certs\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.469785 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469130 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-host-kubelet\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.469785 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469154 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-host-run-ovn-kubernetes\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.469785 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469178 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/12196bd5-b229-4551-9e02-9c040af87b59-ovnkube-script-lib\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.469785 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469201 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsvgc\" (UniqueName: \"kubernetes.io/projected/12196bd5-b229-4551-9e02-9c040af87b59-kube-api-access-qsvgc\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.469785 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469224 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7109dc26-f036-4ea0-9e29-6a0eb3fa9c43-device-dir\") pod \"aws-ebs-csi-driver-node-l4fmz\" (UID: \"7109dc26-f036-4ea0-9e29-6a0eb3fa9c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4fmz" Jul 21 19:37:17.469785 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469247 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7109dc26-f036-4ea0-9e29-6a0eb3fa9c43-etc-selinux\") pod \"aws-ebs-csi-driver-node-l4fmz\" (UID: \"7109dc26-f036-4ea0-9e29-6a0eb3fa9c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4fmz" Jul 21 19:37:17.469785 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469271 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f45d30e4-e0ba-4f2c-a765-d2f56fad780f-os-release\") pod \"multus-additional-cni-plugins-2nv6g\" (UID: \"f45d30e4-e0ba-4f2c-a765-d2f56fad780f\") " pod="openshift-multus/multus-additional-cni-plugins-2nv6g" Jul 21 19:37:17.469785 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469292 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-tmp\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.469785 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469303 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 21 19:37:17.469785 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469312 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-host-kubelet\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.469785 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469317 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxb7h\" (UniqueName: \"kubernetes.io/projected/9dfa1c3e-9a8f-4813-a991-7072ca083d84-kube-api-access-qxb7h\") pod \"network-check-target-lh2hq\" (UID: \"9dfa1c3e-9a8f-4813-a991-7072ca083d84\") " pod="openshift-network-diagnostics/network-check-target-lh2hq" Jul 21 19:37:17.469785 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469349 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-node-log\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.469785 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469374 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f45d30e4-e0ba-4f2c-a765-d2f56fad780f-cnibin\") pod \"multus-additional-cni-plugins-2nv6g\" (UID: \"f45d30e4-e0ba-4f2c-a765-d2f56fad780f\") " pod="openshift-multus/multus-additional-cni-plugins-2nv6g" Jul 21 19:37:17.469785 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469404 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8dsw\" (UniqueName: \"kubernetes.io/projected/f593837e-f6e2-4b42-aa46-5dbee27cf83a-kube-api-access-k8dsw\") pod \"network-metrics-daemon-wzkph\" (UID: \"f593837e-f6e2-4b42-aa46-5dbee27cf83a\") " pod="openshift-multus/network-metrics-daemon-wzkph" Jul 21 19:37:17.469785 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469433 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bdbaf1ca-2ec1-4a58-a0c6-fac4088c2a31-host-slash\") pod \"iptables-alerter-rbttl\" (UID: \"bdbaf1ca-2ec1-4a58-a0c6-fac4088c2a31\") " pod="openshift-network-operator/iptables-alerter-rbttl" Jul 21 19:37:17.469785 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469454 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/926ad8ee-c7f6-43c8-bf81-908b8e6824a8-tmp-dir\") pod \"node-resolver-6w4zf\" (UID: \"926ad8ee-c7f6-43c8-bf81-908b8e6824a8\") " pod="openshift-dns/node-resolver-6w4zf" Jul 21 19:37:17.469785 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469478 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-host-run-netns\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.470623 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469548 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-host-run-ovn-kubernetes\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.470623 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469566 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-host-run-netns\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.470623 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469575 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-node-log\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.470623 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469587 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-run-systemd\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.470623 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469626 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcbvz\" (UniqueName: \"kubernetes.io/projected/8ac4304f-d17a-4a74-aacb-1f47fd557e74-kube-api-access-fcbvz\") pod \"node-ca-g8vsp\" (UID: \"8ac4304f-d17a-4a74-aacb-1f47fd557e74\") " pod="openshift-image-registry/node-ca-g8vsp" Jul 21 19:37:17.470623 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469667 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-run-systemd\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.470623 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469707 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-host\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.470623 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469738 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-host-slash\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.470623 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469782 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-var-lib-openvswitch\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.470623 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469792 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-host-slash\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.470623 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469819 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-host-var-lib-cni-bin\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.470623 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469820 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-var-lib-openvswitch\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.470623 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469850 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttzpj\" (UniqueName: \"kubernetes.io/projected/f45d30e4-e0ba-4f2c-a765-d2f56fad780f-kube-api-access-ttzpj\") pod \"multus-additional-cni-plugins-2nv6g\" (UID: \"f45d30e4-e0ba-4f2c-a765-d2f56fad780f\") " pod="openshift-multus/multus-additional-cni-plugins-2nv6g" Jul 21 19:37:17.470623 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469909 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-run\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.470623 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.469946 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/12196bd5-b229-4551-9e02-9c040af87b59-env-overrides\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.470623 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470017 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-host-run-netns\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.470623 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470051 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f45d30e4-e0ba-4f2c-a765-d2f56fad780f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2nv6g\" (UID: \"f45d30e4-e0ba-4f2c-a765-d2f56fad780f\") " pod="openshift-multus/multus-additional-cni-plugins-2nv6g" Jul 21 19:37:17.471424 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470078 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-hostroot\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.471424 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470107 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-run-openvswitch\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.471424 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470110 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/12196bd5-b229-4551-9e02-9c040af87b59-ovnkube-script-lib\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.471424 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470130 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-host-cni-bin\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.471424 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470155 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/acc2e902-5de8-4233-8a76-1b41791e088f-konnectivity-ca\") pod \"konnectivity-agent-kxpcf\" (UID: \"acc2e902-5de8-4233-8a76-1b41791e088f\") " pod="kube-system/konnectivity-agent-kxpcf" Jul 21 19:37:17.471424 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470182 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f45d30e4-e0ba-4f2c-a765-d2f56fad780f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2nv6g\" (UID: \"f45d30e4-e0ba-4f2c-a765-d2f56fad780f\") " pod="openshift-multus/multus-additional-cni-plugins-2nv6g" Jul 21 19:37:17.471424 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470194 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-run-openvswitch\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.471424 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470201 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-host-cni-bin\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.471424 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470206 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxqqx\" (UniqueName: \"kubernetes.io/projected/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-kube-api-access-xxqqx\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.471424 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470261 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-etc-tuned\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.471424 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470288 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-etc-kubernetes\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.471424 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470321 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/12196bd5-b229-4551-9e02-9c040af87b59-env-overrides\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.471424 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470334 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-etc-openvswitch\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.471424 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470360 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/12196bd5-b229-4551-9e02-9c040af87b59-ovn-node-metrics-cert\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.471424 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470390 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-etc-openvswitch\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.471424 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470422 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfb82dd4-3122-4ebb-aabc-84682403809d-original-pull-secret\") pod \"global-pull-secret-syncer-q9g56\" (UID: \"dfb82dd4-3122-4ebb-aabc-84682403809d\") " pod="kube-system/global-pull-secret-syncer-q9g56" Jul 21 19:37:17.471424 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470447 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7109dc26-f036-4ea0-9e29-6a0eb3fa9c43-socket-dir\") pod \"aws-ebs-csi-driver-node-l4fmz\" (UID: \"7109dc26-f036-4ea0-9e29-6a0eb3fa9c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4fmz" Jul 21 19:37:17.472195 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470482 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7109dc26-f036-4ea0-9e29-6a0eb3fa9c43-sys-fs\") pod \"aws-ebs-csi-driver-node-l4fmz\" (UID: \"7109dc26-f036-4ea0-9e29-6a0eb3fa9c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4fmz" Jul 21 19:37:17.472195 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470505 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8ac4304f-d17a-4a74-aacb-1f47fd557e74-serviceca\") pod \"node-ca-g8vsp\" (UID: \"8ac4304f-d17a-4a74-aacb-1f47fd557e74\") " pod="openshift-image-registry/node-ca-g8vsp" Jul 21 19:37:17.472195 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470526 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-multus-cni-dir\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.472195 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470560 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-host-run-k8s-cni-cncf-io\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.472195 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470590 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7109dc26-f036-4ea0-9e29-6a0eb3fa9c43-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l4fmz\" (UID: \"7109dc26-f036-4ea0-9e29-6a0eb3fa9c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4fmz" Jul 21 19:37:17.472195 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470617 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-cnibin\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.472195 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470653 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-multus-socket-dir-parent\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.472195 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470676 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/acc2e902-5de8-4233-8a76-1b41791e088f-konnectivity-ca\") pod \"konnectivity-agent-kxpcf\" (UID: \"acc2e902-5de8-4233-8a76-1b41791e088f\") " pod="kube-system/konnectivity-agent-kxpcf" Jul 21 19:37:17.472195 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470691 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-host-var-lib-cni-multus\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.472195 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470755 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-multus-conf-dir\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.472195 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470772 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/def7fd0e-546e-453b-ab49-665ae20835fe-multus-daemon-config\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.472195 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470798 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-etc-kubernetes\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.472195 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470814 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-systemd-units\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.472195 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470837 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/12196bd5-b229-4551-9e02-9c040af87b59-ovnkube-config\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.472195 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470850 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/12196bd5-b229-4551-9e02-9c040af87b59-systemd-units\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.472195 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470862 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f45d30e4-e0ba-4f2c-a765-d2f56fad780f-cni-binary-copy\") pod \"multus-additional-cni-plugins-2nv6g\" (UID: \"f45d30e4-e0ba-4f2c-a765-d2f56fad780f\") " pod="openshift-multus/multus-additional-cni-plugins-2nv6g" Jul 21 19:37:17.472195 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470920 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-etc-sysconfig\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.472983 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.470942 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-var-lib-kubelet\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.472983 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.471008 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k7r9\" (UniqueName: \"kubernetes.io/projected/926ad8ee-c7f6-43c8-bf81-908b8e6824a8-kube-api-access-7k7r9\") pod \"node-resolver-6w4zf\" (UID: \"926ad8ee-c7f6-43c8-bf81-908b8e6824a8\") " pod="openshift-dns/node-resolver-6w4zf" Jul 21 19:37:17.472983 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.471317 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/12196bd5-b229-4551-9e02-9c040af87b59-ovnkube-config\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.473495 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.473461 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/12196bd5-b229-4551-9e02-9c040af87b59-ovn-node-metrics-cert\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.473578 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.473538 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/acc2e902-5de8-4233-8a76-1b41791e088f-agent-certs\") pod \"konnectivity-agent-kxpcf\" (UID: \"acc2e902-5de8-4233-8a76-1b41791e088f\") " pod="kube-system/konnectivity-agent-kxpcf" Jul 21 19:37:17.476866 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:17.476848 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 19:37:17.476866 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:17.476871 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 19:37:17.477071 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:17.476884 2581 projected.go:196] Error preparing data for projected volume kube-api-access-qxb7h for pod openshift-network-diagnostics/network-check-target-lh2hq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 19:37:17.477071 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:17.476970 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dfa1c3e-9a8f-4813-a991-7072ca083d84-kube-api-access-qxb7h podName:9dfa1c3e-9a8f-4813-a991-7072ca083d84 nodeName:}" failed. No retries permitted until 2026-07-21 19:37:17.976949999 +0000 UTC m=+2.936962412 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qxb7h" (UniqueName: "kubernetes.io/projected/9dfa1c3e-9a8f-4813-a991-7072ca083d84-kube-api-access-qxb7h") pod "network-check-target-lh2hq" (UID: "9dfa1c3e-9a8f-4813-a991-7072ca083d84") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 19:37:17.479459 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.479435 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsvgc\" (UniqueName: \"kubernetes.io/projected/12196bd5-b229-4551-9e02-9c040af87b59-kube-api-access-qsvgc\") pod \"ovnkube-node-gnxn2\" (UID: \"12196bd5-b229-4551-9e02-9c040af87b59\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.534132 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.534083 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-5.ec2.internal" event={"ID":"bde857cbb1c0b9ad930985637a279229","Type":"ContainerStarted","Data":"aacf612599c2a6aa0f12583acaac1f22cc0f602e912141c891675f9aa5a88198"} Jul 21 19:37:17.535299 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.535271 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-5.ec2.internal" event={"ID":"8a3204fb4289b17b665b5abcf953c874","Type":"ContainerStarted","Data":"ce1b81d53073427e6018e5a11d2767da5ad58a71bb8fba8006f8741ff0754e53"} Jul 21 19:37:17.571238 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.571211 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f45d30e4-e0ba-4f2c-a765-d2f56fad780f-system-cni-dir\") pod \"multus-additional-cni-plugins-2nv6g\" (UID: \"f45d30e4-e0ba-4f2c-a765-d2f56fad780f\") " pod="openshift-multus/multus-additional-cni-plugins-2nv6g" Jul 21 19:37:17.571367 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.571250 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-etc-sysctl-d\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.571367 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.571272 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-etc-sysctl-conf\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.571367 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.571315 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-etc-systemd\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.571367 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.571322 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f45d30e4-e0ba-4f2c-a765-d2f56fad780f-system-cni-dir\") pod \"multus-additional-cni-plugins-2nv6g\" (UID: \"f45d30e4-e0ba-4f2c-a765-d2f56fad780f\") " pod="openshift-multus/multus-additional-cni-plugins-2nv6g" Jul 21 19:37:17.571367 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.571362 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dfb82dd4-3122-4ebb-aabc-84682403809d-kubelet-config\") pod \"global-pull-secret-syncer-q9g56\" (UID: \"dfb82dd4-3122-4ebb-aabc-84682403809d\") " pod="kube-system/global-pull-secret-syncer-q9g56" Jul 21 19:37:17.571600 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.571368 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-etc-systemd\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.571600 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.571396 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7109dc26-f036-4ea0-9e29-6a0eb3fa9c43-registration-dir\") pod \"aws-ebs-csi-driver-node-l4fmz\" (UID: \"7109dc26-f036-4ea0-9e29-6a0eb3fa9c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4fmz" Jul 21 19:37:17.571600 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.571412 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dfb82dd4-3122-4ebb-aabc-84682403809d-kubelet-config\") pod \"global-pull-secret-syncer-q9g56\" (UID: \"dfb82dd4-3122-4ebb-aabc-84682403809d\") " pod="kube-system/global-pull-secret-syncer-q9g56" Jul 21 19:37:17.571600 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.571420 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxd9f\" (UniqueName: \"kubernetes.io/projected/bdbaf1ca-2ec1-4a58-a0c6-fac4088c2a31-kube-api-access-sxd9f\") pod \"iptables-alerter-rbttl\" (UID: \"bdbaf1ca-2ec1-4a58-a0c6-fac4088c2a31\") " pod="openshift-network-operator/iptables-alerter-rbttl" Jul 21 19:37:17.571600 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.571427 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-etc-sysctl-d\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.571600 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.571442 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-etc-modprobe-d\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.571600 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.571466 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-etc-sysctl-conf\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.571600 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.571476 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-sys\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.571600 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.571514 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/926ad8ee-c7f6-43c8-bf81-908b8e6824a8-hosts-file\") pod \"node-resolver-6w4zf\" (UID: \"926ad8ee-c7f6-43c8-bf81-908b8e6824a8\") " pod="openshift-dns/node-resolver-6w4zf" Jul 21 19:37:17.571600 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.571515 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7109dc26-f036-4ea0-9e29-6a0eb3fa9c43-registration-dir\") pod \"aws-ebs-csi-driver-node-l4fmz\" (UID: \"7109dc26-f036-4ea0-9e29-6a0eb3fa9c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4fmz" Jul 21 19:37:17.571600 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.571515 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-etc-modprobe-d\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.571600 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.571514 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-sys\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.571600 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.571537 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dfb82dd4-3122-4ebb-aabc-84682403809d-dbus\") pod \"global-pull-secret-syncer-q9g56\" (UID: \"dfb82dd4-3122-4ebb-aabc-84682403809d\") " pod="kube-system/global-pull-secret-syncer-q9g56" Jul 21 19:37:17.571600 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.571553 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/926ad8ee-c7f6-43c8-bf81-908b8e6824a8-hosts-file\") pod \"node-resolver-6w4zf\" (UID: \"926ad8ee-c7f6-43c8-bf81-908b8e6824a8\") " pod="openshift-dns/node-resolver-6w4zf" Jul 21 19:37:17.571600 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.571565 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpzws\" (UniqueName: \"kubernetes.io/projected/7109dc26-f036-4ea0-9e29-6a0eb3fa9c43-kube-api-access-mpzws\") pod \"aws-ebs-csi-driver-node-l4fmz\" (UID: \"7109dc26-f036-4ea0-9e29-6a0eb3fa9c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4fmz" Jul 21 19:37:17.571600 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.571589 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bdbaf1ca-2ec1-4a58-a0c6-fac4088c2a31-iptables-alerter-script\") pod \"iptables-alerter-rbttl\" (UID: \"bdbaf1ca-2ec1-4a58-a0c6-fac4088c2a31\") " pod="openshift-network-operator/iptables-alerter-rbttl" Jul 21 19:37:17.571600 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.571609 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/def7fd0e-546e-453b-ab49-665ae20835fe-cni-binary-copy\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.572445 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.571630 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f45d30e4-e0ba-4f2c-a765-d2f56fad780f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2nv6g\" (UID: \"f45d30e4-e0ba-4f2c-a765-d2f56fad780f\") " pod="openshift-multus/multus-additional-cni-plugins-2nv6g" Jul 21 19:37:17.572445 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.571711 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dfb82dd4-3122-4ebb-aabc-84682403809d-dbus\") pod \"global-pull-secret-syncer-q9g56\" (UID: \"dfb82dd4-3122-4ebb-aabc-84682403809d\") " pod="kube-system/global-pull-secret-syncer-q9g56" Jul 21 19:37:17.572445 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.571743 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-lib-modules\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.572445 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.571797 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f593837e-f6e2-4b42-aa46-5dbee27cf83a-metrics-certs\") pod \"network-metrics-daemon-wzkph\" (UID: \"f593837e-f6e2-4b42-aa46-5dbee27cf83a\") " pod="openshift-multus/network-metrics-daemon-wzkph" Jul 21 19:37:17.572445 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.571829 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ac4304f-d17a-4a74-aacb-1f47fd557e74-host\") pod \"node-ca-g8vsp\" (UID: \"8ac4304f-d17a-4a74-aacb-1f47fd557e74\") " pod="openshift-image-registry/node-ca-g8vsp" Jul 21 19:37:17.572445 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.571855 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-system-cni-dir\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.572445 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.571878 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-os-release\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.572445 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.571916 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-lib-modules\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.572445 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.571927 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ac4304f-d17a-4a74-aacb-1f47fd557e74-host\") pod \"node-ca-g8vsp\" (UID: \"8ac4304f-d17a-4a74-aacb-1f47fd557e74\") " pod="openshift-image-registry/node-ca-g8vsp" Jul 21 19:37:17.572445 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.571918 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-host-var-lib-kubelet\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.572445 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.571960 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-host-var-lib-kubelet\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.572445 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:17.571998 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 19:37:17.572445 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572036 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-host-run-multus-certs\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.572445 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572063 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-host-run-multus-certs\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.572445 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572072 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7109dc26-f036-4ea0-9e29-6a0eb3fa9c43-device-dir\") pod \"aws-ebs-csi-driver-node-l4fmz\" (UID: \"7109dc26-f036-4ea0-9e29-6a0eb3fa9c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4fmz" Jul 21 19:37:17.572445 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:17.572104 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f593837e-f6e2-4b42-aa46-5dbee27cf83a-metrics-certs podName:f593837e-f6e2-4b42-aa46-5dbee27cf83a nodeName:}" failed. No retries permitted until 2026-07-21 19:37:18.072084293 +0000 UTC m=+3.032096705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f593837e-f6e2-4b42-aa46-5dbee27cf83a-metrics-certs") pod "network-metrics-daemon-wzkph" (UID: "f593837e-f6e2-4b42-aa46-5dbee27cf83a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 19:37:17.572445 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572116 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7109dc26-f036-4ea0-9e29-6a0eb3fa9c43-device-dir\") pod \"aws-ebs-csi-driver-node-l4fmz\" (UID: \"7109dc26-f036-4ea0-9e29-6a0eb3fa9c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4fmz" Jul 21 19:37:17.573285 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572104 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-system-cni-dir\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.573285 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572130 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7109dc26-f036-4ea0-9e29-6a0eb3fa9c43-etc-selinux\") pod \"aws-ebs-csi-driver-node-l4fmz\" (UID: \"7109dc26-f036-4ea0-9e29-6a0eb3fa9c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4fmz" Jul 21 19:37:17.573285 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572159 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f45d30e4-e0ba-4f2c-a765-d2f56fad780f-os-release\") pod \"multus-additional-cni-plugins-2nv6g\" (UID: \"f45d30e4-e0ba-4f2c-a765-d2f56fad780f\") " pod="openshift-multus/multus-additional-cni-plugins-2nv6g" Jul 21 19:37:17.573285 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572100 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-os-release\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.573285 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572189 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-tmp\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.573285 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572213 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7109dc26-f036-4ea0-9e29-6a0eb3fa9c43-etc-selinux\") pod \"aws-ebs-csi-driver-node-l4fmz\" (UID: \"7109dc26-f036-4ea0-9e29-6a0eb3fa9c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4fmz" Jul 21 19:37:17.573285 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572226 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f45d30e4-e0ba-4f2c-a765-d2f56fad780f-cnibin\") pod \"multus-additional-cni-plugins-2nv6g\" (UID: \"f45d30e4-e0ba-4f2c-a765-d2f56fad780f\") " pod="openshift-multus/multus-additional-cni-plugins-2nv6g" Jul 21 19:37:17.573285 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572227 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f45d30e4-e0ba-4f2c-a765-d2f56fad780f-os-release\") pod \"multus-additional-cni-plugins-2nv6g\" (UID: \"f45d30e4-e0ba-4f2c-a765-d2f56fad780f\") " pod="openshift-multus/multus-additional-cni-plugins-2nv6g" Jul 21 19:37:17.573285 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572231 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/def7fd0e-546e-453b-ab49-665ae20835fe-cni-binary-copy\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.573285 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572256 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8dsw\" (UniqueName: \"kubernetes.io/projected/f593837e-f6e2-4b42-aa46-5dbee27cf83a-kube-api-access-k8dsw\") pod \"network-metrics-daemon-wzkph\" (UID: \"f593837e-f6e2-4b42-aa46-5dbee27cf83a\") " pod="openshift-multus/network-metrics-daemon-wzkph" Jul 21 19:37:17.573285 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572278 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f45d30e4-e0ba-4f2c-a765-d2f56fad780f-cnibin\") pod \"multus-additional-cni-plugins-2nv6g\" (UID: \"f45d30e4-e0ba-4f2c-a765-d2f56fad780f\") " pod="openshift-multus/multus-additional-cni-plugins-2nv6g" Jul 21 19:37:17.573285 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572257 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bdbaf1ca-2ec1-4a58-a0c6-fac4088c2a31-iptables-alerter-script\") pod \"iptables-alerter-rbttl\" (UID: \"bdbaf1ca-2ec1-4a58-a0c6-fac4088c2a31\") " pod="openshift-network-operator/iptables-alerter-rbttl" Jul 21 19:37:17.573285 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572280 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bdbaf1ca-2ec1-4a58-a0c6-fac4088c2a31-host-slash\") pod \"iptables-alerter-rbttl\" (UID: \"bdbaf1ca-2ec1-4a58-a0c6-fac4088c2a31\") " pod="openshift-network-operator/iptables-alerter-rbttl" Jul 21 19:37:17.573285 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572318 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bdbaf1ca-2ec1-4a58-a0c6-fac4088c2a31-host-slash\") pod \"iptables-alerter-rbttl\" (UID: \"bdbaf1ca-2ec1-4a58-a0c6-fac4088c2a31\") " pod="openshift-network-operator/iptables-alerter-rbttl" Jul 21 19:37:17.573285 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572345 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/926ad8ee-c7f6-43c8-bf81-908b8e6824a8-tmp-dir\") pod \"node-resolver-6w4zf\" (UID: \"926ad8ee-c7f6-43c8-bf81-908b8e6824a8\") " pod="openshift-dns/node-resolver-6w4zf" Jul 21 19:37:17.573285 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572358 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f45d30e4-e0ba-4f2c-a765-d2f56fad780f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2nv6g\" (UID: \"f45d30e4-e0ba-4f2c-a765-d2f56fad780f\") " pod="openshift-multus/multus-additional-cni-plugins-2nv6g" Jul 21 19:37:17.573285 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572379 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcbvz\" (UniqueName: \"kubernetes.io/projected/8ac4304f-d17a-4a74-aacb-1f47fd557e74-kube-api-access-fcbvz\") pod \"node-ca-g8vsp\" (UID: \"8ac4304f-d17a-4a74-aacb-1f47fd557e74\") " pod="openshift-image-registry/node-ca-g8vsp" Jul 21 19:37:17.574042 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572403 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-host\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.574042 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572431 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-host-var-lib-cni-bin\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.574042 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572455 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttzpj\" (UniqueName: \"kubernetes.io/projected/f45d30e4-e0ba-4f2c-a765-d2f56fad780f-kube-api-access-ttzpj\") pod \"multus-additional-cni-plugins-2nv6g\" (UID: \"f45d30e4-e0ba-4f2c-a765-d2f56fad780f\") " pod="openshift-multus/multus-additional-cni-plugins-2nv6g" Jul 21 19:37:17.574042 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572478 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-run\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.574042 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572504 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-host-run-netns\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.574042 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572518 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-host-var-lib-cni-bin\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.574042 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572528 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f45d30e4-e0ba-4f2c-a765-d2f56fad780f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2nv6g\" (UID: \"f45d30e4-e0ba-4f2c-a765-d2f56fad780f\") " pod="openshift-multus/multus-additional-cni-plugins-2nv6g" Jul 21 19:37:17.574042 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572569 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-hostroot\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.574042 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572597 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/926ad8ee-c7f6-43c8-bf81-908b8e6824a8-tmp-dir\") pod \"node-resolver-6w4zf\" (UID: \"926ad8ee-c7f6-43c8-bf81-908b8e6824a8\") " pod="openshift-dns/node-resolver-6w4zf" Jul 21 19:37:17.574042 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572603 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f45d30e4-e0ba-4f2c-a765-d2f56fad780f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2nv6g\" (UID: \"f45d30e4-e0ba-4f2c-a765-d2f56fad780f\") " pod="openshift-multus/multus-additional-cni-plugins-2nv6g" Jul 21 19:37:17.574042 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572629 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxqqx\" (UniqueName: \"kubernetes.io/projected/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-kube-api-access-xxqqx\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.574042 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572654 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-etc-tuned\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.574042 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572678 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-etc-kubernetes\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.574042 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572692 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-host\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.574042 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572704 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfb82dd4-3122-4ebb-aabc-84682403809d-original-pull-secret\") pod \"global-pull-secret-syncer-q9g56\" (UID: \"dfb82dd4-3122-4ebb-aabc-84682403809d\") " pod="kube-system/global-pull-secret-syncer-q9g56" Jul 21 19:37:17.574042 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572730 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7109dc26-f036-4ea0-9e29-6a0eb3fa9c43-socket-dir\") pod \"aws-ebs-csi-driver-node-l4fmz\" (UID: \"7109dc26-f036-4ea0-9e29-6a0eb3fa9c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4fmz" Jul 21 19:37:17.574042 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572735 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-host-run-netns\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.574720 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572755 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7109dc26-f036-4ea0-9e29-6a0eb3fa9c43-sys-fs\") pod \"aws-ebs-csi-driver-node-l4fmz\" (UID: \"7109dc26-f036-4ea0-9e29-6a0eb3fa9c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4fmz" Jul 21 19:37:17.574720 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572779 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8ac4304f-d17a-4a74-aacb-1f47fd557e74-serviceca\") pod \"node-ca-g8vsp\" (UID: \"8ac4304f-d17a-4a74-aacb-1f47fd557e74\") " pod="openshift-image-registry/node-ca-g8vsp" Jul 21 19:37:17.574720 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:17.572844 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 19:37:17.574720 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:17.572924 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfb82dd4-3122-4ebb-aabc-84682403809d-original-pull-secret podName:dfb82dd4-3122-4ebb-aabc-84682403809d nodeName:}" failed. No retries permitted until 2026-07-21 19:37:18.072886129 +0000 UTC m=+3.032898549 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dfb82dd4-3122-4ebb-aabc-84682403809d-original-pull-secret") pod "global-pull-secret-syncer-q9g56" (UID: "dfb82dd4-3122-4ebb-aabc-84682403809d") : object "kube-system"/"original-pull-secret" not registered Jul 21 19:37:17.574720 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572931 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7109dc26-f036-4ea0-9e29-6a0eb3fa9c43-socket-dir\") pod \"aws-ebs-csi-driver-node-l4fmz\" (UID: \"7109dc26-f036-4ea0-9e29-6a0eb3fa9c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4fmz" Jul 21 19:37:17.574720 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572655 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-hostroot\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.574720 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572984 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-etc-kubernetes\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.574720 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572997 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-multus-cni-dir\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.574720 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.573041 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-host-run-k8s-cni-cncf-io\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.574720 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.573070 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7109dc26-f036-4ea0-9e29-6a0eb3fa9c43-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l4fmz\" (UID: \"7109dc26-f036-4ea0-9e29-6a0eb3fa9c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4fmz" Jul 21 19:37:17.574720 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.573098 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-cnibin\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.574720 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.573125 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-multus-socket-dir-parent\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.574720 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.573148 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f45d30e4-e0ba-4f2c-a765-d2f56fad780f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2nv6g\" (UID: \"f45d30e4-e0ba-4f2c-a765-d2f56fad780f\") " pod="openshift-multus/multus-additional-cni-plugins-2nv6g" Jul 21 19:37:17.574720 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.573150 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-host-var-lib-cni-multus\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.574720 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.573195 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-multus-conf-dir\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.574720 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572999 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f45d30e4-e0ba-4f2c-a765-d2f56fad780f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2nv6g\" (UID: \"f45d30e4-e0ba-4f2c-a765-d2f56fad780f\") " pod="openshift-multus/multus-additional-cni-plugins-2nv6g" Jul 21 19:37:17.574720 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.573224 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/def7fd0e-546e-453b-ab49-665ae20835fe-multus-daemon-config\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.575444 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.573244 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-etc-kubernetes\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.575444 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.573248 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-host-run-k8s-cni-cncf-io\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.575444 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.573001 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7109dc26-f036-4ea0-9e29-6a0eb3fa9c43-sys-fs\") pod \"aws-ebs-csi-driver-node-l4fmz\" (UID: \"7109dc26-f036-4ea0-9e29-6a0eb3fa9c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4fmz" Jul 21 19:37:17.575444 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.573262 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f45d30e4-e0ba-4f2c-a765-d2f56fad780f-cni-binary-copy\") pod \"multus-additional-cni-plugins-2nv6g\" (UID: \"f45d30e4-e0ba-4f2c-a765-d2f56fad780f\") " pod="openshift-multus/multus-additional-cni-plugins-2nv6g" Jul 21 19:37:17.575444 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.573272 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-multus-conf-dir\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.575444 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.572630 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-run\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.575444 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.573294 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-etc-sysconfig\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.575444 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.573320 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-var-lib-kubelet\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.575444 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.573348 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k7r9\" (UniqueName: \"kubernetes.io/projected/926ad8ee-c7f6-43c8-bf81-908b8e6824a8-kube-api-access-7k7r9\") pod \"node-resolver-6w4zf\" (UID: \"926ad8ee-c7f6-43c8-bf81-908b8e6824a8\") " pod="openshift-dns/node-resolver-6w4zf" Jul 21 19:37:17.575444 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.573376 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nvmd\" (UniqueName: \"kubernetes.io/projected/def7fd0e-546e-453b-ab49-665ae20835fe-kube-api-access-7nvmd\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.575444 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.573419 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8ac4304f-d17a-4a74-aacb-1f47fd557e74-serviceca\") pod \"node-ca-g8vsp\" (UID: \"8ac4304f-d17a-4a74-aacb-1f47fd557e74\") " pod="openshift-image-registry/node-ca-g8vsp" Jul 21 19:37:17.575444 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.573479 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-etc-kubernetes\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.575444 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.573539 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-multus-socket-dir-parent\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.575444 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.573580 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f45d30e4-e0ba-4f2c-a765-d2f56fad780f-cni-binary-copy\") pod \"multus-additional-cni-plugins-2nv6g\" (UID: \"f45d30e4-e0ba-4f2c-a765-d2f56fad780f\") " pod="openshift-multus/multus-additional-cni-plugins-2nv6g" Jul 21 19:37:17.575444 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.573591 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7109dc26-f036-4ea0-9e29-6a0eb3fa9c43-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l4fmz\" (UID: \"7109dc26-f036-4ea0-9e29-6a0eb3fa9c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4fmz" Jul 21 19:37:17.575444 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.573195 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-host-var-lib-cni-multus\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.575444 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.573636 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-var-lib-kubelet\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.575444 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.573640 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-cnibin\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.576073 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.573071 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/def7fd0e-546e-453b-ab49-665ae20835fe-multus-cni-dir\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.576073 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.573680 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-etc-sysconfig\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.576073 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.573725 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/def7fd0e-546e-453b-ab49-665ae20835fe-multus-daemon-config\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.576073 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.575033 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-etc-tuned\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.576073 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.575085 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-tmp\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.581086 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.581068 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxd9f\" (UniqueName: \"kubernetes.io/projected/bdbaf1ca-2ec1-4a58-a0c6-fac4088c2a31-kube-api-access-sxd9f\") pod \"iptables-alerter-rbttl\" (UID: \"bdbaf1ca-2ec1-4a58-a0c6-fac4088c2a31\") " pod="openshift-network-operator/iptables-alerter-rbttl" Jul 21 19:37:17.581818 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.581799 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpzws\" (UniqueName: \"kubernetes.io/projected/7109dc26-f036-4ea0-9e29-6a0eb3fa9c43-kube-api-access-mpzws\") pod \"aws-ebs-csi-driver-node-l4fmz\" (UID: \"7109dc26-f036-4ea0-9e29-6a0eb3fa9c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4fmz" Jul 21 19:37:17.581934 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.581804 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8dsw\" (UniqueName: \"kubernetes.io/projected/f593837e-f6e2-4b42-aa46-5dbee27cf83a-kube-api-access-k8dsw\") pod \"network-metrics-daemon-wzkph\" (UID: \"f593837e-f6e2-4b42-aa46-5dbee27cf83a\") " pod="openshift-multus/network-metrics-daemon-wzkph" Jul 21 19:37:17.584763 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.584735 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcbvz\" (UniqueName: \"kubernetes.io/projected/8ac4304f-d17a-4a74-aacb-1f47fd557e74-kube-api-access-fcbvz\") pod \"node-ca-g8vsp\" (UID: \"8ac4304f-d17a-4a74-aacb-1f47fd557e74\") " pod="openshift-image-registry/node-ca-g8vsp" Jul 21 19:37:17.585459 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.585432 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxqqx\" (UniqueName: \"kubernetes.io/projected/e0f9e409-ce13-4b2f-a7e0-233fa5d06f12-kube-api-access-xxqqx\") pod \"tuned-8x7vz\" (UID: \"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12\") " pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.585580 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.585561 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttzpj\" (UniqueName: \"kubernetes.io/projected/f45d30e4-e0ba-4f2c-a765-d2f56fad780f-kube-api-access-ttzpj\") pod \"multus-additional-cni-plugins-2nv6g\" (UID: \"f45d30e4-e0ba-4f2c-a765-d2f56fad780f\") " pod="openshift-multus/multus-additional-cni-plugins-2nv6g" Jul 21 19:37:17.586721 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.586703 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k7r9\" (UniqueName: \"kubernetes.io/projected/926ad8ee-c7f6-43c8-bf81-908b8e6824a8-kube-api-access-7k7r9\") pod \"node-resolver-6w4zf\" (UID: \"926ad8ee-c7f6-43c8-bf81-908b8e6824a8\") " pod="openshift-dns/node-resolver-6w4zf" Jul 21 19:37:17.595482 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.595438 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nvmd\" (UniqueName: \"kubernetes.io/projected/def7fd0e-546e-453b-ab49-665ae20835fe-kube-api-access-7nvmd\") pod \"multus-5m4hj\" (UID: \"def7fd0e-546e-453b-ab49-665ae20835fe\") " pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.670592 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.670555 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:17.678411 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.678393 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kxpcf" Jul 21 19:37:17.690001 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.689971 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5m4hj" Jul 21 19:37:17.695567 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.695551 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2nv6g" Jul 21 19:37:17.703204 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.703186 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" Jul 21 19:37:17.711850 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.711829 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6w4zf" Jul 21 19:37:17.718401 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.718384 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4fmz" Jul 21 19:37:17.724783 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.724767 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g8vsp" Jul 21 19:37:17.731106 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:17.731086 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rbttl" Jul 21 19:37:18.077086 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:18.077023 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfb82dd4-3122-4ebb-aabc-84682403809d-original-pull-secret\") pod \"global-pull-secret-syncer-q9g56\" (UID: \"dfb82dd4-3122-4ebb-aabc-84682403809d\") " pod="kube-system/global-pull-secret-syncer-q9g56" Jul 21 19:37:18.077220 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:18.077092 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f593837e-f6e2-4b42-aa46-5dbee27cf83a-metrics-certs\") pod \"network-metrics-daemon-wzkph\" (UID: \"f593837e-f6e2-4b42-aa46-5dbee27cf83a\") " pod="openshift-multus/network-metrics-daemon-wzkph" Jul 21 19:37:18.077220 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:18.077125 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxb7h\" (UniqueName: \"kubernetes.io/projected/9dfa1c3e-9a8f-4813-a991-7072ca083d84-kube-api-access-qxb7h\") pod \"network-check-target-lh2hq\" (UID: \"9dfa1c3e-9a8f-4813-a991-7072ca083d84\") " pod="openshift-network-diagnostics/network-check-target-lh2hq" Jul 21 19:37:18.077220 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:18.077169 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 19:37:18.077382 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:18.077234 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 19:37:18.077382 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:18.077243 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfb82dd4-3122-4ebb-aabc-84682403809d-original-pull-secret podName:dfb82dd4-3122-4ebb-aabc-84682403809d nodeName:}" failed. No retries permitted until 2026-07-21 19:37:19.07722206 +0000 UTC m=+4.037234472 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dfb82dd4-3122-4ebb-aabc-84682403809d-original-pull-secret") pod "global-pull-secret-syncer-q9g56" (UID: "dfb82dd4-3122-4ebb-aabc-84682403809d") : object "kube-system"/"original-pull-secret" not registered Jul 21 19:37:18.077382 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:18.077250 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 19:37:18.077382 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:18.077266 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 19:37:18.077382 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:18.077278 2581 projected.go:196] Error preparing data for projected volume kube-api-access-qxb7h for pod openshift-network-diagnostics/network-check-target-lh2hq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 19:37:18.077382 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:18.077281 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f593837e-f6e2-4b42-aa46-5dbee27cf83a-metrics-certs podName:f593837e-f6e2-4b42-aa46-5dbee27cf83a nodeName:}" failed. No retries permitted until 2026-07-21 19:37:19.077267278 +0000 UTC m=+4.037279690 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f593837e-f6e2-4b42-aa46-5dbee27cf83a-metrics-certs") pod "network-metrics-daemon-wzkph" (UID: "f593837e-f6e2-4b42-aa46-5dbee27cf83a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 19:37:18.077382 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:18.077345 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dfa1c3e-9a8f-4813-a991-7072ca083d84-kube-api-access-qxb7h podName:9dfa1c3e-9a8f-4813-a991-7072ca083d84 nodeName:}" failed. No retries permitted until 2026-07-21 19:37:19.077330535 +0000 UTC m=+4.037342960 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qxb7h" (UniqueName: "kubernetes.io/projected/9dfa1c3e-9a8f-4813-a991-7072ca083d84-kube-api-access-qxb7h") pod "network-check-target-lh2hq" (UID: "9dfa1c3e-9a8f-4813-a991-7072ca083d84") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 19:37:18.373211 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:18.373183 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7109dc26_f036_4ea0_9e29_6a0eb3fa9c43.slice/crio-8746994f6027dec1c6352c1cb42c6fda3c781106f6e8f6d31c82e3971586308c WatchSource:0}: Error finding container 8746994f6027dec1c6352c1cb42c6fda3c781106f6e8f6d31c82e3971586308c: Status 404 returned error can't find the container with id 8746994f6027dec1c6352c1cb42c6fda3c781106f6e8f6d31c82e3971586308c Jul 21 19:37:18.377885 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:18.377867 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ac4304f_d17a_4a74_aacb_1f47fd557e74.slice/crio-f3cb91a865406b02424afb248c611f390255cfa68625d95ae3dab4f44e77f5dc WatchSource:0}: Error finding container f3cb91a865406b02424afb248c611f390255cfa68625d95ae3dab4f44e77f5dc: Status 404 returned error can't find the container with id f3cb91a865406b02424afb248c611f390255cfa68625d95ae3dab4f44e77f5dc Jul 21 19:37:18.378581 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:18.378566 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12196bd5_b229_4551_9e02_9c040af87b59.slice/crio-a5cdb77fb14256dbd5a98b3f62054ba5bf9e94b01226afc1b257e6ed2044d1da WatchSource:0}: Error finding container a5cdb77fb14256dbd5a98b3f62054ba5bf9e94b01226afc1b257e6ed2044d1da: Status 404 returned error can't find the container with id a5cdb77fb14256dbd5a98b3f62054ba5bf9e94b01226afc1b257e6ed2044d1da Jul 21 19:37:18.379812 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:18.379790 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddef7fd0e_546e_453b_ab49_665ae20835fe.slice/crio-9d84e1ba4b2036b3a3654ffb6c4b63aea8ccac6223a93f15b0e1ba312464f0e7 WatchSource:0}: Error finding container 9d84e1ba4b2036b3a3654ffb6c4b63aea8ccac6223a93f15b0e1ba312464f0e7: Status 404 returned error can't find the container with id 9d84e1ba4b2036b3a3654ffb6c4b63aea8ccac6223a93f15b0e1ba312464f0e7 Jul 21 19:37:18.380635 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:18.380577 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacc2e902_5de8_4233_8a76_1b41791e088f.slice/crio-6a0cc2936a413c1225dc6d7470879388389a1d368d49111471c3518bf2003e5e WatchSource:0}: Error finding container 6a0cc2936a413c1225dc6d7470879388389a1d368d49111471c3518bf2003e5e: Status 404 returned error can't find the container with id 6a0cc2936a413c1225dc6d7470879388389a1d368d49111471c3518bf2003e5e Jul 21 19:37:18.381638 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:18.381612 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf45d30e4_e0ba_4f2c_a765_d2f56fad780f.slice/crio-4a208308e11e4b23409101bbfd3134fae97f9b4af0a75fa6285515bb32eec7e3 WatchSource:0}: Error finding container 4a208308e11e4b23409101bbfd3134fae97f9b4af0a75fa6285515bb32eec7e3: Status 404 returned error can't find the container with id 4a208308e11e4b23409101bbfd3134fae97f9b4af0a75fa6285515bb32eec7e3 Jul 21 19:37:18.382671 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:18.382645 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0f9e409_ce13_4b2f_a7e0_233fa5d06f12.slice/crio-f7ae6dd902ae0b2d40c46cba2f3ec52cad2f3bc6c565ebbcde93a284661bb264 WatchSource:0}: Error finding container f7ae6dd902ae0b2d40c46cba2f3ec52cad2f3bc6c565ebbcde93a284661bb264: Status 404 returned error can't find the container with id f7ae6dd902ae0b2d40c46cba2f3ec52cad2f3bc6c565ebbcde93a284661bb264 Jul 21 19:37:18.384514 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:18.384423 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod926ad8ee_c7f6_43c8_bf81_908b8e6824a8.slice/crio-9da2f50f941ff02b5ccbdb0616384b1a9fbac0d8a36bcce6361742f819bb147f WatchSource:0}: Error finding container 9da2f50f941ff02b5ccbdb0616384b1a9fbac0d8a36bcce6361742f819bb147f: Status 404 returned error can't find the container with id 9da2f50f941ff02b5ccbdb0616384b1a9fbac0d8a36bcce6361742f819bb147f Jul 21 19:37:18.387616 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:18.385835 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdbaf1ca_2ec1_4a58_a0c6_fac4088c2a31.slice/crio-d3814887b17a93c91425b1799d2a9f6e101389ff7c5748afde570c6ce65a31a8 WatchSource:0}: Error finding container d3814887b17a93c91425b1799d2a9f6e101389ff7c5748afde570c6ce65a31a8: Status 404 returned error can't find the container with id d3814887b17a93c91425b1799d2a9f6e101389ff7c5748afde570c6ce65a31a8 Jul 21 19:37:18.399160 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:18.399127 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 19:32:17 +0000 UTC" deadline="2028-03-16 05:51:51.822694529 +0000 UTC" Jul 21 19:37:18.399160 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:18.399158 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14482h14m33.423540392s" Jul 21 19:37:18.528719 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:18.528697 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh2hq" Jul 21 19:37:18.528828 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:18.528792 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lh2hq" podUID="9dfa1c3e-9a8f-4813-a991-7072ca083d84" Jul 21 19:37:18.542461 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:18.542247 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-5.ec2.internal" event={"ID":"bde857cbb1c0b9ad930985637a279229","Type":"ContainerStarted","Data":"654488cff373b8edfd0af257036da4c6d322a3d67b5d6543ec72356b137d9f90"} Jul 21 19:37:18.543457 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:18.543433 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rbttl" event={"ID":"bdbaf1ca-2ec1-4a58-a0c6-fac4088c2a31","Type":"ContainerStarted","Data":"d3814887b17a93c91425b1799d2a9f6e101389ff7c5748afde570c6ce65a31a8"} Jul 21 19:37:18.544456 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:18.544437 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5m4hj" event={"ID":"def7fd0e-546e-453b-ab49-665ae20835fe","Type":"ContainerStarted","Data":"9d84e1ba4b2036b3a3654ffb6c4b63aea8ccac6223a93f15b0e1ba312464f0e7"} Jul 21 19:37:18.545520 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:18.545493 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" event={"ID":"12196bd5-b229-4551-9e02-9c040af87b59","Type":"ContainerStarted","Data":"a5cdb77fb14256dbd5a98b3f62054ba5bf9e94b01226afc1b257e6ed2044d1da"} Jul 21 19:37:18.546475 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:18.546454 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g8vsp" event={"ID":"8ac4304f-d17a-4a74-aacb-1f47fd557e74","Type":"ContainerStarted","Data":"f3cb91a865406b02424afb248c611f390255cfa68625d95ae3dab4f44e77f5dc"} Jul 21 19:37:18.547353 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:18.547333 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6w4zf" event={"ID":"926ad8ee-c7f6-43c8-bf81-908b8e6824a8","Type":"ContainerStarted","Data":"9da2f50f941ff02b5ccbdb0616384b1a9fbac0d8a36bcce6361742f819bb147f"} Jul 21 19:37:18.548217 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:18.548198 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" event={"ID":"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12","Type":"ContainerStarted","Data":"f7ae6dd902ae0b2d40c46cba2f3ec52cad2f3bc6c565ebbcde93a284661bb264"} Jul 21 19:37:18.549037 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:18.549020 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kxpcf" event={"ID":"acc2e902-5de8-4233-8a76-1b41791e088f","Type":"ContainerStarted","Data":"6a0cc2936a413c1225dc6d7470879388389a1d368d49111471c3518bf2003e5e"} Jul 21 19:37:18.550035 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:18.550018 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2nv6g" event={"ID":"f45d30e4-e0ba-4f2c-a765-d2f56fad780f","Type":"ContainerStarted","Data":"4a208308e11e4b23409101bbfd3134fae97f9b4af0a75fa6285515bb32eec7e3"} Jul 21 19:37:18.550931 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:18.550916 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4fmz" event={"ID":"7109dc26-f036-4ea0-9e29-6a0eb3fa9c43","Type":"ContainerStarted","Data":"8746994f6027dec1c6352c1cb42c6fda3c781106f6e8f6d31c82e3971586308c"} Jul 21 19:37:19.085995 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:19.085956 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f593837e-f6e2-4b42-aa46-5dbee27cf83a-metrics-certs\") pod \"network-metrics-daemon-wzkph\" (UID: \"f593837e-f6e2-4b42-aa46-5dbee27cf83a\") " pod="openshift-multus/network-metrics-daemon-wzkph" Jul 21 19:37:19.086196 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:19.086014 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxb7h\" (UniqueName: \"kubernetes.io/projected/9dfa1c3e-9a8f-4813-a991-7072ca083d84-kube-api-access-qxb7h\") pod \"network-check-target-lh2hq\" (UID: \"9dfa1c3e-9a8f-4813-a991-7072ca083d84\") " pod="openshift-network-diagnostics/network-check-target-lh2hq" Jul 21 19:37:19.086196 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:19.086056 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfb82dd4-3122-4ebb-aabc-84682403809d-original-pull-secret\") pod \"global-pull-secret-syncer-q9g56\" (UID: \"dfb82dd4-3122-4ebb-aabc-84682403809d\") " pod="kube-system/global-pull-secret-syncer-q9g56" Jul 21 19:37:19.086196 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:19.086167 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 19:37:19.086430 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:19.086224 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfb82dd4-3122-4ebb-aabc-84682403809d-original-pull-secret podName:dfb82dd4-3122-4ebb-aabc-84682403809d nodeName:}" failed. No retries permitted until 2026-07-21 19:37:21.086207201 +0000 UTC m=+6.046219618 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dfb82dd4-3122-4ebb-aabc-84682403809d-original-pull-secret") pod "global-pull-secret-syncer-q9g56" (UID: "dfb82dd4-3122-4ebb-aabc-84682403809d") : object "kube-system"/"original-pull-secret" not registered Jul 21 19:37:19.086617 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:19.086599 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 19:37:19.086701 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:19.086653 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f593837e-f6e2-4b42-aa46-5dbee27cf83a-metrics-certs podName:f593837e-f6e2-4b42-aa46-5dbee27cf83a nodeName:}" failed. No retries permitted until 2026-07-21 19:37:21.086636365 +0000 UTC m=+6.046648778 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f593837e-f6e2-4b42-aa46-5dbee27cf83a-metrics-certs") pod "network-metrics-daemon-wzkph" (UID: "f593837e-f6e2-4b42-aa46-5dbee27cf83a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 19:37:19.086759 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:19.086734 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 19:37:19.086759 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:19.086752 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 19:37:19.086852 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:19.086765 2581 projected.go:196] Error preparing data for projected volume kube-api-access-qxb7h for pod openshift-network-diagnostics/network-check-target-lh2hq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 19:37:19.086852 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:19.086801 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dfa1c3e-9a8f-4813-a991-7072ca083d84-kube-api-access-qxb7h podName:9dfa1c3e-9a8f-4813-a991-7072ca083d84 nodeName:}" failed. No retries permitted until 2026-07-21 19:37:21.086790043 +0000 UTC m=+6.046802461 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qxb7h" (UniqueName: "kubernetes.io/projected/9dfa1c3e-9a8f-4813-a991-7072ca083d84-kube-api-access-qxb7h") pod "network-check-target-lh2hq" (UID: "9dfa1c3e-9a8f-4813-a991-7072ca083d84") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 19:37:19.399539 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:19.399425 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 19:32:17 +0000 UTC" deadline="2028-01-19 16:49:17.576387783 +0000 UTC" Jul 21 19:37:19.399539 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:19.399486 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13125h11m58.176906125s" Jul 21 19:37:19.530440 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:19.530408 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzkph" Jul 21 19:37:19.530603 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:19.530552 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzkph" podUID="f593837e-f6e2-4b42-aa46-5dbee27cf83a" Jul 21 19:37:19.530960 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:19.530939 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9g56" Jul 21 19:37:19.531066 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:19.531044 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q9g56" podUID="dfb82dd4-3122-4ebb-aabc-84682403809d" Jul 21 19:37:19.584533 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:19.583359 2581 generic.go:356] "Generic (PLEG): container finished" podID="8a3204fb4289b17b665b5abcf953c874" containerID="dd518dd03985e67ef04fa1a74e08f63603db2c20d3a230ea8779b2444bfd698c" exitCode=0 Jul 21 19:37:19.584533 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:19.584308 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-5.ec2.internal" event={"ID":"8a3204fb4289b17b665b5abcf953c874","Type":"ContainerDied","Data":"dd518dd03985e67ef04fa1a74e08f63603db2c20d3a230ea8779b2444bfd698c"} Jul 21 19:37:19.601709 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:19.600710 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-5.ec2.internal" podStartSLOduration=3.600691998 podStartE2EDuration="3.600691998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 19:37:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:37:18.567162394 +0000 UTC m=+3.527174829" watchObservedRunningTime="2026-07-21 19:37:19.600691998 +0000 UTC m=+4.560704432" Jul 21 19:37:20.529312 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:20.528830 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh2hq" Jul 21 19:37:20.529312 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:20.528968 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lh2hq" podUID="9dfa1c3e-9a8f-4813-a991-7072ca083d84" Jul 21 19:37:20.614624 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:20.614590 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-5.ec2.internal" event={"ID":"8a3204fb4289b17b665b5abcf953c874","Type":"ContainerStarted","Data":"5c6ad370bc8ba030dfbf62f158b42118d5396a2d7fdd1e9e56c3199b7ae3166e"} Jul 21 19:37:20.631270 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:20.631219 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-5.ec2.internal" podStartSLOduration=4.631200973 podStartE2EDuration="4.631200973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 19:37:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:37:20.630585528 +0000 UTC m=+5.590597963" watchObservedRunningTime="2026-07-21 19:37:20.631200973 +0000 UTC m=+5.591213408" Jul 21 19:37:21.100551 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:21.100519 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f593837e-f6e2-4b42-aa46-5dbee27cf83a-metrics-certs\") pod \"network-metrics-daemon-wzkph\" (UID: \"f593837e-f6e2-4b42-aa46-5dbee27cf83a\") " pod="openshift-multus/network-metrics-daemon-wzkph" Jul 21 19:37:21.100730 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:21.100570 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxb7h\" (UniqueName: \"kubernetes.io/projected/9dfa1c3e-9a8f-4813-a991-7072ca083d84-kube-api-access-qxb7h\") pod \"network-check-target-lh2hq\" (UID: \"9dfa1c3e-9a8f-4813-a991-7072ca083d84\") " pod="openshift-network-diagnostics/network-check-target-lh2hq" Jul 21 19:37:21.100730 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:21.100616 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfb82dd4-3122-4ebb-aabc-84682403809d-original-pull-secret\") pod \"global-pull-secret-syncer-q9g56\" (UID: \"dfb82dd4-3122-4ebb-aabc-84682403809d\") " pod="kube-system/global-pull-secret-syncer-q9g56" Jul 21 19:37:21.101081 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:21.101059 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 19:37:21.101175 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:21.101128 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f593837e-f6e2-4b42-aa46-5dbee27cf83a-metrics-certs podName:f593837e-f6e2-4b42-aa46-5dbee27cf83a nodeName:}" failed. No retries permitted until 2026-07-21 19:37:25.101108241 +0000 UTC m=+10.061120660 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f593837e-f6e2-4b42-aa46-5dbee27cf83a-metrics-certs") pod "network-metrics-daemon-wzkph" (UID: "f593837e-f6e2-4b42-aa46-5dbee27cf83a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 19:37:21.101175 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:21.101067 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 19:37:21.101175 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:21.101170 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 19:37:21.101375 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:21.101184 2581 projected.go:196] Error preparing data for projected volume kube-api-access-qxb7h for pod openshift-network-diagnostics/network-check-target-lh2hq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 19:37:21.101375 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:21.101254 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dfa1c3e-9a8f-4813-a991-7072ca083d84-kube-api-access-qxb7h podName:9dfa1c3e-9a8f-4813-a991-7072ca083d84 nodeName:}" failed. No retries permitted until 2026-07-21 19:37:25.101217182 +0000 UTC m=+10.061229600 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qxb7h" (UniqueName: "kubernetes.io/projected/9dfa1c3e-9a8f-4813-a991-7072ca083d84-kube-api-access-qxb7h") pod "network-check-target-lh2hq" (UID: "9dfa1c3e-9a8f-4813-a991-7072ca083d84") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 19:37:21.101513 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:21.101492 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 19:37:21.101573 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:21.101564 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfb82dd4-3122-4ebb-aabc-84682403809d-original-pull-secret podName:dfb82dd4-3122-4ebb-aabc-84682403809d nodeName:}" failed. No retries permitted until 2026-07-21 19:37:25.101538197 +0000 UTC m=+10.061550617 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dfb82dd4-3122-4ebb-aabc-84682403809d-original-pull-secret") pod "global-pull-secret-syncer-q9g56" (UID: "dfb82dd4-3122-4ebb-aabc-84682403809d") : object "kube-system"/"original-pull-secret" not registered Jul 21 19:37:21.531078 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:21.530358 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzkph" Jul 21 19:37:21.531078 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:21.530499 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzkph" podUID="f593837e-f6e2-4b42-aa46-5dbee27cf83a" Jul 21 19:37:21.531078 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:21.530869 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9g56" Jul 21 19:37:21.531078 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:21.530978 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q9g56" podUID="dfb82dd4-3122-4ebb-aabc-84682403809d" Jul 21 19:37:22.529464 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:22.528979 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh2hq" Jul 21 19:37:22.529464 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:22.529096 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lh2hq" podUID="9dfa1c3e-9a8f-4813-a991-7072ca083d84" Jul 21 19:37:23.528421 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:23.528287 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzkph" Jul 21 19:37:23.528421 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:23.528287 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9g56" Jul 21 19:37:23.528919 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:23.528437 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzkph" podUID="f593837e-f6e2-4b42-aa46-5dbee27cf83a" Jul 21 19:37:23.528919 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:23.528474 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q9g56" podUID="dfb82dd4-3122-4ebb-aabc-84682403809d" Jul 21 19:37:24.528558 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:24.528522 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh2hq" Jul 21 19:37:24.528989 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:24.528655 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lh2hq" podUID="9dfa1c3e-9a8f-4813-a991-7072ca083d84" Jul 21 19:37:25.133185 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:25.133147 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfb82dd4-3122-4ebb-aabc-84682403809d-original-pull-secret\") pod \"global-pull-secret-syncer-q9g56\" (UID: \"dfb82dd4-3122-4ebb-aabc-84682403809d\") " pod="kube-system/global-pull-secret-syncer-q9g56" Jul 21 19:37:25.133378 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:25.133222 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f593837e-f6e2-4b42-aa46-5dbee27cf83a-metrics-certs\") pod \"network-metrics-daemon-wzkph\" (UID: \"f593837e-f6e2-4b42-aa46-5dbee27cf83a\") " pod="openshift-multus/network-metrics-daemon-wzkph" Jul 21 19:37:25.133378 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:25.133259 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxb7h\" (UniqueName: \"kubernetes.io/projected/9dfa1c3e-9a8f-4813-a991-7072ca083d84-kube-api-access-qxb7h\") pod \"network-check-target-lh2hq\" (UID: \"9dfa1c3e-9a8f-4813-a991-7072ca083d84\") " pod="openshift-network-diagnostics/network-check-target-lh2hq" Jul 21 19:37:25.133378 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:25.133282 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 19:37:25.133378 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:25.133356 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfb82dd4-3122-4ebb-aabc-84682403809d-original-pull-secret podName:dfb82dd4-3122-4ebb-aabc-84682403809d nodeName:}" failed. No retries permitted until 2026-07-21 19:37:33.133335714 +0000 UTC m=+18.093348140 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dfb82dd4-3122-4ebb-aabc-84682403809d-original-pull-secret") pod "global-pull-secret-syncer-q9g56" (UID: "dfb82dd4-3122-4ebb-aabc-84682403809d") : object "kube-system"/"original-pull-secret" not registered Jul 21 19:37:25.133594 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:25.133394 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 19:37:25.133594 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:25.133414 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 19:37:25.133594 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:25.133426 2581 projected.go:196] Error preparing data for projected volume kube-api-access-qxb7h for pod openshift-network-diagnostics/network-check-target-lh2hq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 19:37:25.133594 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:25.133474 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dfa1c3e-9a8f-4813-a991-7072ca083d84-kube-api-access-qxb7h podName:9dfa1c3e-9a8f-4813-a991-7072ca083d84 nodeName:}" failed. No retries permitted until 2026-07-21 19:37:33.133459505 +0000 UTC m=+18.093471921 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qxb7h" (UniqueName: "kubernetes.io/projected/9dfa1c3e-9a8f-4813-a991-7072ca083d84-kube-api-access-qxb7h") pod "network-check-target-lh2hq" (UID: "9dfa1c3e-9a8f-4813-a991-7072ca083d84") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 19:37:25.133594 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:25.133530 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 19:37:25.133594 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:25.133560 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f593837e-f6e2-4b42-aa46-5dbee27cf83a-metrics-certs podName:f593837e-f6e2-4b42-aa46-5dbee27cf83a nodeName:}" failed. No retries permitted until 2026-07-21 19:37:33.133549173 +0000 UTC m=+18.093561585 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f593837e-f6e2-4b42-aa46-5dbee27cf83a-metrics-certs") pod "network-metrics-daemon-wzkph" (UID: "f593837e-f6e2-4b42-aa46-5dbee27cf83a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 19:37:25.529632 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:25.529597 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9g56" Jul 21 19:37:25.530110 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:25.529726 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q9g56" podUID="dfb82dd4-3122-4ebb-aabc-84682403809d" Jul 21 19:37:25.530176 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:25.530149 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzkph" Jul 21 19:37:25.530279 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:25.530257 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzkph" podUID="f593837e-f6e2-4b42-aa46-5dbee27cf83a" Jul 21 19:37:26.528854 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:26.528820 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh2hq" Jul 21 19:37:26.529066 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:26.528964 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lh2hq" podUID="9dfa1c3e-9a8f-4813-a991-7072ca083d84" Jul 21 19:37:27.528670 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:27.528620 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzkph" Jul 21 19:37:27.529160 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:27.528624 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9g56" Jul 21 19:37:27.529160 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:27.528783 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzkph" podUID="f593837e-f6e2-4b42-aa46-5dbee27cf83a" Jul 21 19:37:27.529160 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:27.528847 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q9g56" podUID="dfb82dd4-3122-4ebb-aabc-84682403809d" Jul 21 19:37:28.528435 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:28.528397 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh2hq" Jul 21 19:37:28.528615 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:28.528515 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lh2hq" podUID="9dfa1c3e-9a8f-4813-a991-7072ca083d84" Jul 21 19:37:29.528660 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:29.528625 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzkph" Jul 21 19:37:29.529153 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:29.528625 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9g56" Jul 21 19:37:29.529153 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:29.528774 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzkph" podUID="f593837e-f6e2-4b42-aa46-5dbee27cf83a" Jul 21 19:37:29.529153 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:29.528838 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q9g56" podUID="dfb82dd4-3122-4ebb-aabc-84682403809d" Jul 21 19:37:30.528206 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:30.528175 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh2hq" Jul 21 19:37:30.528370 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:30.528283 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lh2hq" podUID="9dfa1c3e-9a8f-4813-a991-7072ca083d84" Jul 21 19:37:31.528360 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:31.528326 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzkph" Jul 21 19:37:31.528840 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:31.528460 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzkph" podUID="f593837e-f6e2-4b42-aa46-5dbee27cf83a" Jul 21 19:37:31.528840 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:31.528510 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9g56" Jul 21 19:37:31.528840 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:31.528628 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q9g56" podUID="dfb82dd4-3122-4ebb-aabc-84682403809d" Jul 21 19:37:32.529013 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:32.528980 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh2hq" Jul 21 19:37:32.529444 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:32.529104 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lh2hq" podUID="9dfa1c3e-9a8f-4813-a991-7072ca083d84" Jul 21 19:37:33.197634 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:33.197601 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfb82dd4-3122-4ebb-aabc-84682403809d-original-pull-secret\") pod \"global-pull-secret-syncer-q9g56\" (UID: \"dfb82dd4-3122-4ebb-aabc-84682403809d\") " pod="kube-system/global-pull-secret-syncer-q9g56" Jul 21 19:37:33.197775 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:33.197662 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f593837e-f6e2-4b42-aa46-5dbee27cf83a-metrics-certs\") pod \"network-metrics-daemon-wzkph\" (UID: \"f593837e-f6e2-4b42-aa46-5dbee27cf83a\") " pod="openshift-multus/network-metrics-daemon-wzkph" Jul 21 19:37:33.197775 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:33.197696 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxb7h\" (UniqueName: \"kubernetes.io/projected/9dfa1c3e-9a8f-4813-a991-7072ca083d84-kube-api-access-qxb7h\") pod \"network-check-target-lh2hq\" (UID: \"9dfa1c3e-9a8f-4813-a991-7072ca083d84\") " pod="openshift-network-diagnostics/network-check-target-lh2hq" Jul 21 19:37:33.197881 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:33.197775 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 19:37:33.197881 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:33.197815 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 19:37:33.197881 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:33.197833 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 19:37:33.197881 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:33.197847 2581 projected.go:196] Error preparing data for projected volume kube-api-access-qxb7h for pod openshift-network-diagnostics/network-check-target-lh2hq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 19:37:33.197881 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:33.197852 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfb82dd4-3122-4ebb-aabc-84682403809d-original-pull-secret podName:dfb82dd4-3122-4ebb-aabc-84682403809d nodeName:}" failed. No retries permitted until 2026-07-21 19:37:49.197830859 +0000 UTC m=+34.157843276 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dfb82dd4-3122-4ebb-aabc-84682403809d-original-pull-secret") pod "global-pull-secret-syncer-q9g56" (UID: "dfb82dd4-3122-4ebb-aabc-84682403809d") : object "kube-system"/"original-pull-secret" not registered Jul 21 19:37:33.198137 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:33.197815 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 19:37:33.198137 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:33.197905 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dfa1c3e-9a8f-4813-a991-7072ca083d84-kube-api-access-qxb7h podName:9dfa1c3e-9a8f-4813-a991-7072ca083d84 nodeName:}" failed. No retries permitted until 2026-07-21 19:37:49.197876873 +0000 UTC m=+34.157889286 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qxb7h" (UniqueName: "kubernetes.io/projected/9dfa1c3e-9a8f-4813-a991-7072ca083d84-kube-api-access-qxb7h") pod "network-check-target-lh2hq" (UID: "9dfa1c3e-9a8f-4813-a991-7072ca083d84") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 19:37:33.198137 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:33.197966 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f593837e-f6e2-4b42-aa46-5dbee27cf83a-metrics-certs podName:f593837e-f6e2-4b42-aa46-5dbee27cf83a nodeName:}" failed. No retries permitted until 2026-07-21 19:37:49.197950171 +0000 UTC m=+34.157962595 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f593837e-f6e2-4b42-aa46-5dbee27cf83a-metrics-certs") pod "network-metrics-daemon-wzkph" (UID: "f593837e-f6e2-4b42-aa46-5dbee27cf83a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 19:37:33.528861 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:33.528830 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzkph" Jul 21 19:37:33.529030 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:33.528986 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzkph" podUID="f593837e-f6e2-4b42-aa46-5dbee27cf83a" Jul 21 19:37:33.529402 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:33.529070 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9g56" Jul 21 19:37:33.529402 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:33.529177 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q9g56" podUID="dfb82dd4-3122-4ebb-aabc-84682403809d" Jul 21 19:37:34.528997 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:34.528968 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh2hq" Jul 21 19:37:34.529176 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:34.529078 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lh2hq" podUID="9dfa1c3e-9a8f-4813-a991-7072ca083d84" Jul 21 19:37:35.529078 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:35.529041 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzkph" Jul 21 19:37:35.529257 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:35.529157 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzkph" podUID="f593837e-f6e2-4b42-aa46-5dbee27cf83a" Jul 21 19:37:35.529257 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:35.529211 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9g56" Jul 21 19:37:35.530449 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:35.529321 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q9g56" podUID="dfb82dd4-3122-4ebb-aabc-84682403809d" Jul 21 19:37:36.528810 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:36.528774 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh2hq" Jul 21 19:37:36.529003 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:36.528905 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lh2hq" podUID="9dfa1c3e-9a8f-4813-a991-7072ca083d84" Jul 21 19:37:37.528261 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:37.528132 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9g56" Jul 21 19:37:37.529072 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:37.528156 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzkph" Jul 21 19:37:37.529072 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:37.528343 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q9g56" podUID="dfb82dd4-3122-4ebb-aabc-84682403809d" Jul 21 19:37:37.529072 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:37.528453 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzkph" podUID="f593837e-f6e2-4b42-aa46-5dbee27cf83a" Jul 21 19:37:37.647432 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:37.647287 2581 generic.go:356] "Generic (PLEG): container finished" podID="f45d30e4-e0ba-4f2c-a765-d2f56fad780f" containerID="848c1e7f2ab641f3e84e629231a0b2f2629e0d8d1a2d15349a697667e155e895" exitCode=0 Jul 21 19:37:37.647587 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:37.647332 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2nv6g" event={"ID":"f45d30e4-e0ba-4f2c-a765-d2f56fad780f","Type":"ContainerDied","Data":"848c1e7f2ab641f3e84e629231a0b2f2629e0d8d1a2d15349a697667e155e895"} Jul 21 19:37:37.648925 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:37.648884 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4fmz" event={"ID":"7109dc26-f036-4ea0-9e29-6a0eb3fa9c43","Type":"ContainerStarted","Data":"ea8561e0f1103e44e11bb41acc81867cd79411ea506df98e525907a5a7ce87d8"} Jul 21 19:37:37.650183 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:37.650164 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5m4hj" event={"ID":"def7fd0e-546e-453b-ab49-665ae20835fe","Type":"ContainerStarted","Data":"d3b479b67933a1f57771cdce5c5bfbcb25e477414994031771e38a8845146277"} Jul 21 19:37:37.652041 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:37.652016 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" event={"ID":"12196bd5-b229-4551-9e02-9c040af87b59","Type":"ContainerStarted","Data":"9e1d4bd1b7a79bcb6b65b77557d31fc2c09c526b3616366f1aaa2a42576bbc77"} Jul 21 19:37:37.652143 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:37.652094 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" event={"ID":"12196bd5-b229-4551-9e02-9c040af87b59","Type":"ContainerStarted","Data":"13ca00bc88c1148d010b0e2d59749975584b8655a1fc44f82670b31f6823e338"} Jul 21 19:37:37.652207 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:37.652143 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" event={"ID":"12196bd5-b229-4551-9e02-9c040af87b59","Type":"ContainerStarted","Data":"b4ee5521b47c2cc49283985f53814d9fef4bd4b7e8d945e00ec956465eb2b63f"} Jul 21 19:37:37.653340 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:37.653321 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g8vsp" event={"ID":"8ac4304f-d17a-4a74-aacb-1f47fd557e74","Type":"ContainerStarted","Data":"122bd6b12f963e579058437d8c3c761924c3999cebe3a951c72176f169e5543c"} Jul 21 19:37:37.654651 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:37.654630 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6w4zf" event={"ID":"926ad8ee-c7f6-43c8-bf81-908b8e6824a8","Type":"ContainerStarted","Data":"9de53c0fe062cf18c652700197386ea967ada530a2634865fe7928a54e711be6"} Jul 21 19:37:37.655854 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:37.655834 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" event={"ID":"e0f9e409-ce13-4b2f-a7e0-233fa5d06f12","Type":"ContainerStarted","Data":"8cf0814a5192bdb6df1521a0897250ff07b3e266a403be6d7548fe158f90eaaf"} Jul 21 19:37:37.657020 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:37.657002 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kxpcf" event={"ID":"acc2e902-5de8-4233-8a76-1b41791e088f","Type":"ContainerStarted","Data":"a2a2a34f92868d7d495ceda67b3ba34fdf91b93d25c2c46b7a7e82027cc5a1f5"} Jul 21 19:37:37.765471 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:37.765418 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kxpcf" podStartSLOduration=3.915047961 podStartE2EDuration="22.765403059s" totalImagesPullingTime="18.850355098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:37:37.738546436 +0000 UTC m=+22.698558870" watchObservedRunningTime="2026-07-21 19:37:37.765403059 +0000 UTC m=+22.725415484" Jul 21 19:37:37.765695 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:37.765671 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5m4hj" podStartSLOduration=3.8670067919999997 podStartE2EDuration="22.765663857s" totalImagesPullingTime="18.898657065s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 19:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:37:37.76553677 +0000 UTC m=+22.725549189" watchObservedRunningTime="2026-07-21 19:37:37.765663857 +0000 UTC m=+22.725676291" Jul 21 19:37:37.816024 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:37.815989 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-g8vsp" podStartSLOduration=3.963214162 podStartE2EDuration="22.815974741s" totalImagesPullingTime="18.852760579s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 19:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:37:37.788659056 +0000 UTC m=+22.748671489" watchObservedRunningTime="2026-07-21 19:37:37.815974741 +0000 UTC m=+22.775987175" Jul 21 19:37:37.816228 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:37.816203 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8x7vz" podStartSLOduration=3.969412367 podStartE2EDuration="22.81619958s" totalImagesPullingTime="18.846787213s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 19:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:37:37.815305468 +0000 UTC m=+22.775317902" watchObservedRunningTime="2026-07-21 19:37:37.81619958 +0000 UTC m=+22.776212014" Jul 21 19:37:38.528856 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:38.528791 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh2hq" Jul 21 19:37:38.529421 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:38.528913 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lh2hq" podUID="9dfa1c3e-9a8f-4813-a991-7072ca083d84" Jul 21 19:37:38.662686 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:38.662660 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 21 19:37:38.663426 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:38.662952 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rbttl" event={"ID":"bdbaf1ca-2ec1-4a58-a0c6-fac4088c2a31","Type":"ContainerStarted","Data":"118a4bdee68ce05cb710e5b8bdc3b42476407108d7eb8f63184a1622eb9de957"} Jul 21 19:37:38.674277 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:38.674249 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" event={"ID":"12196bd5-b229-4551-9e02-9c040af87b59","Type":"ContainerStarted","Data":"bae854d2e06201ddc6fdd3e509363127d879115d12501b77aa14f5d6028fb95c"} Jul 21 19:37:38.674401 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:38.674334 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" event={"ID":"12196bd5-b229-4551-9e02-9c040af87b59","Type":"ContainerStarted","Data":"e814b1e1dacc37dce6635c4d25ecfe3e6beaccfc3df8b926b0f0f2e73be01f55"} Jul 21 19:37:38.674401 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:38.674382 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" event={"ID":"12196bd5-b229-4551-9e02-9c040af87b59","Type":"ContainerStarted","Data":"f17d93c8327c673c425c6daf3663206160196fcd685800b82f36d75916456312"} Jul 21 19:37:38.676151 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:38.676091 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4fmz" event={"ID":"7109dc26-f036-4ea0-9e29-6a0eb3fa9c43","Type":"ContainerStarted","Data":"abf5b9e26db478fa29103c33b7c08a09a393b4e4d1b536123d3abadef44a35ba"} Jul 21 19:37:38.688115 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:38.688076 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6w4zf" podStartSLOduration=4.817614424 podStartE2EDuration="23.688062219s" totalImagesPullingTime="18.870447795s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 19:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:37:37.836277258 +0000 UTC m=+22.796289690" watchObservedRunningTime="2026-07-21 19:37:38.688062219 +0000 UTC m=+23.648074655" Jul 21 19:37:38.688512 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:38.688488 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rbttl" podStartSLOduration=4.845075774 podStartE2EDuration="23.688482211s" totalImagesPullingTime="18.843406437s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 19:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:37:38.687473195 +0000 UTC m=+23.647485636" watchObservedRunningTime="2026-07-21 19:37:38.688482211 +0000 UTC m=+23.648494645" Jul 21 19:37:39.422043 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:39.421927 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T19:37:38.662681897Z","UUID":"69d84e05-9a9f-4fb3-bd08-a7d50501775c","Handler":null,"Name":"","Endpoint":""} Jul 21 19:37:39.423528 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:39.423509 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 21 19:37:39.423659 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:39.423548 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 21 19:37:39.529140 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:39.529111 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzkph" Jul 21 19:37:39.529658 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:39.529244 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzkph" podUID="f593837e-f6e2-4b42-aa46-5dbee27cf83a" Jul 21 19:37:39.529658 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:39.529267 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9g56" Jul 21 19:37:39.529658 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:39.529371 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q9g56" podUID="dfb82dd4-3122-4ebb-aabc-84682403809d" Jul 21 19:37:40.528250 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:40.528216 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh2hq" Jul 21 19:37:40.528491 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:40.528340 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lh2hq" podUID="9dfa1c3e-9a8f-4813-a991-7072ca083d84" Jul 21 19:37:40.682536 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:40.682503 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4fmz" event={"ID":"7109dc26-f036-4ea0-9e29-6a0eb3fa9c43","Type":"ContainerStarted","Data":"fca432228be2ae1d88d0ab01e432acbec0a9cdfc830308ddaef15aede54a28bc"} Jul 21 19:37:40.685810 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:40.685777 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" event={"ID":"12196bd5-b229-4551-9e02-9c040af87b59","Type":"ContainerStarted","Data":"335bd1800b46c6db69608778b33595d26763f424b1dd85453e0c038ad494f548"} Jul 21 19:37:40.705495 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:40.705439 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4fmz" podStartSLOduration=4.649973693 podStartE2EDuration="25.705420741s" totalImagesPullingTime="21.055447048s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 19:37:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:37:40.70484869 +0000 UTC m=+25.664861125" watchObservedRunningTime="2026-07-21 19:37:40.705420741 +0000 UTC m=+25.665433176" Jul 21 19:37:41.242839 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:41.242808 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kxpcf" Jul 21 19:37:41.243496 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:41.243474 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kxpcf" Jul 21 19:37:41.528363 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:41.528095 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzkph" Jul 21 19:37:41.528502 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:41.528435 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzkph" podUID="f593837e-f6e2-4b42-aa46-5dbee27cf83a" Jul 21 19:37:41.528502 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:41.528483 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9g56" Jul 21 19:37:41.528611 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:41.528584 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q9g56" podUID="dfb82dd4-3122-4ebb-aabc-84682403809d" Jul 21 19:37:41.688501 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:41.688472 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kxpcf" Jul 21 19:37:41.688985 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:41.688811 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kxpcf" Jul 21 19:37:42.528244 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:42.528213 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh2hq" Jul 21 19:37:42.528466 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:42.528344 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lh2hq" podUID="9dfa1c3e-9a8f-4813-a991-7072ca083d84" Jul 21 19:37:43.528735 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:43.528566 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzkph" Jul 21 19:37:43.529494 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:43.528627 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9g56" Jul 21 19:37:43.529494 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:43.528848 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzkph" podUID="f593837e-f6e2-4b42-aa46-5dbee27cf83a" Jul 21 19:37:43.529494 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:43.528883 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q9g56" podUID="dfb82dd4-3122-4ebb-aabc-84682403809d" Jul 21 19:37:43.696379 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:43.696292 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" event={"ID":"12196bd5-b229-4551-9e02-9c040af87b59","Type":"ContainerStarted","Data":"df7f38c7d0a6e61184b76c4ef50b17849b86de3bb1c8722e4c8a259b3ef157cf"} Jul 21 19:37:43.696538 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:43.696515 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:43.696668 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:43.696579 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:43.696668 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:43.696622 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:43.698176 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:43.698153 2581 generic.go:356] "Generic (PLEG): container finished" podID="f45d30e4-e0ba-4f2c-a765-d2f56fad780f" containerID="61c949268c131e5b41f0eecc64da3870305084bfd166ebc6cf9c2755b1fc38db" exitCode=0 Jul 21 19:37:43.698284 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:43.698235 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2nv6g" event={"ID":"f45d30e4-e0ba-4f2c-a765-d2f56fad780f","Type":"ContainerDied","Data":"61c949268c131e5b41f0eecc64da3870305084bfd166ebc6cf9c2755b1fc38db"} Jul 21 19:37:43.711683 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:43.711666 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:43.712171 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:43.712156 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:37:43.724698 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:43.724664 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" podStartSLOduration=9.785106313 podStartE2EDuration="28.724653451s" totalImagesPullingTime="18.939547138s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 19:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:37:43.724164975 +0000 UTC m=+28.684177410" watchObservedRunningTime="2026-07-21 19:37:43.724653451 +0000 UTC m=+28.684665876" Jul 21 19:37:44.529055 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:44.529027 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh2hq" Jul 21 19:37:44.529465 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:44.529128 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lh2hq" podUID="9dfa1c3e-9a8f-4813-a991-7072ca083d84" Jul 21 19:37:45.076470 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:45.076401 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lh2hq"] Jul 21 19:37:45.076652 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:45.076514 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh2hq" Jul 21 19:37:45.076652 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:45.076623 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lh2hq" podUID="9dfa1c3e-9a8f-4813-a991-7072ca083d84" Jul 21 19:37:45.079911 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:45.079871 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q9g56"] Jul 21 19:37:45.080024 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:45.079990 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9g56" Jul 21 19:37:45.080105 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:45.080085 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q9g56" podUID="dfb82dd4-3122-4ebb-aabc-84682403809d" Jul 21 19:37:45.081315 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:45.081260 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wzkph"] Jul 21 19:37:45.081384 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:45.081356 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzkph" Jul 21 19:37:45.081476 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:45.081456 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzkph" podUID="f593837e-f6e2-4b42-aa46-5dbee27cf83a" Jul 21 19:37:45.703805 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:45.703774 2581 generic.go:356] "Generic (PLEG): container finished" podID="f45d30e4-e0ba-4f2c-a765-d2f56fad780f" containerID="d3f70964a6c444f54639e0579e22dc96a753a3088db7679e57a30692fa3c9ad3" exitCode=0 Jul 21 19:37:45.704182 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:45.703852 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2nv6g" event={"ID":"f45d30e4-e0ba-4f2c-a765-d2f56fad780f","Type":"ContainerDied","Data":"d3f70964a6c444f54639e0579e22dc96a753a3088db7679e57a30692fa3c9ad3"} Jul 21 19:37:46.528356 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:46.528323 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzkph" Jul 21 19:37:46.528491 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:46.528373 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9g56" Jul 21 19:37:46.528491 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:46.528387 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh2hq" Jul 21 19:37:46.528491 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:46.528449 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q9g56" podUID="dfb82dd4-3122-4ebb-aabc-84682403809d" Jul 21 19:37:46.528592 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:46.528490 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lh2hq" podUID="9dfa1c3e-9a8f-4813-a991-7072ca083d84" Jul 21 19:37:46.528592 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:46.528568 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzkph" podUID="f593837e-f6e2-4b42-aa46-5dbee27cf83a" Jul 21 19:37:47.709886 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:47.709702 2581 generic.go:356] "Generic (PLEG): container finished" podID="f45d30e4-e0ba-4f2c-a765-d2f56fad780f" containerID="b5302298d77f73a841e181e7e63a083df4ea41eb98ba5b58bdfa4cbfc4c6b053" exitCode=0 Jul 21 19:37:47.709886 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:47.709781 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2nv6g" event={"ID":"f45d30e4-e0ba-4f2c-a765-d2f56fad780f","Type":"ContainerDied","Data":"b5302298d77f73a841e181e7e63a083df4ea41eb98ba5b58bdfa4cbfc4c6b053"} Jul 21 19:37:48.528634 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:48.528598 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9g56" Jul 21 19:37:48.528814 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:48.528635 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh2hq" Jul 21 19:37:48.528814 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:48.528654 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzkph" Jul 21 19:37:48.528814 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:48.528729 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q9g56" podUID="dfb82dd4-3122-4ebb-aabc-84682403809d" Jul 21 19:37:48.528814 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:48.528797 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lh2hq" podUID="9dfa1c3e-9a8f-4813-a991-7072ca083d84" Jul 21 19:37:48.529009 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:48.528859 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzkph" podUID="f593837e-f6e2-4b42-aa46-5dbee27cf83a" Jul 21 19:37:49.218307 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:49.218267 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxb7h\" (UniqueName: \"kubernetes.io/projected/9dfa1c3e-9a8f-4813-a991-7072ca083d84-kube-api-access-qxb7h\") pod \"network-check-target-lh2hq\" (UID: \"9dfa1c3e-9a8f-4813-a991-7072ca083d84\") " pod="openshift-network-diagnostics/network-check-target-lh2hq" Jul 21 19:37:49.218758 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:49.218332 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfb82dd4-3122-4ebb-aabc-84682403809d-original-pull-secret\") pod \"global-pull-secret-syncer-q9g56\" (UID: \"dfb82dd4-3122-4ebb-aabc-84682403809d\") " pod="kube-system/global-pull-secret-syncer-q9g56" Jul 21 19:37:49.218758 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:49.218383 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f593837e-f6e2-4b42-aa46-5dbee27cf83a-metrics-certs\") pod \"network-metrics-daemon-wzkph\" (UID: \"f593837e-f6e2-4b42-aa46-5dbee27cf83a\") " pod="openshift-multus/network-metrics-daemon-wzkph" Jul 21 19:37:49.218758 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:49.218458 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 19:37:49.218758 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:49.218479 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 19:37:49.218758 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:49.218483 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 19:37:49.218758 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:49.218539 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f593837e-f6e2-4b42-aa46-5dbee27cf83a-metrics-certs podName:f593837e-f6e2-4b42-aa46-5dbee27cf83a nodeName:}" failed. No retries permitted until 2026-07-21 19:38:21.218520189 +0000 UTC m=+66.178532607 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f593837e-f6e2-4b42-aa46-5dbee27cf83a-metrics-certs") pod "network-metrics-daemon-wzkph" (UID: "f593837e-f6e2-4b42-aa46-5dbee27cf83a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 19:37:49.218758 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:49.218486 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 19:37:49.218758 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:49.218557 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfb82dd4-3122-4ebb-aabc-84682403809d-original-pull-secret podName:dfb82dd4-3122-4ebb-aabc-84682403809d nodeName:}" failed. No retries permitted until 2026-07-21 19:38:21.218547408 +0000 UTC m=+66.178559824 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dfb82dd4-3122-4ebb-aabc-84682403809d-original-pull-secret") pod "global-pull-secret-syncer-q9g56" (UID: "dfb82dd4-3122-4ebb-aabc-84682403809d") : object "kube-system"/"original-pull-secret" not registered Jul 21 19:37:49.218758 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:49.218562 2581 projected.go:196] Error preparing data for projected volume kube-api-access-qxb7h for pod openshift-network-diagnostics/network-check-target-lh2hq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 19:37:49.218758 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:49.218609 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dfa1c3e-9a8f-4813-a991-7072ca083d84-kube-api-access-qxb7h podName:9dfa1c3e-9a8f-4813-a991-7072ca083d84 nodeName:}" failed. No retries permitted until 2026-07-21 19:38:21.21859172 +0000 UTC m=+66.178604137 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qxb7h" (UniqueName: "kubernetes.io/projected/9dfa1c3e-9a8f-4813-a991-7072ca083d84-kube-api-access-qxb7h") pod "network-check-target-lh2hq" (UID: "9dfa1c3e-9a8f-4813-a991-7072ca083d84") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 19:37:49.858625 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:49.858583 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-5.ec2.internal" event="NodeReady" Jul 21 19:37:49.858780 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:49.858712 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 21 19:37:49.908824 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:49.908792 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pgd57"] Jul 21 19:37:49.910626 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:49.910606 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pgd57" Jul 21 19:37:49.911659 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:49.911613 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wsmxp"] Jul 21 19:37:49.913134 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:49.913100 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 21 19:37:49.913134 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:49.913112 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-46cqs\"" Jul 21 19:37:49.913134 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:49.913127 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 21 19:37:49.913470 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:49.913451 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wsmxp" Jul 21 19:37:49.915678 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:49.915657 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 21 19:37:49.915993 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:49.915950 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 21 19:37:49.915993 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:49.915965 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 21 19:37:49.915993 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:49.915955 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zpj99\"" Jul 21 19:37:49.922719 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:49.922667 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pgd57"] Jul 21 19:37:49.924556 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:49.924535 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wsmxp"] Jul 21 19:37:50.025990 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:50.025965 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a044c778-bc03-453d-829e-dfb6cca7e844-tmp-dir\") pod \"dns-default-pgd57\" (UID: \"a044c778-bc03-453d-829e-dfb6cca7e844\") " pod="openshift-dns/dns-default-pgd57" Jul 21 19:37:50.026125 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:50.026000 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdxjw\" (UniqueName: \"kubernetes.io/projected/a044c778-bc03-453d-829e-dfb6cca7e844-kube-api-access-jdxjw\") pod \"dns-default-pgd57\" (UID: \"a044c778-bc03-453d-829e-dfb6cca7e844\") " pod="openshift-dns/dns-default-pgd57" Jul 21 19:37:50.026125 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:50.026019 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4v7r\" (UniqueName: \"kubernetes.io/projected/8e6be3ee-b04a-4428-82b5-a37cbd6d0e84-kube-api-access-j4v7r\") pod \"ingress-canary-wsmxp\" (UID: \"8e6be3ee-b04a-4428-82b5-a37cbd6d0e84\") " pod="openshift-ingress-canary/ingress-canary-wsmxp" Jul 21 19:37:50.026205 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:50.026141 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a044c778-bc03-453d-829e-dfb6cca7e844-config-volume\") pod \"dns-default-pgd57\" (UID: \"a044c778-bc03-453d-829e-dfb6cca7e844\") " pod="openshift-dns/dns-default-pgd57" Jul 21 19:37:50.026205 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:50.026172 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a044c778-bc03-453d-829e-dfb6cca7e844-metrics-tls\") pod \"dns-default-pgd57\" (UID: \"a044c778-bc03-453d-829e-dfb6cca7e844\") " pod="openshift-dns/dns-default-pgd57" Jul 21 19:37:50.026205 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:50.026190 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e6be3ee-b04a-4428-82b5-a37cbd6d0e84-cert\") pod \"ingress-canary-wsmxp\" (UID: \"8e6be3ee-b04a-4428-82b5-a37cbd6d0e84\") " pod="openshift-ingress-canary/ingress-canary-wsmxp" Jul 21 19:37:50.127309 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:50.127280 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a044c778-bc03-453d-829e-dfb6cca7e844-config-volume\") pod \"dns-default-pgd57\" (UID: \"a044c778-bc03-453d-829e-dfb6cca7e844\") " pod="openshift-dns/dns-default-pgd57" Jul 21 19:37:50.127454 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:50.127316 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a044c778-bc03-453d-829e-dfb6cca7e844-metrics-tls\") pod \"dns-default-pgd57\" (UID: \"a044c778-bc03-453d-829e-dfb6cca7e844\") " pod="openshift-dns/dns-default-pgd57" Jul 21 19:37:50.127454 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:50.127334 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e6be3ee-b04a-4428-82b5-a37cbd6d0e84-cert\") pod \"ingress-canary-wsmxp\" (UID: \"8e6be3ee-b04a-4428-82b5-a37cbd6d0e84\") " pod="openshift-ingress-canary/ingress-canary-wsmxp" Jul 21 19:37:50.127454 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:50.127355 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a044c778-bc03-453d-829e-dfb6cca7e844-tmp-dir\") pod \"dns-default-pgd57\" (UID: \"a044c778-bc03-453d-829e-dfb6cca7e844\") " pod="openshift-dns/dns-default-pgd57" Jul 21 19:37:50.127454 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:50.127386 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdxjw\" (UniqueName: \"kubernetes.io/projected/a044c778-bc03-453d-829e-dfb6cca7e844-kube-api-access-jdxjw\") pod \"dns-default-pgd57\" (UID: \"a044c778-bc03-453d-829e-dfb6cca7e844\") " pod="openshift-dns/dns-default-pgd57" Jul 21 19:37:50.127454 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:50.127410 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4v7r\" (UniqueName: \"kubernetes.io/projected/8e6be3ee-b04a-4428-82b5-a37cbd6d0e84-kube-api-access-j4v7r\") pod \"ingress-canary-wsmxp\" (UID: \"8e6be3ee-b04a-4428-82b5-a37cbd6d0e84\") " pod="openshift-ingress-canary/ingress-canary-wsmxp" Jul 21 19:37:50.127454 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:50.127443 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 19:37:50.127718 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:50.127509 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a044c778-bc03-453d-829e-dfb6cca7e844-metrics-tls podName:a044c778-bc03-453d-829e-dfb6cca7e844 nodeName:}" failed. No retries permitted until 2026-07-21 19:37:50.627487356 +0000 UTC m=+35.587499768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a044c778-bc03-453d-829e-dfb6cca7e844-metrics-tls") pod "dns-default-pgd57" (UID: "a044c778-bc03-453d-829e-dfb6cca7e844") : secret "dns-default-metrics-tls" not found Jul 21 19:37:50.127869 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:50.127848 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a044c778-bc03-453d-829e-dfb6cca7e844-tmp-dir\") pod \"dns-default-pgd57\" (UID: \"a044c778-bc03-453d-829e-dfb6cca7e844\") " pod="openshift-dns/dns-default-pgd57" Jul 21 19:37:50.128011 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:50.127961 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a044c778-bc03-453d-829e-dfb6cca7e844-config-volume\") pod \"dns-default-pgd57\" (UID: \"a044c778-bc03-453d-829e-dfb6cca7e844\") " pod="openshift-dns/dns-default-pgd57" Jul 21 19:37:50.132036 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:50.132017 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e6be3ee-b04a-4428-82b5-a37cbd6d0e84-cert\") pod \"ingress-canary-wsmxp\" (UID: \"8e6be3ee-b04a-4428-82b5-a37cbd6d0e84\") " pod="openshift-ingress-canary/ingress-canary-wsmxp" Jul 21 19:37:50.136155 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:50.136120 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdxjw\" (UniqueName: \"kubernetes.io/projected/a044c778-bc03-453d-829e-dfb6cca7e844-kube-api-access-jdxjw\") pod \"dns-default-pgd57\" (UID: \"a044c778-bc03-453d-829e-dfb6cca7e844\") " pod="openshift-dns/dns-default-pgd57" Jul 21 19:37:50.136643 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:50.136623 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4v7r\" (UniqueName: \"kubernetes.io/projected/8e6be3ee-b04a-4428-82b5-a37cbd6d0e84-kube-api-access-j4v7r\") pod \"ingress-canary-wsmxp\" (UID: \"8e6be3ee-b04a-4428-82b5-a37cbd6d0e84\") " pod="openshift-ingress-canary/ingress-canary-wsmxp" Jul 21 19:37:50.230005 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:50.229970 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wsmxp" Jul 21 19:37:50.369869 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:50.369840 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wsmxp"] Jul 21 19:37:50.528756 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:50.528720 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh2hq" Jul 21 19:37:50.528915 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:50.528720 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9g56" Jul 21 19:37:50.528915 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:50.528738 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzkph" Jul 21 19:37:50.531831 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:50.531806 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 21 19:37:50.532912 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:50.532787 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 21 19:37:50.532912 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:50.532849 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 21 19:37:50.532912 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:50.532789 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tcjpf\"" Jul 21 19:37:50.532912 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:50.532802 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nmxjk\"" Jul 21 19:37:50.533181 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:50.532814 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 21 19:37:50.630579 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:50.630332 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a044c778-bc03-453d-829e-dfb6cca7e844-metrics-tls\") pod \"dns-default-pgd57\" (UID: \"a044c778-bc03-453d-829e-dfb6cca7e844\") " pod="openshift-dns/dns-default-pgd57" Jul 21 19:37:50.630729 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:50.630509 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 19:37:50.630729 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:50.630673 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a044c778-bc03-453d-829e-dfb6cca7e844-metrics-tls podName:a044c778-bc03-453d-829e-dfb6cca7e844 nodeName:}" failed. No retries permitted until 2026-07-21 19:37:51.63065082 +0000 UTC m=+36.590663234 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a044c778-bc03-453d-829e-dfb6cca7e844-metrics-tls") pod "dns-default-pgd57" (UID: "a044c778-bc03-453d-829e-dfb6cca7e844") : secret "dns-default-metrics-tls" not found Jul 21 19:37:51.637743 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:51.637698 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a044c778-bc03-453d-829e-dfb6cca7e844-metrics-tls\") pod \"dns-default-pgd57\" (UID: \"a044c778-bc03-453d-829e-dfb6cca7e844\") " pod="openshift-dns/dns-default-pgd57" Jul 21 19:37:51.638333 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:51.637871 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 19:37:51.638333 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:51.637961 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a044c778-bc03-453d-829e-dfb6cca7e844-metrics-tls podName:a044c778-bc03-453d-829e-dfb6cca7e844 nodeName:}" failed. No retries permitted until 2026-07-21 19:37:53.637943802 +0000 UTC m=+38.597956214 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a044c778-bc03-453d-829e-dfb6cca7e844-metrics-tls") pod "dns-default-pgd57" (UID: "a044c778-bc03-453d-829e-dfb6cca7e844") : secret "dns-default-metrics-tls" not found Jul 21 19:37:51.768930 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:37:51.767931 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e6be3ee_b04a_4428_82b5_a37cbd6d0e84.slice/crio-f136987d2a5df2c5c7d81a2673392b2a2c0e5962cc2c5a983d3706b0ee9eb418 WatchSource:0}: Error finding container f136987d2a5df2c5c7d81a2673392b2a2c0e5962cc2c5a983d3706b0ee9eb418: Status 404 returned error can't find the container with id f136987d2a5df2c5c7d81a2673392b2a2c0e5962cc2c5a983d3706b0ee9eb418 Jul 21 19:37:52.724046 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:52.724008 2581 generic.go:356] "Generic (PLEG): container finished" podID="f45d30e4-e0ba-4f2c-a765-d2f56fad780f" containerID="65f8edfbe8ee0f1fc0f2c8b150f7c25c3a7ff7ebc4ad23484bd19b518556599b" exitCode=0 Jul 21 19:37:52.724552 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:52.724097 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2nv6g" event={"ID":"f45d30e4-e0ba-4f2c-a765-d2f56fad780f","Type":"ContainerDied","Data":"65f8edfbe8ee0f1fc0f2c8b150f7c25c3a7ff7ebc4ad23484bd19b518556599b"} Jul 21 19:37:52.725263 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:52.725229 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wsmxp" event={"ID":"8e6be3ee-b04a-4428-82b5-a37cbd6d0e84","Type":"ContainerStarted","Data":"f136987d2a5df2c5c7d81a2673392b2a2c0e5962cc2c5a983d3706b0ee9eb418"} Jul 21 19:37:53.651344 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:53.651312 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a044c778-bc03-453d-829e-dfb6cca7e844-metrics-tls\") pod \"dns-default-pgd57\" (UID: \"a044c778-bc03-453d-829e-dfb6cca7e844\") " pod="openshift-dns/dns-default-pgd57" Jul 21 19:37:53.651481 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:53.651442 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 19:37:53.651551 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:53.651514 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a044c778-bc03-453d-829e-dfb6cca7e844-metrics-tls podName:a044c778-bc03-453d-829e-dfb6cca7e844 nodeName:}" failed. No retries permitted until 2026-07-21 19:37:57.651493424 +0000 UTC m=+42.611505841 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a044c778-bc03-453d-829e-dfb6cca7e844-metrics-tls") pod "dns-default-pgd57" (UID: "a044c778-bc03-453d-829e-dfb6cca7e844") : secret "dns-default-metrics-tls" not found Jul 21 19:37:53.731448 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:53.731415 2581 generic.go:356] "Generic (PLEG): container finished" podID="f45d30e4-e0ba-4f2c-a765-d2f56fad780f" containerID="7ec773d63b5cdd6993ea74ecb9f28ca70ca13e9e8461dd5b98a59393c451f05d" exitCode=0 Jul 21 19:37:53.731866 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:53.731473 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2nv6g" event={"ID":"f45d30e4-e0ba-4f2c-a765-d2f56fad780f","Type":"ContainerDied","Data":"7ec773d63b5cdd6993ea74ecb9f28ca70ca13e9e8461dd5b98a59393c451f05d"} Jul 21 19:37:54.736256 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:54.736227 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2nv6g" event={"ID":"f45d30e4-e0ba-4f2c-a765-d2f56fad780f","Type":"ContainerStarted","Data":"ed65648698c055c91434e036c50f266defa7c3a88fb2f25e5dd8acbbaaf9f611"} Jul 21 19:37:54.762875 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:54.762827 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2nv6g" podStartSLOduration=9.238975024 podStartE2EDuration="39.762810852s" totalImagesPullingTime="30.523835828s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 19:37:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:37:54.762219381 +0000 UTC m=+39.722231816" watchObservedRunningTime="2026-07-21 19:37:54.762810852 +0000 UTC m=+39.722823290" Jul 21 19:37:55.739631 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:55.739444 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wsmxp" event={"ID":"8e6be3ee-b04a-4428-82b5-a37cbd6d0e84","Type":"ContainerStarted","Data":"ad36b165f4f477633e9788938ef719ca55a744c44eb9901ec0fe9088707d2b0f"} Jul 21 19:37:55.757590 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:55.757545 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wsmxp" podStartSLOduration=3.843461182 podStartE2EDuration="6.757531142s" totalImagesPullingTime="2.91406996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:37:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:37:55.756068871 +0000 UTC m=+40.716081318" watchObservedRunningTime="2026-07-21 19:37:55.757531142 +0000 UTC m=+40.717543575" Jul 21 19:37:57.683835 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:37:57.683799 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a044c778-bc03-453d-829e-dfb6cca7e844-metrics-tls\") pod \"dns-default-pgd57\" (UID: \"a044c778-bc03-453d-829e-dfb6cca7e844\") " pod="openshift-dns/dns-default-pgd57" Jul 21 19:37:57.684243 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:57.683925 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 19:37:57.684243 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:37:57.683975 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a044c778-bc03-453d-829e-dfb6cca7e844-metrics-tls podName:a044c778-bc03-453d-829e-dfb6cca7e844 nodeName:}" failed. No retries permitted until 2026-07-21 19:38:05.683961212 +0000 UTC m=+50.643973625 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a044c778-bc03-453d-829e-dfb6cca7e844-metrics-tls") pod "dns-default-pgd57" (UID: "a044c778-bc03-453d-829e-dfb6cca7e844") : secret "dns-default-metrics-tls" not found Jul 21 19:38:05.737438 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:05.737403 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a044c778-bc03-453d-829e-dfb6cca7e844-metrics-tls\") pod \"dns-default-pgd57\" (UID: \"a044c778-bc03-453d-829e-dfb6cca7e844\") " pod="openshift-dns/dns-default-pgd57" Jul 21 19:38:05.737929 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:05.737511 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 19:38:05.737929 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:05.737569 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a044c778-bc03-453d-829e-dfb6cca7e844-metrics-tls podName:a044c778-bc03-453d-829e-dfb6cca7e844 nodeName:}" failed. No retries permitted until 2026-07-21 19:38:21.737556247 +0000 UTC m=+66.697568659 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a044c778-bc03-453d-829e-dfb6cca7e844-metrics-tls") pod "dns-default-pgd57" (UID: "a044c778-bc03-453d-829e-dfb6cca7e844") : secret "dns-default-metrics-tls" not found Jul 21 19:38:15.722936 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:15.722907 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gnxn2" Jul 21 19:38:21.229407 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:21.229349 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfb82dd4-3122-4ebb-aabc-84682403809d-original-pull-secret\") pod \"global-pull-secret-syncer-q9g56\" (UID: \"dfb82dd4-3122-4ebb-aabc-84682403809d\") " pod="kube-system/global-pull-secret-syncer-q9g56" Jul 21 19:38:21.229970 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:21.229429 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f593837e-f6e2-4b42-aa46-5dbee27cf83a-metrics-certs\") pod \"network-metrics-daemon-wzkph\" (UID: \"f593837e-f6e2-4b42-aa46-5dbee27cf83a\") " pod="openshift-multus/network-metrics-daemon-wzkph" Jul 21 19:38:21.229970 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:21.229464 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxb7h\" (UniqueName: \"kubernetes.io/projected/9dfa1c3e-9a8f-4813-a991-7072ca083d84-kube-api-access-qxb7h\") pod \"network-check-target-lh2hq\" (UID: \"9dfa1c3e-9a8f-4813-a991-7072ca083d84\") " pod="openshift-network-diagnostics/network-check-target-lh2hq" Jul 21 19:38:21.232582 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:21.232560 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 21 19:38:21.232693 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:21.232675 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 21 19:38:21.232815 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:21.232798 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 21 19:38:21.240162 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:21.240134 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 21 19:38:21.240216 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:21.240196 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f593837e-f6e2-4b42-aa46-5dbee27cf83a-metrics-certs podName:f593837e-f6e2-4b42-aa46-5dbee27cf83a nodeName:}" failed. No retries permitted until 2026-07-21 19:39:25.240182557 +0000 UTC m=+130.200194969 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f593837e-f6e2-4b42-aa46-5dbee27cf83a-metrics-certs") pod "network-metrics-daemon-wzkph" (UID: "f593837e-f6e2-4b42-aa46-5dbee27cf83a") : secret "metrics-daemon-secret" not found Jul 21 19:38:21.242688 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:21.242674 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 21 19:38:21.243747 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:21.243731 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfb82dd4-3122-4ebb-aabc-84682403809d-original-pull-secret\") pod \"global-pull-secret-syncer-q9g56\" (UID: \"dfb82dd4-3122-4ebb-aabc-84682403809d\") " pod="kube-system/global-pull-secret-syncer-q9g56" Jul 21 19:38:21.252726 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:21.252705 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxb7h\" (UniqueName: \"kubernetes.io/projected/9dfa1c3e-9a8f-4813-a991-7072ca083d84-kube-api-access-qxb7h\") pod \"network-check-target-lh2hq\" (UID: \"9dfa1c3e-9a8f-4813-a991-7072ca083d84\") " pod="openshift-network-diagnostics/network-check-target-lh2hq" Jul 21 19:38:21.443163 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:21.443128 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nmxjk\"" Jul 21 19:38:21.447472 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:21.447444 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9g56" Jul 21 19:38:21.451373 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:21.451358 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh2hq" Jul 21 19:38:21.592647 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:21.592618 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q9g56"] Jul 21 19:38:21.595720 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:38:21.595695 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfb82dd4_3122_4ebb_aabc_84682403809d.slice/crio-ceed6036b2033d2263d2b0991a1e91d8ff2a2c626f6d3f516dd15f8a542f463b WatchSource:0}: Error finding container ceed6036b2033d2263d2b0991a1e91d8ff2a2c626f6d3f516dd15f8a542f463b: Status 404 returned error can't find the container with id ceed6036b2033d2263d2b0991a1e91d8ff2a2c626f6d3f516dd15f8a542f463b Jul 21 19:38:21.618272 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:21.618251 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lh2hq"] Jul 21 19:38:21.621295 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:38:21.621270 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dfa1c3e_9a8f_4813_a991_7072ca083d84.slice/crio-b37b3e9bbd4fdd6ed92c1b438612763ce89c113ebac9328a3c996f6d0712d1de WatchSource:0}: Error finding container b37b3e9bbd4fdd6ed92c1b438612763ce89c113ebac9328a3c996f6d0712d1de: Status 404 returned error can't find the container with id b37b3e9bbd4fdd6ed92c1b438612763ce89c113ebac9328a3c996f6d0712d1de Jul 21 19:38:21.799282 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:21.799186 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q9g56" event={"ID":"dfb82dd4-3122-4ebb-aabc-84682403809d","Type":"ContainerStarted","Data":"ceed6036b2033d2263d2b0991a1e91d8ff2a2c626f6d3f516dd15f8a542f463b"} Jul 21 19:38:21.800182 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:21.800156 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lh2hq" event={"ID":"9dfa1c3e-9a8f-4813-a991-7072ca083d84","Type":"ContainerStarted","Data":"b37b3e9bbd4fdd6ed92c1b438612763ce89c113ebac9328a3c996f6d0712d1de"} Jul 21 19:38:21.833707 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:21.833683 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a044c778-bc03-453d-829e-dfb6cca7e844-metrics-tls\") pod \"dns-default-pgd57\" (UID: \"a044c778-bc03-453d-829e-dfb6cca7e844\") " pod="openshift-dns/dns-default-pgd57" Jul 21 19:38:21.833799 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:21.833789 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 19:38:21.833847 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:21.833837 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a044c778-bc03-453d-829e-dfb6cca7e844-metrics-tls podName:a044c778-bc03-453d-829e-dfb6cca7e844 nodeName:}" failed. No retries permitted until 2026-07-21 19:38:53.833823913 +0000 UTC m=+98.793836324 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a044c778-bc03-453d-829e-dfb6cca7e844-metrics-tls") pod "dns-default-pgd57" (UID: "a044c778-bc03-453d-829e-dfb6cca7e844") : secret "dns-default-metrics-tls" not found Jul 21 19:38:22.894438 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:22.894397 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-pzvw2"] Jul 21 19:38:22.914345 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:22.914203 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-pzvw2"] Jul 21 19:38:22.914345 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:22.914319 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-pzvw2" Jul 21 19:38:22.917356 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:22.917335 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 21 19:38:22.918564 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:22.918540 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-nr926\"" Jul 21 19:38:22.918862 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:22.918540 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 21 19:38:22.940080 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:22.939989 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95s7t\" (UniqueName: \"kubernetes.io/projected/d9dc2253-8393-4e58-b8a7-9eec02a3ff95-kube-api-access-95s7t\") pod \"volume-data-source-validator-78cf4c6f6-pzvw2\" (UID: \"d9dc2253-8393-4e58-b8a7-9eec02a3ff95\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-pzvw2" Jul 21 19:38:23.008943 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.008865 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-khzjj"] Jul 21 19:38:23.024169 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.024134 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-khzjj" Jul 21 19:38:23.029369 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.028692 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 21 19:38:23.029369 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.028699 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 21 19:38:23.029369 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.029168 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 21 19:38:23.029692 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.029476 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 21 19:38:23.029692 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.029686 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xrtvq\"" Jul 21 19:38:23.030046 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.030022 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-khzjj"] Jul 21 19:38:23.040309 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.040282 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whrpc\" (UniqueName: \"kubernetes.io/projected/6d039d3e-3f40-42d1-ba6e-8d2689b93aee-kube-api-access-whrpc\") pod \"cluster-monitoring-operator-76cf8966f8-khzjj\" (UID: \"6d039d3e-3f40-42d1-ba6e-8d2689b93aee\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-khzjj" Jul 21 19:38:23.040433 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.040330 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95s7t\" (UniqueName: \"kubernetes.io/projected/d9dc2253-8393-4e58-b8a7-9eec02a3ff95-kube-api-access-95s7t\") pod \"volume-data-source-validator-78cf4c6f6-pzvw2\" (UID: \"d9dc2253-8393-4e58-b8a7-9eec02a3ff95\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-pzvw2" Jul 21 19:38:23.040433 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.040359 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d039d3e-3f40-42d1-ba6e-8d2689b93aee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-khzjj\" (UID: \"6d039d3e-3f40-42d1-ba6e-8d2689b93aee\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-khzjj" Jul 21 19:38:23.040433 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.040419 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6d039d3e-3f40-42d1-ba6e-8d2689b93aee-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-khzjj\" (UID: \"6d039d3e-3f40-42d1-ba6e-8d2689b93aee\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-khzjj" Jul 21 19:38:23.056818 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.056787 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95s7t\" (UniqueName: \"kubernetes.io/projected/d9dc2253-8393-4e58-b8a7-9eec02a3ff95-kube-api-access-95s7t\") pod \"volume-data-source-validator-78cf4c6f6-pzvw2\" (UID: \"d9dc2253-8393-4e58-b8a7-9eec02a3ff95\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-pzvw2" Jul 21 19:38:23.126682 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.126645 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-pfgv4"] Jul 21 19:38:23.141602 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.141570 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d039d3e-3f40-42d1-ba6e-8d2689b93aee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-khzjj\" (UID: \"6d039d3e-3f40-42d1-ba6e-8d2689b93aee\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-khzjj" Jul 21 19:38:23.141749 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.141656 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6d039d3e-3f40-42d1-ba6e-8d2689b93aee-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-khzjj\" (UID: \"6d039d3e-3f40-42d1-ba6e-8d2689b93aee\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-khzjj" Jul 21 19:38:23.141749 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.141714 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whrpc\" (UniqueName: \"kubernetes.io/projected/6d039d3e-3f40-42d1-ba6e-8d2689b93aee-kube-api-access-whrpc\") pod \"cluster-monitoring-operator-76cf8966f8-khzjj\" (UID: \"6d039d3e-3f40-42d1-ba6e-8d2689b93aee\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-khzjj" Jul 21 19:38:23.142201 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:23.142173 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 19:38:23.142313 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:23.142248 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d039d3e-3f40-42d1-ba6e-8d2689b93aee-cluster-monitoring-operator-tls podName:6d039d3e-3f40-42d1-ba6e-8d2689b93aee nodeName:}" failed. No retries permitted until 2026-07-21 19:38:23.64222884 +0000 UTC m=+68.602241259 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6d039d3e-3f40-42d1-ba6e-8d2689b93aee-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-khzjj" (UID: "6d039d3e-3f40-42d1-ba6e-8d2689b93aee") : secret "cluster-monitoring-operator-tls" not found Jul 21 19:38:23.142683 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.142651 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6d039d3e-3f40-42d1-ba6e-8d2689b93aee-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-khzjj\" (UID: \"6d039d3e-3f40-42d1-ba6e-8d2689b93aee\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-khzjj" Jul 21 19:38:23.150329 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.150268 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d8497d4b5-7g956"] Jul 21 19:38:23.150425 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.150387 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-pfgv4" Jul 21 19:38:23.154057 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.154036 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-99w5w\"" Jul 21 19:38:23.159862 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.159843 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whrpc\" (UniqueName: \"kubernetes.io/projected/6d039d3e-3f40-42d1-ba6e-8d2689b93aee-kube-api-access-whrpc\") pod \"cluster-monitoring-operator-76cf8966f8-khzjj\" (UID: \"6d039d3e-3f40-42d1-ba6e-8d2689b93aee\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-khzjj" Jul 21 19:38:23.174399 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.174376 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-pfgv4"] Jul 21 19:38:23.174514 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.174417 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d8497d4b5-7g956"] Jul 21 19:38:23.174514 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.174501 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" Jul 21 19:38:23.177636 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.177487 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 21 19:38:23.178039 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.177818 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 21 19:38:23.178039 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.177840 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 21 19:38:23.178383 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.178362 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7l5zt\"" Jul 21 19:38:23.183861 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.183838 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 21 19:38:23.226300 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.226191 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-pzvw2" Jul 21 19:38:23.242048 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.242019 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c159abd-90aa-4655-a6a4-b4cb928e7f16-image-registry-private-configuration\") pod \"image-registry-5d8497d4b5-7g956\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" Jul 21 19:38:23.242187 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.242054 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fg7m\" (UniqueName: \"kubernetes.io/projected/2c159abd-90aa-4655-a6a4-b4cb928e7f16-kube-api-access-9fg7m\") pod \"image-registry-5d8497d4b5-7g956\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" Jul 21 19:38:23.242187 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.242118 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd62r\" (UniqueName: \"kubernetes.io/projected/513c73d3-8233-43fa-b342-403492d74be3-kube-api-access-sd62r\") pod \"network-check-source-7bc5b6bf85-pfgv4\" (UID: \"513c73d3-8233-43fa-b342-403492d74be3\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-pfgv4" Jul 21 19:38:23.242302 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.242193 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c159abd-90aa-4655-a6a4-b4cb928e7f16-registry-tls\") pod \"image-registry-5d8497d4b5-7g956\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" Jul 21 19:38:23.242302 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.242220 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c159abd-90aa-4655-a6a4-b4cb928e7f16-ca-trust-extracted\") pod \"image-registry-5d8497d4b5-7g956\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" Jul 21 19:38:23.242302 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.242248 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c159abd-90aa-4655-a6a4-b4cb928e7f16-installation-pull-secrets\") pod \"image-registry-5d8497d4b5-7g956\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" Jul 21 19:38:23.242302 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.242274 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c159abd-90aa-4655-a6a4-b4cb928e7f16-bound-sa-token\") pod \"image-registry-5d8497d4b5-7g956\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" Jul 21 19:38:23.242529 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.242318 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c159abd-90aa-4655-a6a4-b4cb928e7f16-registry-certificates\") pod \"image-registry-5d8497d4b5-7g956\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" Jul 21 19:38:23.242529 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.242355 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c159abd-90aa-4655-a6a4-b4cb928e7f16-trusted-ca\") pod \"image-registry-5d8497d4b5-7g956\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" Jul 21 19:38:23.343110 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.342868 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c159abd-90aa-4655-a6a4-b4cb928e7f16-registry-tls\") pod \"image-registry-5d8497d4b5-7g956\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" Jul 21 19:38:23.343110 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.342917 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c159abd-90aa-4655-a6a4-b4cb928e7f16-ca-trust-extracted\") pod \"image-registry-5d8497d4b5-7g956\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" Jul 21 19:38:23.343110 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.342935 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c159abd-90aa-4655-a6a4-b4cb928e7f16-installation-pull-secrets\") pod \"image-registry-5d8497d4b5-7g956\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" Jul 21 19:38:23.343110 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.342952 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c159abd-90aa-4655-a6a4-b4cb928e7f16-bound-sa-token\") pod \"image-registry-5d8497d4b5-7g956\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" Jul 21 19:38:23.343110 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.342976 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c159abd-90aa-4655-a6a4-b4cb928e7f16-registry-certificates\") pod \"image-registry-5d8497d4b5-7g956\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" Jul 21 19:38:23.343110 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.342993 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c159abd-90aa-4655-a6a4-b4cb928e7f16-trusted-ca\") pod \"image-registry-5d8497d4b5-7g956\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" Jul 21 19:38:23.343110 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.343048 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c159abd-90aa-4655-a6a4-b4cb928e7f16-image-registry-private-configuration\") pod \"image-registry-5d8497d4b5-7g956\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" Jul 21 19:38:23.343110 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:23.343050 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 19:38:23.343110 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:23.343073 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d8497d4b5-7g956: secret "image-registry-tls" not found Jul 21 19:38:23.343637 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:23.343140 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c159abd-90aa-4655-a6a4-b4cb928e7f16-registry-tls podName:2c159abd-90aa-4655-a6a4-b4cb928e7f16 nodeName:}" failed. No retries permitted until 2026-07-21 19:38:23.843116953 +0000 UTC m=+68.803129385 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c159abd-90aa-4655-a6a4-b4cb928e7f16-registry-tls") pod "image-registry-5d8497d4b5-7g956" (UID: "2c159abd-90aa-4655-a6a4-b4cb928e7f16") : secret "image-registry-tls" not found Jul 21 19:38:23.343637 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.343312 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c159abd-90aa-4655-a6a4-b4cb928e7f16-ca-trust-extracted\") pod \"image-registry-5d8497d4b5-7g956\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" Jul 21 19:38:23.343810 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.343766 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c159abd-90aa-4655-a6a4-b4cb928e7f16-registry-certificates\") pod \"image-registry-5d8497d4b5-7g956\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" Jul 21 19:38:23.343810 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.343066 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fg7m\" (UniqueName: \"kubernetes.io/projected/2c159abd-90aa-4655-a6a4-b4cb928e7f16-kube-api-access-9fg7m\") pod \"image-registry-5d8497d4b5-7g956\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" Jul 21 19:38:23.344015 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.343858 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd62r\" (UniqueName: \"kubernetes.io/projected/513c73d3-8233-43fa-b342-403492d74be3-kube-api-access-sd62r\") pod \"network-check-source-7bc5b6bf85-pfgv4\" (UID: \"513c73d3-8233-43fa-b342-403492d74be3\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-pfgv4" Jul 21 19:38:23.344385 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.344309 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c159abd-90aa-4655-a6a4-b4cb928e7f16-trusted-ca\") pod \"image-registry-5d8497d4b5-7g956\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" Jul 21 19:38:23.346390 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.346345 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c159abd-90aa-4655-a6a4-b4cb928e7f16-installation-pull-secrets\") pod \"image-registry-5d8497d4b5-7g956\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" Jul 21 19:38:23.346916 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.346860 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c159abd-90aa-4655-a6a4-b4cb928e7f16-image-registry-private-configuration\") pod \"image-registry-5d8497d4b5-7g956\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" Jul 21 19:38:23.358779 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.358731 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd62r\" (UniqueName: \"kubernetes.io/projected/513c73d3-8233-43fa-b342-403492d74be3-kube-api-access-sd62r\") pod \"network-check-source-7bc5b6bf85-pfgv4\" (UID: \"513c73d3-8233-43fa-b342-403492d74be3\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-pfgv4" Jul 21 19:38:23.359321 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.359302 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c159abd-90aa-4655-a6a4-b4cb928e7f16-bound-sa-token\") pod \"image-registry-5d8497d4b5-7g956\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" Jul 21 19:38:23.360559 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.360518 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fg7m\" (UniqueName: \"kubernetes.io/projected/2c159abd-90aa-4655-a6a4-b4cb928e7f16-kube-api-access-9fg7m\") pod \"image-registry-5d8497d4b5-7g956\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" Jul 21 19:38:23.453747 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.453647 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-pzvw2"] Jul 21 19:38:23.457870 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:38:23.457842 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9dc2253_8393_4e58_b8a7_9eec02a3ff95.slice/crio-c76448ee6e8530896b0ed1289e524b3658d31208d1679d545ba7debfaffb1200 WatchSource:0}: Error finding container c76448ee6e8530896b0ed1289e524b3658d31208d1679d545ba7debfaffb1200: Status 404 returned error can't find the container with id c76448ee6e8530896b0ed1289e524b3658d31208d1679d545ba7debfaffb1200 Jul 21 19:38:23.469576 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.469551 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-pfgv4" Jul 21 19:38:23.629189 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.629158 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-pfgv4"] Jul 21 19:38:23.632347 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:38:23.632326 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod513c73d3_8233_43fa_b342_403492d74be3.slice/crio-380e426d24f3216dcddf39c8e9334c0db19b13d122166011ff043e813b09a580 WatchSource:0}: Error finding container 380e426d24f3216dcddf39c8e9334c0db19b13d122166011ff043e813b09a580: Status 404 returned error can't find the container with id 380e426d24f3216dcddf39c8e9334c0db19b13d122166011ff043e813b09a580 Jul 21 19:38:23.646714 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.646668 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d039d3e-3f40-42d1-ba6e-8d2689b93aee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-khzjj\" (UID: \"6d039d3e-3f40-42d1-ba6e-8d2689b93aee\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-khzjj" Jul 21 19:38:23.646818 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:23.646803 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 19:38:23.646884 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:23.646866 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d039d3e-3f40-42d1-ba6e-8d2689b93aee-cluster-monitoring-operator-tls podName:6d039d3e-3f40-42d1-ba6e-8d2689b93aee nodeName:}" failed. No retries permitted until 2026-07-21 19:38:24.646846672 +0000 UTC m=+69.606859084 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6d039d3e-3f40-42d1-ba6e-8d2689b93aee-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-khzjj" (UID: "6d039d3e-3f40-42d1-ba6e-8d2689b93aee") : secret "cluster-monitoring-operator-tls" not found Jul 21 19:38:23.807185 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.807149 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-pfgv4" event={"ID":"513c73d3-8233-43fa-b342-403492d74be3","Type":"ContainerStarted","Data":"380e426d24f3216dcddf39c8e9334c0db19b13d122166011ff043e813b09a580"} Jul 21 19:38:23.808568 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.808536 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-pzvw2" event={"ID":"d9dc2253-8393-4e58-b8a7-9eec02a3ff95","Type":"ContainerStarted","Data":"c76448ee6e8530896b0ed1289e524b3658d31208d1679d545ba7debfaffb1200"} Jul 21 19:38:23.848379 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:23.848347 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c159abd-90aa-4655-a6a4-b4cb928e7f16-registry-tls\") pod \"image-registry-5d8497d4b5-7g956\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" Jul 21 19:38:23.848528 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:23.848501 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 19:38:23.848528 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:23.848527 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d8497d4b5-7g956: secret "image-registry-tls" not found Jul 21 19:38:23.848675 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:23.848591 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c159abd-90aa-4655-a6a4-b4cb928e7f16-registry-tls podName:2c159abd-90aa-4655-a6a4-b4cb928e7f16 nodeName:}" failed. No retries permitted until 2026-07-21 19:38:24.848570567 +0000 UTC m=+69.808582984 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c159abd-90aa-4655-a6a4-b4cb928e7f16-registry-tls") pod "image-registry-5d8497d4b5-7g956" (UID: "2c159abd-90aa-4655-a6a4-b4cb928e7f16") : secret "image-registry-tls" not found Jul 21 19:38:24.654712 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:24.654672 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d039d3e-3f40-42d1-ba6e-8d2689b93aee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-khzjj\" (UID: \"6d039d3e-3f40-42d1-ba6e-8d2689b93aee\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-khzjj" Jul 21 19:38:24.655123 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:24.654841 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 19:38:24.655123 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:24.654934 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d039d3e-3f40-42d1-ba6e-8d2689b93aee-cluster-monitoring-operator-tls podName:6d039d3e-3f40-42d1-ba6e-8d2689b93aee nodeName:}" failed. No retries permitted until 2026-07-21 19:38:26.654912823 +0000 UTC m=+71.614925241 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6d039d3e-3f40-42d1-ba6e-8d2689b93aee-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-khzjj" (UID: "6d039d3e-3f40-42d1-ba6e-8d2689b93aee") : secret "cluster-monitoring-operator-tls" not found Jul 21 19:38:24.855964 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:24.855931 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c159abd-90aa-4655-a6a4-b4cb928e7f16-registry-tls\") pod \"image-registry-5d8497d4b5-7g956\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" Jul 21 19:38:24.856105 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:24.856052 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 19:38:24.856105 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:24.856071 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d8497d4b5-7g956: secret "image-registry-tls" not found Jul 21 19:38:24.856174 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:24.856118 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c159abd-90aa-4655-a6a4-b4cb928e7f16-registry-tls podName:2c159abd-90aa-4655-a6a4-b4cb928e7f16 nodeName:}" failed. No retries permitted until 2026-07-21 19:38:26.856103828 +0000 UTC m=+71.816116240 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c159abd-90aa-4655-a6a4-b4cb928e7f16-registry-tls") pod "image-registry-5d8497d4b5-7g956" (UID: "2c159abd-90aa-4655-a6a4-b4cb928e7f16") : secret "image-registry-tls" not found Jul 21 19:38:26.671009 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:26.670936 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d039d3e-3f40-42d1-ba6e-8d2689b93aee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-khzjj\" (UID: \"6d039d3e-3f40-42d1-ba6e-8d2689b93aee\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-khzjj" Jul 21 19:38:26.671521 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:26.671108 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 19:38:26.671521 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:26.671194 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d039d3e-3f40-42d1-ba6e-8d2689b93aee-cluster-monitoring-operator-tls podName:6d039d3e-3f40-42d1-ba6e-8d2689b93aee nodeName:}" failed. No retries permitted until 2026-07-21 19:38:30.671173036 +0000 UTC m=+75.631185456 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6d039d3e-3f40-42d1-ba6e-8d2689b93aee-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-khzjj" (UID: "6d039d3e-3f40-42d1-ba6e-8d2689b93aee") : secret "cluster-monitoring-operator-tls" not found Jul 21 19:38:26.817631 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:26.817594 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lh2hq" event={"ID":"9dfa1c3e-9a8f-4813-a991-7072ca083d84","Type":"ContainerStarted","Data":"9078db3674e60722fa7461d6ae16011f93a3d1a94e4a2e5e2de1cc0cd0dfe39e"} Jul 21 19:38:26.817815 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:26.817681 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lh2hq" Jul 21 19:38:26.819112 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:26.819085 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q9g56" event={"ID":"dfb82dd4-3122-4ebb-aabc-84682403809d","Type":"ContainerStarted","Data":"134d3268a44fb7e2fc67903dd28064e4f536e179992740f615e2d81b6f34fce3"} Jul 21 19:38:26.820403 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:26.820382 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-pfgv4" event={"ID":"513c73d3-8233-43fa-b342-403492d74be3","Type":"ContainerStarted","Data":"c734f25d2764996c8f4074dab00ba92b9fc897b3d83bf7188c3526ddddabab17"} Jul 21 19:38:26.834535 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:26.834496 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lh2hq" podStartSLOduration=67.204025425 podStartE2EDuration="1m11.834483707s" totalImagesPullingTime="4.630458282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:38:26.833854125 +0000 UTC m=+71.793866571" watchObservedRunningTime="2026-07-21 19:38:26.834483707 +0000 UTC m=+71.794496170" Jul 21 19:38:26.849728 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:26.849681 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-q9g56" podStartSLOduration=67.187983894 podStartE2EDuration="1m11.849669415s" totalImagesPullingTime="4.661685521s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 19:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:38:26.848350793 +0000 UTC m=+71.808363229" watchObservedRunningTime="2026-07-21 19:38:26.849669415 +0000 UTC m=+71.809681826" Jul 21 19:38:26.864469 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:26.864428 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-pfgv4" podStartSLOduration=1.24605415 podStartE2EDuration="3.864416401s" totalImagesPullingTime="2.618362251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:38:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:38:26.863733892 +0000 UTC m=+71.823746327" watchObservedRunningTime="2026-07-21 19:38:26.864416401 +0000 UTC m=+71.824428835" Jul 21 19:38:26.873021 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:26.872997 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c159abd-90aa-4655-a6a4-b4cb928e7f16-registry-tls\") pod \"image-registry-5d8497d4b5-7g956\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" Jul 21 19:38:26.873161 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:26.873143 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 19:38:26.873216 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:26.873163 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d8497d4b5-7g956: secret "image-registry-tls" not found Jul 21 19:38:26.873216 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:26.873209 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c159abd-90aa-4655-a6a4-b4cb928e7f16-registry-tls podName:2c159abd-90aa-4655-a6a4-b4cb928e7f16 nodeName:}" failed. No retries permitted until 2026-07-21 19:38:30.873195084 +0000 UTC m=+75.833207502 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c159abd-90aa-4655-a6a4-b4cb928e7f16-registry-tls") pod "image-registry-5d8497d4b5-7g956" (UID: "2c159abd-90aa-4655-a6a4-b4cb928e7f16") : secret "image-registry-tls" not found Jul 21 19:38:27.824221 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:27.824187 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-pzvw2" event={"ID":"d9dc2253-8393-4e58-b8a7-9eec02a3ff95","Type":"ContainerStarted","Data":"63117b4e0eb3cbd4269066ee11b724e89c06715d5d95a2ffe489e8b47052d8a2"} Jul 21 19:38:27.839289 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:27.839247 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-pzvw2" podStartSLOduration=2.049457175 podStartE2EDuration="5.839233638s" totalImagesPullingTime="3.789776463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:38:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:38:27.838778522 +0000 UTC m=+72.798790956" watchObservedRunningTime="2026-07-21 19:38:27.839233638 +0000 UTC m=+72.799246072" Jul 21 19:38:30.700518 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:30.700472 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d039d3e-3f40-42d1-ba6e-8d2689b93aee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-khzjj\" (UID: \"6d039d3e-3f40-42d1-ba6e-8d2689b93aee\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-khzjj" Jul 21 19:38:30.700917 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:30.700615 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 19:38:30.700917 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:30.700678 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d039d3e-3f40-42d1-ba6e-8d2689b93aee-cluster-monitoring-operator-tls podName:6d039d3e-3f40-42d1-ba6e-8d2689b93aee nodeName:}" failed. No retries permitted until 2026-07-21 19:38:38.700663443 +0000 UTC m=+83.660675855 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6d039d3e-3f40-42d1-ba6e-8d2689b93aee-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-khzjj" (UID: "6d039d3e-3f40-42d1-ba6e-8d2689b93aee") : secret "cluster-monitoring-operator-tls" not found Jul 21 19:38:30.902114 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:30.902085 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c159abd-90aa-4655-a6a4-b4cb928e7f16-registry-tls\") pod \"image-registry-5d8497d4b5-7g956\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" Jul 21 19:38:30.902249 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:30.902189 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 19:38:30.902249 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:30.902200 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d8497d4b5-7g956: secret "image-registry-tls" not found Jul 21 19:38:30.902249 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:30.902245 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c159abd-90aa-4655-a6a4-b4cb928e7f16-registry-tls podName:2c159abd-90aa-4655-a6a4-b4cb928e7f16 nodeName:}" failed. No retries permitted until 2026-07-21 19:38:38.902228994 +0000 UTC m=+83.862241409 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c159abd-90aa-4655-a6a4-b4cb928e7f16-registry-tls") pod "image-registry-5d8497d4b5-7g956" (UID: "2c159abd-90aa-4655-a6a4-b4cb928e7f16") : secret "image-registry-tls" not found Jul 21 19:38:31.589920 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:31.589876 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-z4wl4"] Jul 21 19:38:31.591902 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:31.591878 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z4wl4" Jul 21 19:38:31.595048 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:31.595026 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 21 19:38:31.595559 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:31.595543 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 21 19:38:31.595635 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:31.595583 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 21 19:38:31.596850 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:31.596830 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 21 19:38:31.597002 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:31.596884 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hqhr5\"" Jul 21 19:38:31.609852 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:31.609830 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z4wl4"] Jul 21 19:38:31.706746 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:31.706724 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21fbc355-5f0b-495a-bb69-38730c31a5b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z4wl4\" (UID: \"21fbc355-5f0b-495a-bb69-38730c31a5b2\") " pod="openshift-insights/insights-runtime-extractor-z4wl4" Jul 21 19:38:31.707117 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:31.706818 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/21fbc355-5f0b-495a-bb69-38730c31a5b2-crio-socket\") pod \"insights-runtime-extractor-z4wl4\" (UID: \"21fbc355-5f0b-495a-bb69-38730c31a5b2\") " pod="openshift-insights/insights-runtime-extractor-z4wl4" Jul 21 19:38:31.707117 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:31.706851 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/21fbc355-5f0b-495a-bb69-38730c31a5b2-data-volume\") pod \"insights-runtime-extractor-z4wl4\" (UID: \"21fbc355-5f0b-495a-bb69-38730c31a5b2\") " pod="openshift-insights/insights-runtime-extractor-z4wl4" Jul 21 19:38:31.707117 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:31.706879 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21fbc355-5f0b-495a-bb69-38730c31a5b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z4wl4\" (UID: \"21fbc355-5f0b-495a-bb69-38730c31a5b2\") " pod="openshift-insights/insights-runtime-extractor-z4wl4" Jul 21 19:38:31.707117 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:31.706923 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg42p\" (UniqueName: \"kubernetes.io/projected/21fbc355-5f0b-495a-bb69-38730c31a5b2-kube-api-access-lg42p\") pod \"insights-runtime-extractor-z4wl4\" (UID: \"21fbc355-5f0b-495a-bb69-38730c31a5b2\") " pod="openshift-insights/insights-runtime-extractor-z4wl4" Jul 21 19:38:31.808143 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:31.808121 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21fbc355-5f0b-495a-bb69-38730c31a5b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z4wl4\" (UID: \"21fbc355-5f0b-495a-bb69-38730c31a5b2\") " pod="openshift-insights/insights-runtime-extractor-z4wl4" Jul 21 19:38:31.808236 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:31.808187 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 19:38:31.808279 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:31.808242 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21fbc355-5f0b-495a-bb69-38730c31a5b2-kube-rbac-proxy-cm podName:21fbc355-5f0b-495a-bb69-38730c31a5b2 nodeName:}" failed. No retries permitted until 2026-07-21 19:38:32.30822763 +0000 UTC m=+77.268240042 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/21fbc355-5f0b-495a-bb69-38730c31a5b2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z4wl4" (UID: "21fbc355-5f0b-495a-bb69-38730c31a5b2") : configmap "kube-rbac-proxy" not found Jul 21 19:38:31.808279 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:31.808257 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/21fbc355-5f0b-495a-bb69-38730c31a5b2-crio-socket\") pod \"insights-runtime-extractor-z4wl4\" (UID: \"21fbc355-5f0b-495a-bb69-38730c31a5b2\") " pod="openshift-insights/insights-runtime-extractor-z4wl4" Jul 21 19:38:31.808279 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:31.808277 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/21fbc355-5f0b-495a-bb69-38730c31a5b2-data-volume\") pod \"insights-runtime-extractor-z4wl4\" (UID: \"21fbc355-5f0b-495a-bb69-38730c31a5b2\") " pod="openshift-insights/insights-runtime-extractor-z4wl4" Jul 21 19:38:31.808460 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:31.808292 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21fbc355-5f0b-495a-bb69-38730c31a5b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z4wl4\" (UID: \"21fbc355-5f0b-495a-bb69-38730c31a5b2\") " pod="openshift-insights/insights-runtime-extractor-z4wl4" Jul 21 19:38:31.808460 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:31.808356 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 19:38:31.808460 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:31.808354 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/21fbc355-5f0b-495a-bb69-38730c31a5b2-crio-socket\") pod \"insights-runtime-extractor-z4wl4\" (UID: \"21fbc355-5f0b-495a-bb69-38730c31a5b2\") " pod="openshift-insights/insights-runtime-extractor-z4wl4" Jul 21 19:38:31.808460 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:31.808392 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21fbc355-5f0b-495a-bb69-38730c31a5b2-insights-runtime-extractor-tls podName:21fbc355-5f0b-495a-bb69-38730c31a5b2 nodeName:}" failed. No retries permitted until 2026-07-21 19:38:32.308384056 +0000 UTC m=+77.268396468 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/21fbc355-5f0b-495a-bb69-38730c31a5b2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z4wl4" (UID: "21fbc355-5f0b-495a-bb69-38730c31a5b2") : secret "insights-runtime-extractor-tls" not found Jul 21 19:38:31.808460 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:31.808409 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg42p\" (UniqueName: \"kubernetes.io/projected/21fbc355-5f0b-495a-bb69-38730c31a5b2-kube-api-access-lg42p\") pod \"insights-runtime-extractor-z4wl4\" (UID: \"21fbc355-5f0b-495a-bb69-38730c31a5b2\") " pod="openshift-insights/insights-runtime-extractor-z4wl4" Jul 21 19:38:31.808622 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:31.808537 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/21fbc355-5f0b-495a-bb69-38730c31a5b2-data-volume\") pod \"insights-runtime-extractor-z4wl4\" (UID: \"21fbc355-5f0b-495a-bb69-38730c31a5b2\") " pod="openshift-insights/insights-runtime-extractor-z4wl4" Jul 21 19:38:31.827401 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:31.827381 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg42p\" (UniqueName: \"kubernetes.io/projected/21fbc355-5f0b-495a-bb69-38730c31a5b2-kube-api-access-lg42p\") pod \"insights-runtime-extractor-z4wl4\" (UID: \"21fbc355-5f0b-495a-bb69-38730c31a5b2\") " pod="openshift-insights/insights-runtime-extractor-z4wl4" Jul 21 19:38:32.240981 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:32.240948 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9n6fd"] Jul 21 19:38:32.242852 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:32.242836 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9n6fd" Jul 21 19:38:32.245702 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:32.245681 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-djxgj\"" Jul 21 19:38:32.246166 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:32.246151 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 21 19:38:32.246962 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:32.246947 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 21 19:38:32.258976 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:32.258956 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9n6fd"] Jul 21 19:38:32.311512 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:32.311490 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21fbc355-5f0b-495a-bb69-38730c31a5b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z4wl4\" (UID: \"21fbc355-5f0b-495a-bb69-38730c31a5b2\") " pod="openshift-insights/insights-runtime-extractor-z4wl4" Jul 21 19:38:32.311619 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:32.311531 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7nhh\" (UniqueName: \"kubernetes.io/projected/6a13e076-b654-40d1-a489-605fc65d73c7-kube-api-access-d7nhh\") pod \"migrator-7cc9c7ffd7-9n6fd\" (UID: \"6a13e076-b654-40d1-a489-605fc65d73c7\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9n6fd" Jul 21 19:38:32.311619 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:32.311564 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21fbc355-5f0b-495a-bb69-38730c31a5b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z4wl4\" (UID: \"21fbc355-5f0b-495a-bb69-38730c31a5b2\") " pod="openshift-insights/insights-runtime-extractor-z4wl4" Jul 21 19:38:32.311851 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:32.311629 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 19:38:32.311851 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:32.311644 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 19:38:32.311851 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:32.311713 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21fbc355-5f0b-495a-bb69-38730c31a5b2-insights-runtime-extractor-tls podName:21fbc355-5f0b-495a-bb69-38730c31a5b2 nodeName:}" failed. No retries permitted until 2026-07-21 19:38:33.311693961 +0000 UTC m=+78.271706376 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/21fbc355-5f0b-495a-bb69-38730c31a5b2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z4wl4" (UID: "21fbc355-5f0b-495a-bb69-38730c31a5b2") : secret "insights-runtime-extractor-tls" not found Jul 21 19:38:32.311851 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:32.311798 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21fbc355-5f0b-495a-bb69-38730c31a5b2-kube-rbac-proxy-cm podName:21fbc355-5f0b-495a-bb69-38730c31a5b2 nodeName:}" failed. No retries permitted until 2026-07-21 19:38:33.311784142 +0000 UTC m=+78.271796568 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/21fbc355-5f0b-495a-bb69-38730c31a5b2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z4wl4" (UID: "21fbc355-5f0b-495a-bb69-38730c31a5b2") : configmap "kube-rbac-proxy" not found Jul 21 19:38:32.412586 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:32.412563 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7nhh\" (UniqueName: \"kubernetes.io/projected/6a13e076-b654-40d1-a489-605fc65d73c7-kube-api-access-d7nhh\") pod \"migrator-7cc9c7ffd7-9n6fd\" (UID: \"6a13e076-b654-40d1-a489-605fc65d73c7\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9n6fd" Jul 21 19:38:32.421724 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:32.421697 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7nhh\" (UniqueName: \"kubernetes.io/projected/6a13e076-b654-40d1-a489-605fc65d73c7-kube-api-access-d7nhh\") pod \"migrator-7cc9c7ffd7-9n6fd\" (UID: \"6a13e076-b654-40d1-a489-605fc65d73c7\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9n6fd" Jul 21 19:38:32.551665 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:32.551597 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9n6fd" Jul 21 19:38:32.673910 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:32.673862 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9n6fd"] Jul 21 19:38:32.677092 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:38:32.677066 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a13e076_b654_40d1_a489_605fc65d73c7.slice/crio-6d4b235bc23849614a6f01423beea5a2592a9f38255e29b5ff317aa75d3ce54f WatchSource:0}: Error finding container 6d4b235bc23849614a6f01423beea5a2592a9f38255e29b5ff317aa75d3ce54f: Status 404 returned error can't find the container with id 6d4b235bc23849614a6f01423beea5a2592a9f38255e29b5ff317aa75d3ce54f Jul 21 19:38:32.837763 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:32.837700 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9n6fd" event={"ID":"6a13e076-b654-40d1-a489-605fc65d73c7","Type":"ContainerStarted","Data":"6d4b235bc23849614a6f01423beea5a2592a9f38255e29b5ff317aa75d3ce54f"} Jul 21 19:38:33.319904 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:33.319867 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21fbc355-5f0b-495a-bb69-38730c31a5b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z4wl4\" (UID: \"21fbc355-5f0b-495a-bb69-38730c31a5b2\") " pod="openshift-insights/insights-runtime-extractor-z4wl4" Jul 21 19:38:33.320092 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:33.319988 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21fbc355-5f0b-495a-bb69-38730c31a5b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z4wl4\" (UID: \"21fbc355-5f0b-495a-bb69-38730c31a5b2\") " pod="openshift-insights/insights-runtime-extractor-z4wl4" Jul 21 19:38:33.320092 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:33.319992 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 19:38:33.320207 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:33.320056 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 19:38:33.320207 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:33.320118 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21fbc355-5f0b-495a-bb69-38730c31a5b2-kube-rbac-proxy-cm podName:21fbc355-5f0b-495a-bb69-38730c31a5b2 nodeName:}" failed. No retries permitted until 2026-07-21 19:38:35.3201004 +0000 UTC m=+80.280112829 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/21fbc355-5f0b-495a-bb69-38730c31a5b2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z4wl4" (UID: "21fbc355-5f0b-495a-bb69-38730c31a5b2") : configmap "kube-rbac-proxy" not found Jul 21 19:38:33.320207 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:33.320201 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21fbc355-5f0b-495a-bb69-38730c31a5b2-insights-runtime-extractor-tls podName:21fbc355-5f0b-495a-bb69-38730c31a5b2 nodeName:}" failed. No retries permitted until 2026-07-21 19:38:35.32017555 +0000 UTC m=+80.280187963 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/21fbc355-5f0b-495a-bb69-38730c31a5b2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z4wl4" (UID: "21fbc355-5f0b-495a-bb69-38730c31a5b2") : secret "insights-runtime-extractor-tls" not found Jul 21 19:38:33.349214 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:33.349176 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6w4zf_926ad8ee-c7f6-43c8-bf81-908b8e6824a8/dns-node-resolver/0.log" Jul 21 19:38:34.552808 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:34.552782 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g8vsp_8ac4304f-d17a-4a74-aacb-1f47fd557e74/node-ca/0.log" Jul 21 19:38:34.845612 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:34.845539 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9n6fd" event={"ID":"6a13e076-b654-40d1-a489-605fc65d73c7","Type":"ContainerStarted","Data":"abd7dfb5ca7afb75ea65cd4dea023676f468f2c2efdb84315991fbc9fd812c5f"} Jul 21 19:38:34.845612 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:34.845586 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9n6fd" event={"ID":"6a13e076-b654-40d1-a489-605fc65d73c7","Type":"ContainerStarted","Data":"a3f5b6cedbf8f1bc256681d43a2f01a658acffc4268c654d5be09a95df00e614"} Jul 21 19:38:35.334025 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:35.333986 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21fbc355-5f0b-495a-bb69-38730c31a5b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z4wl4\" (UID: \"21fbc355-5f0b-495a-bb69-38730c31a5b2\") " pod="openshift-insights/insights-runtime-extractor-z4wl4" Jul 21 19:38:35.334222 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:35.334068 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21fbc355-5f0b-495a-bb69-38730c31a5b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z4wl4\" (UID: \"21fbc355-5f0b-495a-bb69-38730c31a5b2\") " pod="openshift-insights/insights-runtime-extractor-z4wl4" Jul 21 19:38:35.334222 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:35.334112 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 19:38:35.334222 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:35.334168 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 19:38:35.334222 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:35.334194 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21fbc355-5f0b-495a-bb69-38730c31a5b2-kube-rbac-proxy-cm podName:21fbc355-5f0b-495a-bb69-38730c31a5b2 nodeName:}" failed. No retries permitted until 2026-07-21 19:38:39.33417586 +0000 UTC m=+84.294188272 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/21fbc355-5f0b-495a-bb69-38730c31a5b2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z4wl4" (UID: "21fbc355-5f0b-495a-bb69-38730c31a5b2") : configmap "kube-rbac-proxy" not found Jul 21 19:38:35.334222 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:35.334215 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21fbc355-5f0b-495a-bb69-38730c31a5b2-insights-runtime-extractor-tls podName:21fbc355-5f0b-495a-bb69-38730c31a5b2 nodeName:}" failed. No retries permitted until 2026-07-21 19:38:39.33420372 +0000 UTC m=+84.294216132 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/21fbc355-5f0b-495a-bb69-38730c31a5b2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z4wl4" (UID: "21fbc355-5f0b-495a-bb69-38730c31a5b2") : secret "insights-runtime-extractor-tls" not found Jul 21 19:38:35.550172 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:35.550149 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wsmxp_8e6be3ee-b04a-4428-82b5-a37cbd6d0e84/serve-healthcheck-canary/0.log" Jul 21 19:38:38.759750 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:38.759629 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d039d3e-3f40-42d1-ba6e-8d2689b93aee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-khzjj\" (UID: \"6d039d3e-3f40-42d1-ba6e-8d2689b93aee\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-khzjj" Jul 21 19:38:38.760117 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:38.759773 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 19:38:38.760117 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:38.759833 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d039d3e-3f40-42d1-ba6e-8d2689b93aee-cluster-monitoring-operator-tls podName:6d039d3e-3f40-42d1-ba6e-8d2689b93aee nodeName:}" failed. No retries permitted until 2026-07-21 19:38:54.759816831 +0000 UTC m=+99.719829255 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6d039d3e-3f40-42d1-ba6e-8d2689b93aee-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-khzjj" (UID: "6d039d3e-3f40-42d1-ba6e-8d2689b93aee") : secret "cluster-monitoring-operator-tls" not found Jul 21 19:38:38.961120 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:38.961085 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c159abd-90aa-4655-a6a4-b4cb928e7f16-registry-tls\") pod \"image-registry-5d8497d4b5-7g956\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" Jul 21 19:38:38.961278 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:38.961192 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 19:38:38.961278 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:38.961204 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d8497d4b5-7g956: secret "image-registry-tls" not found Jul 21 19:38:38.961278 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:38.961254 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c159abd-90aa-4655-a6a4-b4cb928e7f16-registry-tls podName:2c159abd-90aa-4655-a6a4-b4cb928e7f16 nodeName:}" failed. No retries permitted until 2026-07-21 19:38:54.961236971 +0000 UTC m=+99.921249407 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c159abd-90aa-4655-a6a4-b4cb928e7f16-registry-tls") pod "image-registry-5d8497d4b5-7g956" (UID: "2c159abd-90aa-4655-a6a4-b4cb928e7f16") : secret "image-registry-tls" not found Jul 21 19:38:39.364493 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:39.364464 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21fbc355-5f0b-495a-bb69-38730c31a5b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z4wl4\" (UID: \"21fbc355-5f0b-495a-bb69-38730c31a5b2\") " pod="openshift-insights/insights-runtime-extractor-z4wl4" Jul 21 19:38:39.364636 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:39.364516 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21fbc355-5f0b-495a-bb69-38730c31a5b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z4wl4\" (UID: \"21fbc355-5f0b-495a-bb69-38730c31a5b2\") " pod="openshift-insights/insights-runtime-extractor-z4wl4" Jul 21 19:38:39.364676 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:39.364632 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 19:38:39.364676 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:39.364672 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 19:38:39.364731 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:39.364712 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21fbc355-5f0b-495a-bb69-38730c31a5b2-insights-runtime-extractor-tls podName:21fbc355-5f0b-495a-bb69-38730c31a5b2 nodeName:}" failed. No retries permitted until 2026-07-21 19:38:47.364695029 +0000 UTC m=+92.324707454 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/21fbc355-5f0b-495a-bb69-38730c31a5b2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z4wl4" (UID: "21fbc355-5f0b-495a-bb69-38730c31a5b2") : secret "insights-runtime-extractor-tls" not found Jul 21 19:38:39.364731 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:39.364727 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21fbc355-5f0b-495a-bb69-38730c31a5b2-kube-rbac-proxy-cm podName:21fbc355-5f0b-495a-bb69-38730c31a5b2 nodeName:}" failed. No retries permitted until 2026-07-21 19:38:47.364720835 +0000 UTC m=+92.324733246 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/21fbc355-5f0b-495a-bb69-38730c31a5b2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z4wl4" (UID: "21fbc355-5f0b-495a-bb69-38730c31a5b2") : configmap "kube-rbac-proxy" not found Jul 21 19:38:47.418582 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:47.418548 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21fbc355-5f0b-495a-bb69-38730c31a5b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z4wl4\" (UID: \"21fbc355-5f0b-495a-bb69-38730c31a5b2\") " pod="openshift-insights/insights-runtime-extractor-z4wl4" Jul 21 19:38:47.419114 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:47.418616 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21fbc355-5f0b-495a-bb69-38730c31a5b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z4wl4\" (UID: \"21fbc355-5f0b-495a-bb69-38730c31a5b2\") " pod="openshift-insights/insights-runtime-extractor-z4wl4" Jul 21 19:38:47.419114 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:47.418701 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 19:38:47.419114 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:38:47.418756 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21fbc355-5f0b-495a-bb69-38730c31a5b2-insights-runtime-extractor-tls podName:21fbc355-5f0b-495a-bb69-38730c31a5b2 nodeName:}" failed. No retries permitted until 2026-07-21 19:39:03.418743719 +0000 UTC m=+108.378756132 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/21fbc355-5f0b-495a-bb69-38730c31a5b2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z4wl4" (UID: "21fbc355-5f0b-495a-bb69-38730c31a5b2") : secret "insights-runtime-extractor-tls" not found Jul 21 19:38:47.419288 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:47.419237 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21fbc355-5f0b-495a-bb69-38730c31a5b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z4wl4\" (UID: \"21fbc355-5f0b-495a-bb69-38730c31a5b2\") " pod="openshift-insights/insights-runtime-extractor-z4wl4" Jul 21 19:38:53.864588 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:53.864541 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a044c778-bc03-453d-829e-dfb6cca7e844-metrics-tls\") pod \"dns-default-pgd57\" (UID: \"a044c778-bc03-453d-829e-dfb6cca7e844\") " pod="openshift-dns/dns-default-pgd57" Jul 21 19:38:53.866683 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:53.866660 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a044c778-bc03-453d-829e-dfb6cca7e844-metrics-tls\") pod \"dns-default-pgd57\" (UID: \"a044c778-bc03-453d-829e-dfb6cca7e844\") " pod="openshift-dns/dns-default-pgd57" Jul 21 19:38:54.126118 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:54.126042 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-46cqs\"" Jul 21 19:38:54.134224 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:54.134210 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pgd57" Jul 21 19:38:54.254875 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:54.254817 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9n6fd" podStartSLOduration=20.958014401 podStartE2EDuration="22.25479206s" totalImagesPullingTime="1.296777659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:38:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:38:34.866052871 +0000 UTC m=+79.826065306" watchObservedRunningTime="2026-07-21 19:38:54.25479206 +0000 UTC m=+99.214804495" Jul 21 19:38:54.255055 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:54.254999 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pgd57"] Jul 21 19:38:54.258152 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:38:54.258120 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda044c778_bc03_453d_829e_dfb6cca7e844.slice/crio-cfb2ea1c3855c3e45c15132ab2b8d637ea1269d34653608240a965dbc6b0d179 WatchSource:0}: Error finding container cfb2ea1c3855c3e45c15132ab2b8d637ea1269d34653608240a965dbc6b0d179: Status 404 returned error can't find the container with id cfb2ea1c3855c3e45c15132ab2b8d637ea1269d34653608240a965dbc6b0d179 Jul 21 19:38:54.769970 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:54.769932 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d039d3e-3f40-42d1-ba6e-8d2689b93aee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-khzjj\" (UID: \"6d039d3e-3f40-42d1-ba6e-8d2689b93aee\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-khzjj" Jul 21 19:38:54.772834 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:54.772794 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d039d3e-3f40-42d1-ba6e-8d2689b93aee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-khzjj\" (UID: \"6d039d3e-3f40-42d1-ba6e-8d2689b93aee\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-khzjj" Jul 21 19:38:54.837497 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:54.837464 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-khzjj" Jul 21 19:38:54.905279 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:54.905232 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pgd57" event={"ID":"a044c778-bc03-453d-829e-dfb6cca7e844","Type":"ContainerStarted","Data":"cfb2ea1c3855c3e45c15132ab2b8d637ea1269d34653608240a965dbc6b0d179"} Jul 21 19:38:54.971459 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:54.971422 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c159abd-90aa-4655-a6a4-b4cb928e7f16-registry-tls\") pod \"image-registry-5d8497d4b5-7g956\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" Jul 21 19:38:54.974208 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:54.974166 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-khzjj"] Jul 21 19:38:54.974208 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:54.974200 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c159abd-90aa-4655-a6a4-b4cb928e7f16-registry-tls\") pod \"image-registry-5d8497d4b5-7g956\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" Jul 21 19:38:54.977707 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:38:54.977682 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d039d3e_3f40_42d1_ba6e_8d2689b93aee.slice/crio-27fa54b2a879fea4c763b69433906a47c30c72785cad635a07fced0b43f1a827 WatchSource:0}: Error finding container 27fa54b2a879fea4c763b69433906a47c30c72785cad635a07fced0b43f1a827: Status 404 returned error can't find the container with id 27fa54b2a879fea4c763b69433906a47c30c72785cad635a07fced0b43f1a827 Jul 21 19:38:54.986601 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:54.986428 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" Jul 21 19:38:55.130570 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:55.130382 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d8497d4b5-7g956"] Jul 21 19:38:55.133688 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:38:55.133659 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c159abd_90aa_4655_a6a4_b4cb928e7f16.slice/crio-ea2c290a4908ec2603ed5e95cb40b52e06368d11f49b3a5eeba65e9cc92fde63 WatchSource:0}: Error finding container ea2c290a4908ec2603ed5e95cb40b52e06368d11f49b3a5eeba65e9cc92fde63: Status 404 returned error can't find the container with id ea2c290a4908ec2603ed5e95cb40b52e06368d11f49b3a5eeba65e9cc92fde63 Jul 21 19:38:55.909694 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:55.909658 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-khzjj" event={"ID":"6d039d3e-3f40-42d1-ba6e-8d2689b93aee","Type":"ContainerStarted","Data":"27fa54b2a879fea4c763b69433906a47c30c72785cad635a07fced0b43f1a827"} Jul 21 19:38:55.911127 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:55.911098 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" event={"ID":"2c159abd-90aa-4655-a6a4-b4cb928e7f16","Type":"ContainerStarted","Data":"f7d645577ccb45c8c89d62d72baeef31bc6847382d0cb78587ac332be4f9dd33"} Jul 21 19:38:55.911270 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:55.911144 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" event={"ID":"2c159abd-90aa-4655-a6a4-b4cb928e7f16","Type":"ContainerStarted","Data":"ea2c290a4908ec2603ed5e95cb40b52e06368d11f49b3a5eeba65e9cc92fde63"} Jul 21 19:38:55.911270 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:55.911194 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" Jul 21 19:38:55.912675 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:55.912652 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pgd57" event={"ID":"a044c778-bc03-453d-829e-dfb6cca7e844","Type":"ContainerStarted","Data":"526be9a1edaf0f84cc5790c86a0d364c2a7e36791df67bc4f10b5fadc79f2eee"} Jul 21 19:38:55.912786 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:55.912685 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pgd57" event={"ID":"a044c778-bc03-453d-829e-dfb6cca7e844","Type":"ContainerStarted","Data":"b3b9e74847ef92c11c98bca6f292013a3280ec1465034758fc6402bae5652510"} Jul 21 19:38:55.912786 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:55.912779 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pgd57" Jul 21 19:38:55.932814 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:55.932772 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" podStartSLOduration=32.932759903 podStartE2EDuration="32.932759903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:38:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:38:55.93154518 +0000 UTC m=+100.891557613" watchObservedRunningTime="2026-07-21 19:38:55.932759903 +0000 UTC m=+100.892772336" Jul 21 19:38:55.954060 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:55.953991 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pgd57" podStartSLOduration=65.51428836 podStartE2EDuration="1m6.953979062s" totalImagesPullingTime="1.439690702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:37:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:38:55.952826994 +0000 UTC m=+100.912839425" watchObservedRunningTime="2026-07-21 19:38:55.953979062 +0000 UTC m=+100.913991496" Jul 21 19:38:57.164475 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.164436 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cd77fbccd-rfzwd"] Jul 21 19:38:57.175331 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.175301 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cd77fbccd-rfzwd" Jul 21 19:38:57.178765 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.178742 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 21 19:38:57.178926 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.178742 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 21 19:38:57.178926 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.178804 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 21 19:38:57.180067 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.180043 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 21 19:38:57.182336 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.182314 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-fkghv\"" Jul 21 19:38:57.184390 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.184366 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cd77fbccd-rfzwd"] Jul 21 19:38:57.261763 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.261729 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d8497d4b5-7g956"] Jul 21 19:38:57.279276 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.279244 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-4fk66"] Jul 21 19:38:57.289041 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.289017 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-4fk66" Jul 21 19:38:57.289153 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.289127 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69c5f6c8bb-8j8cl"] Jul 21 19:38:57.291400 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.291374 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6w2b\" (UniqueName: \"kubernetes.io/projected/e7d41260-57b9-4f2a-b2da-f23524fbb45c-kube-api-access-c6w2b\") pod \"managed-serviceaccount-addon-agent-6cd77fbccd-rfzwd\" (UID: \"e7d41260-57b9-4f2a-b2da-f23524fbb45c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cd77fbccd-rfzwd" Jul 21 19:38:57.291506 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.291487 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7d41260-57b9-4f2a-b2da-f23524fbb45c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6cd77fbccd-rfzwd\" (UID: \"e7d41260-57b9-4f2a-b2da-f23524fbb45c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cd77fbccd-rfzwd" Jul 21 19:38:57.291757 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.291743 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 21 19:38:57.291995 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.291977 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 21 19:38:57.292749 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.292734 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-wzsvp\"" Jul 21 19:38:57.297801 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.297782 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-4fk66"] Jul 21 19:38:57.297926 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.297859 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69c5f6c8bb-8j8cl" Jul 21 19:38:57.301692 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.301675 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vr2bh\"" Jul 21 19:38:57.301791 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.301756 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 21 19:38:57.301791 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.301768 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 21 19:38:57.301791 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.301783 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 21 19:38:57.302016 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.301789 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 21 19:38:57.302016 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.301869 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 21 19:38:57.307239 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.307219 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69c5f6c8bb-8j8cl"] Jul 21 19:38:57.392823 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.392795 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx4dj\" (UniqueName: \"kubernetes.io/projected/252c47fa-fc69-463a-a137-693698551a5c-kube-api-access-gx4dj\") pod \"console-69c5f6c8bb-8j8cl\" (UID: \"252c47fa-fc69-463a-a137-693698551a5c\") " pod="openshift-console/console-69c5f6c8bb-8j8cl" Jul 21 19:38:57.392823 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.392822 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/252c47fa-fc69-463a-a137-693698551a5c-console-oauth-config\") pod \"console-69c5f6c8bb-8j8cl\" (UID: \"252c47fa-fc69-463a-a137-693698551a5c\") " pod="openshift-console/console-69c5f6c8bb-8j8cl" Jul 21 19:38:57.392994 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.392847 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6w2b\" (UniqueName: \"kubernetes.io/projected/e7d41260-57b9-4f2a-b2da-f23524fbb45c-kube-api-access-c6w2b\") pod \"managed-serviceaccount-addon-agent-6cd77fbccd-rfzwd\" (UID: \"e7d41260-57b9-4f2a-b2da-f23524fbb45c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cd77fbccd-rfzwd" Jul 21 19:38:57.392994 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.392862 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/252c47fa-fc69-463a-a137-693698551a5c-oauth-serving-cert\") pod \"console-69c5f6c8bb-8j8cl\" (UID: \"252c47fa-fc69-463a-a137-693698551a5c\") " pod="openshift-console/console-69c5f6c8bb-8j8cl" Jul 21 19:38:57.392994 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.392916 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d88ml\" (UniqueName: \"kubernetes.io/projected/82871ec4-5735-4674-8938-338a3bdc268e-kube-api-access-d88ml\") pod \"downloads-5bc67dcd46-4fk66\" (UID: \"82871ec4-5735-4674-8938-338a3bdc268e\") " pod="openshift-console/downloads-5bc67dcd46-4fk66" Jul 21 19:38:57.392994 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.392968 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/252c47fa-fc69-463a-a137-693698551a5c-service-ca\") pod \"console-69c5f6c8bb-8j8cl\" (UID: \"252c47fa-fc69-463a-a137-693698551a5c\") " pod="openshift-console/console-69c5f6c8bb-8j8cl" Jul 21 19:38:57.393115 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.392995 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/252c47fa-fc69-463a-a137-693698551a5c-console-serving-cert\") pod \"console-69c5f6c8bb-8j8cl\" (UID: \"252c47fa-fc69-463a-a137-693698551a5c\") " pod="openshift-console/console-69c5f6c8bb-8j8cl" Jul 21 19:38:57.393115 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.393028 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/252c47fa-fc69-463a-a137-693698551a5c-console-config\") pod \"console-69c5f6c8bb-8j8cl\" (UID: \"252c47fa-fc69-463a-a137-693698551a5c\") " pod="openshift-console/console-69c5f6c8bb-8j8cl" Jul 21 19:38:57.393115 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.393065 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7d41260-57b9-4f2a-b2da-f23524fbb45c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6cd77fbccd-rfzwd\" (UID: \"e7d41260-57b9-4f2a-b2da-f23524fbb45c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cd77fbccd-rfzwd" Jul 21 19:38:57.395371 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.395345 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7d41260-57b9-4f2a-b2da-f23524fbb45c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6cd77fbccd-rfzwd\" (UID: \"e7d41260-57b9-4f2a-b2da-f23524fbb45c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cd77fbccd-rfzwd" Jul 21 19:38:57.415708 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.415656 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6w2b\" (UniqueName: \"kubernetes.io/projected/e7d41260-57b9-4f2a-b2da-f23524fbb45c-kube-api-access-c6w2b\") pod \"managed-serviceaccount-addon-agent-6cd77fbccd-rfzwd\" (UID: \"e7d41260-57b9-4f2a-b2da-f23524fbb45c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cd77fbccd-rfzwd" Jul 21 19:38:57.493459 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.493438 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/252c47fa-fc69-463a-a137-693698551a5c-console-config\") pod \"console-69c5f6c8bb-8j8cl\" (UID: \"252c47fa-fc69-463a-a137-693698551a5c\") " pod="openshift-console/console-69c5f6c8bb-8j8cl" Jul 21 19:38:57.493554 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.493482 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx4dj\" (UniqueName: \"kubernetes.io/projected/252c47fa-fc69-463a-a137-693698551a5c-kube-api-access-gx4dj\") pod \"console-69c5f6c8bb-8j8cl\" (UID: \"252c47fa-fc69-463a-a137-693698551a5c\") " pod="openshift-console/console-69c5f6c8bb-8j8cl" Jul 21 19:38:57.493554 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.493499 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/252c47fa-fc69-463a-a137-693698551a5c-console-oauth-config\") pod \"console-69c5f6c8bb-8j8cl\" (UID: \"252c47fa-fc69-463a-a137-693698551a5c\") " pod="openshift-console/console-69c5f6c8bb-8j8cl" Jul 21 19:38:57.493554 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.493525 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/252c47fa-fc69-463a-a137-693698551a5c-oauth-serving-cert\") pod \"console-69c5f6c8bb-8j8cl\" (UID: \"252c47fa-fc69-463a-a137-693698551a5c\") " pod="openshift-console/console-69c5f6c8bb-8j8cl" Jul 21 19:38:57.493554 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.493543 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d88ml\" (UniqueName: \"kubernetes.io/projected/82871ec4-5735-4674-8938-338a3bdc268e-kube-api-access-d88ml\") pod \"downloads-5bc67dcd46-4fk66\" (UID: \"82871ec4-5735-4674-8938-338a3bdc268e\") " pod="openshift-console/downloads-5bc67dcd46-4fk66" Jul 21 19:38:57.493704 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.493574 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/252c47fa-fc69-463a-a137-693698551a5c-service-ca\") pod \"console-69c5f6c8bb-8j8cl\" (UID: \"252c47fa-fc69-463a-a137-693698551a5c\") " pod="openshift-console/console-69c5f6c8bb-8j8cl" Jul 21 19:38:57.493704 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.493604 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/252c47fa-fc69-463a-a137-693698551a5c-console-serving-cert\") pod \"console-69c5f6c8bb-8j8cl\" (UID: \"252c47fa-fc69-463a-a137-693698551a5c\") " pod="openshift-console/console-69c5f6c8bb-8j8cl" Jul 21 19:38:57.494122 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.494101 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/252c47fa-fc69-463a-a137-693698551a5c-console-config\") pod \"console-69c5f6c8bb-8j8cl\" (UID: \"252c47fa-fc69-463a-a137-693698551a5c\") " pod="openshift-console/console-69c5f6c8bb-8j8cl" Jul 21 19:38:57.494214 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.494134 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/252c47fa-fc69-463a-a137-693698551a5c-oauth-serving-cert\") pod \"console-69c5f6c8bb-8j8cl\" (UID: \"252c47fa-fc69-463a-a137-693698551a5c\") " pod="openshift-console/console-69c5f6c8bb-8j8cl" Jul 21 19:38:57.494354 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.494335 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/252c47fa-fc69-463a-a137-693698551a5c-service-ca\") pod \"console-69c5f6c8bb-8j8cl\" (UID: \"252c47fa-fc69-463a-a137-693698551a5c\") " pod="openshift-console/console-69c5f6c8bb-8j8cl" Jul 21 19:38:57.495794 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.495776 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/252c47fa-fc69-463a-a137-693698551a5c-console-serving-cert\") pod \"console-69c5f6c8bb-8j8cl\" (UID: \"252c47fa-fc69-463a-a137-693698551a5c\") " pod="openshift-console/console-69c5f6c8bb-8j8cl" Jul 21 19:38:57.495871 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.495802 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/252c47fa-fc69-463a-a137-693698551a5c-console-oauth-config\") pod \"console-69c5f6c8bb-8j8cl\" (UID: \"252c47fa-fc69-463a-a137-693698551a5c\") " pod="openshift-console/console-69c5f6c8bb-8j8cl" Jul 21 19:38:57.497702 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.497690 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cd77fbccd-rfzwd" Jul 21 19:38:57.505212 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.505190 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d88ml\" (UniqueName: \"kubernetes.io/projected/82871ec4-5735-4674-8938-338a3bdc268e-kube-api-access-d88ml\") pod \"downloads-5bc67dcd46-4fk66\" (UID: \"82871ec4-5735-4674-8938-338a3bdc268e\") " pod="openshift-console/downloads-5bc67dcd46-4fk66" Jul 21 19:38:57.505692 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.505675 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx4dj\" (UniqueName: \"kubernetes.io/projected/252c47fa-fc69-463a-a137-693698551a5c-kube-api-access-gx4dj\") pod \"console-69c5f6c8bb-8j8cl\" (UID: \"252c47fa-fc69-463a-a137-693698551a5c\") " pod="openshift-console/console-69c5f6c8bb-8j8cl" Jul 21 19:38:57.598242 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.598211 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-4fk66" Jul 21 19:38:57.607581 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.607501 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69c5f6c8bb-8j8cl" Jul 21 19:38:57.665860 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.665782 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cd77fbccd-rfzwd"] Jul 21 19:38:57.768102 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.768042 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-4fk66"] Jul 21 19:38:57.771225 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:38:57.771195 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82871ec4_5735_4674_8938_338a3bdc268e.slice/crio-11cc105fe7461babf11aea1fab5b5a295a12e610cca777958fb81d65fb758486 WatchSource:0}: Error finding container 11cc105fe7461babf11aea1fab5b5a295a12e610cca777958fb81d65fb758486: Status 404 returned error can't find the container with id 11cc105fe7461babf11aea1fab5b5a295a12e610cca777958fb81d65fb758486 Jul 21 19:38:57.793438 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.793417 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69c5f6c8bb-8j8cl"] Jul 21 19:38:57.796187 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:38:57.796159 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod252c47fa_fc69_463a_a137_693698551a5c.slice/crio-37fed0f24f981d0497783a16b2cd104ed3a86a3cfab6003df909258a0c9d7d0d WatchSource:0}: Error finding container 37fed0f24f981d0497783a16b2cd104ed3a86a3cfab6003df909258a0c9d7d0d: Status 404 returned error can't find the container with id 37fed0f24f981d0497783a16b2cd104ed3a86a3cfab6003df909258a0c9d7d0d Jul 21 19:38:57.827487 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.827464 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lh2hq" Jul 21 19:38:57.920921 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.920827 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-khzjj" event={"ID":"6d039d3e-3f40-42d1-ba6e-8d2689b93aee","Type":"ContainerStarted","Data":"ffc93a33a23a56fa9159e2a97d5c36bee4102aafad7f86737a13dc7f2e11ae20"} Jul 21 19:38:57.921957 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.921930 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-4fk66" event={"ID":"82871ec4-5735-4674-8938-338a3bdc268e","Type":"ContainerStarted","Data":"11cc105fe7461babf11aea1fab5b5a295a12e610cca777958fb81d65fb758486"} Jul 21 19:38:57.923021 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.922999 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cd77fbccd-rfzwd" event={"ID":"e7d41260-57b9-4f2a-b2da-f23524fbb45c","Type":"ContainerStarted","Data":"3be2dfa300363c7a731c7bc9f846e619dd88399c20556c439bf86aa8a6810b82"} Jul 21 19:38:57.924169 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.924149 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69c5f6c8bb-8j8cl" event={"ID":"252c47fa-fc69-463a-a137-693698551a5c","Type":"ContainerStarted","Data":"37fed0f24f981d0497783a16b2cd104ed3a86a3cfab6003df909258a0c9d7d0d"} Jul 21 19:38:57.951500 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:38:57.951457 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-khzjj" podStartSLOduration=33.495342191 podStartE2EDuration="35.951443502s" totalImagesPullingTime="2.456101311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:38:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:38:57.950934913 +0000 UTC m=+102.910947349" watchObservedRunningTime="2026-07-21 19:38:57.951443502 +0000 UTC m=+102.911455957" Jul 21 19:39:02.948530 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:02.948486 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cd77fbccd-rfzwd" event={"ID":"e7d41260-57b9-4f2a-b2da-f23524fbb45c","Type":"ContainerStarted","Data":"4ea331c7a873dde7390e9d14cd7ca5fcbeece96b90ca5641659613681e95b8ad"} Jul 21 19:39:02.950187 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:02.950159 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69c5f6c8bb-8j8cl" event={"ID":"252c47fa-fc69-463a-a137-693698551a5c","Type":"ContainerStarted","Data":"a37ebb026de0faed3bbc23fdffd86d782be0653ea123a731e001f37d15c72c25"} Jul 21 19:39:02.964601 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:02.964436 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cd77fbccd-rfzwd" podStartSLOduration=1.532702398 podStartE2EDuration="5.964418291s" totalImagesPullingTime="4.431715893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:38:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:39:02.962632257 +0000 UTC m=+107.922644692" watchObservedRunningTime="2026-07-21 19:39:02.964418291 +0000 UTC m=+107.924430729" Jul 21 19:39:02.982155 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:02.982106 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69c5f6c8bb-8j8cl" podStartSLOduration=1.673994231 podStartE2EDuration="5.982094137s" totalImagesPullingTime="4.308099906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:38:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:39:02.981287146 +0000 UTC m=+107.941299574" watchObservedRunningTime="2026-07-21 19:39:02.982094137 +0000 UTC m=+107.942106549" Jul 21 19:39:03.444380 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:03.444337 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21fbc355-5f0b-495a-bb69-38730c31a5b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z4wl4\" (UID: \"21fbc355-5f0b-495a-bb69-38730c31a5b2\") " pod="openshift-insights/insights-runtime-extractor-z4wl4" Jul 21 19:39:03.446830 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:03.446797 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21fbc355-5f0b-495a-bb69-38730c31a5b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z4wl4\" (UID: \"21fbc355-5f0b-495a-bb69-38730c31a5b2\") " pod="openshift-insights/insights-runtime-extractor-z4wl4" Jul 21 19:39:03.700820 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:03.700733 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z4wl4" Jul 21 19:39:03.846650 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:03.846580 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z4wl4"] Jul 21 19:39:03.849575 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:39:03.849545 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21fbc355_5f0b_495a_bb69_38730c31a5b2.slice/crio-189a32513abd77ab862f120a2359965f2b97b92e901dd735be06625b5159cf9c WatchSource:0}: Error finding container 189a32513abd77ab862f120a2359965f2b97b92e901dd735be06625b5159cf9c: Status 404 returned error can't find the container with id 189a32513abd77ab862f120a2359965f2b97b92e901dd735be06625b5159cf9c Jul 21 19:39:03.954910 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:03.954809 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z4wl4" event={"ID":"21fbc355-5f0b-495a-bb69-38730c31a5b2","Type":"ContainerStarted","Data":"189a32513abd77ab862f120a2359965f2b97b92e901dd735be06625b5159cf9c"} Jul 21 19:39:05.919362 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:05.919325 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pgd57" Jul 21 19:39:07.607756 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:07.607723 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69c5f6c8bb-8j8cl" Jul 21 19:39:07.608224 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:07.607818 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69c5f6c8bb-8j8cl" Jul 21 19:39:07.614022 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:07.613997 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69c5f6c8bb-8j8cl" Jul 21 19:39:07.978158 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:07.978125 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69c5f6c8bb-8j8cl" Jul 21 19:39:12.503274 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.503232 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-5wzgw"] Jul 21 19:39:12.506047 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.506026 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5wzgw" Jul 21 19:39:12.508747 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.508721 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 21 19:39:12.508876 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.508726 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 21 19:39:12.509857 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.509829 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 21 19:39:12.509981 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.509945 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-ftb8n\"" Jul 21 19:39:12.518356 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.518290 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-5wzgw"] Jul 21 19:39:12.528345 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.528321 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-rzrhp"] Jul 21 19:39:12.530907 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.530873 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-rzrhp" Jul 21 19:39:12.533535 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.533516 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 21 19:39:12.533690 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.533553 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 21 19:39:12.533690 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.533513 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 21 19:39:12.533939 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.533921 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-pxpth\"" Jul 21 19:39:12.541461 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.541437 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rks8q"] Jul 21 19:39:12.544383 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.543877 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rks8q" Jul 21 19:39:12.545472 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.545450 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-rzrhp"] Jul 21 19:39:12.547272 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.547244 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 21 19:39:12.547375 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.547355 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 21 19:39:12.547464 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.547356 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 21 19:39:12.547464 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.547401 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6t7pw\"" Jul 21 19:39:12.628813 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.628782 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/539150a9-fc2d-4bd2-ad45-0f485ede80ef-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-rzrhp\" (UID: \"539150a9-fc2d-4bd2-ad45-0f485ede80ef\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rzrhp" Jul 21 19:39:12.628813 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.628817 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/539150a9-fc2d-4bd2-ad45-0f485ede80ef-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-rzrhp\" (UID: \"539150a9-fc2d-4bd2-ad45-0f485ede80ef\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rzrhp" Jul 21 19:39:12.629075 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.628899 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b44vb\" (UniqueName: \"kubernetes.io/projected/539150a9-fc2d-4bd2-ad45-0f485ede80ef-kube-api-access-b44vb\") pod \"kube-state-metrics-56c5594674-rzrhp\" (UID: \"539150a9-fc2d-4bd2-ad45-0f485ede80ef\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rzrhp" Jul 21 19:39:12.629075 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.628945 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/539150a9-fc2d-4bd2-ad45-0f485ede80ef-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-rzrhp\" (UID: \"539150a9-fc2d-4bd2-ad45-0f485ede80ef\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rzrhp" Jul 21 19:39:12.629075 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.628982 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz57n\" (UniqueName: \"kubernetes.io/projected/53364f5c-6e45-469d-9869-b8455fa40af5-kube-api-access-qz57n\") pod \"openshift-state-metrics-79f6958cdf-5wzgw\" (UID: \"53364f5c-6e45-469d-9869-b8455fa40af5\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5wzgw" Jul 21 19:39:12.629075 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.629010 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/539150a9-fc2d-4bd2-ad45-0f485ede80ef-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-rzrhp\" (UID: \"539150a9-fc2d-4bd2-ad45-0f485ede80ef\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rzrhp" Jul 21 19:39:12.629075 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.629033 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/539150a9-fc2d-4bd2-ad45-0f485ede80ef-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-rzrhp\" (UID: \"539150a9-fc2d-4bd2-ad45-0f485ede80ef\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rzrhp" Jul 21 19:39:12.629320 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.629137 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53364f5c-6e45-469d-9869-b8455fa40af5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-5wzgw\" (UID: \"53364f5c-6e45-469d-9869-b8455fa40af5\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5wzgw" Jul 21 19:39:12.629320 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.629204 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/53364f5c-6e45-469d-9869-b8455fa40af5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-5wzgw\" (UID: \"53364f5c-6e45-469d-9869-b8455fa40af5\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5wzgw" Jul 21 19:39:12.629320 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.629244 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53364f5c-6e45-469d-9869-b8455fa40af5-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-5wzgw\" (UID: \"53364f5c-6e45-469d-9869-b8455fa40af5\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5wzgw" Jul 21 19:39:12.730280 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.730242 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/539150a9-fc2d-4bd2-ad45-0f485ede80ef-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-rzrhp\" (UID: \"539150a9-fc2d-4bd2-ad45-0f485ede80ef\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rzrhp" Jul 21 19:39:12.730522 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.730292 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/539150a9-fc2d-4bd2-ad45-0f485ede80ef-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-rzrhp\" (UID: \"539150a9-fc2d-4bd2-ad45-0f485ede80ef\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rzrhp" Jul 21 19:39:12.730522 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.730323 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/980db5a5-ca83-4603-8408-40169686abc2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rks8q\" (UID: \"980db5a5-ca83-4603-8408-40169686abc2\") " pod="openshift-monitoring/node-exporter-rks8q" Jul 21 19:39:12.730522 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.730355 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53364f5c-6e45-469d-9869-b8455fa40af5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-5wzgw\" (UID: \"53364f5c-6e45-469d-9869-b8455fa40af5\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5wzgw" Jul 21 19:39:12.730522 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.730400 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/980db5a5-ca83-4603-8408-40169686abc2-node-exporter-accelerators-collector-config\") pod \"node-exporter-rks8q\" (UID: \"980db5a5-ca83-4603-8408-40169686abc2\") " pod="openshift-monitoring/node-exporter-rks8q" Jul 21 19:39:12.730830 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.730758 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/539150a9-fc2d-4bd2-ad45-0f485ede80ef-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-rzrhp\" (UID: \"539150a9-fc2d-4bd2-ad45-0f485ede80ef\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rzrhp" Jul 21 19:39:12.730917 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.730821 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/980db5a5-ca83-4603-8408-40169686abc2-node-exporter-textfile\") pod \"node-exporter-rks8q\" (UID: \"980db5a5-ca83-4603-8408-40169686abc2\") " pod="openshift-monitoring/node-exporter-rks8q" Jul 21 19:39:12.730917 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.730877 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/53364f5c-6e45-469d-9869-b8455fa40af5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-5wzgw\" (UID: \"53364f5c-6e45-469d-9869-b8455fa40af5\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5wzgw" Jul 21 19:39:12.731032 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.730942 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/980db5a5-ca83-4603-8408-40169686abc2-root\") pod \"node-exporter-rks8q\" (UID: \"980db5a5-ca83-4603-8408-40169686abc2\") " pod="openshift-monitoring/node-exporter-rks8q" Jul 21 19:39:12.731032 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.730976 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53364f5c-6e45-469d-9869-b8455fa40af5-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-5wzgw\" (UID: \"53364f5c-6e45-469d-9869-b8455fa40af5\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5wzgw" Jul 21 19:39:12.731032 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.730992 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/980db5a5-ca83-4603-8408-40169686abc2-sys\") pod \"node-exporter-rks8q\" (UID: \"980db5a5-ca83-4603-8408-40169686abc2\") " pod="openshift-monitoring/node-exporter-rks8q" Jul 21 19:39:12.731032 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.731018 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/980db5a5-ca83-4603-8408-40169686abc2-metrics-client-ca\") pod \"node-exporter-rks8q\" (UID: \"980db5a5-ca83-4603-8408-40169686abc2\") " pod="openshift-monitoring/node-exporter-rks8q" Jul 21 19:39:12.731241 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.731040 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/539150a9-fc2d-4bd2-ad45-0f485ede80ef-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-rzrhp\" (UID: \"539150a9-fc2d-4bd2-ad45-0f485ede80ef\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rzrhp" Jul 21 19:39:12.731241 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.731070 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/539150a9-fc2d-4bd2-ad45-0f485ede80ef-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-rzrhp\" (UID: \"539150a9-fc2d-4bd2-ad45-0f485ede80ef\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rzrhp" Jul 21 19:39:12.731241 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.731103 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b44vb\" (UniqueName: \"kubernetes.io/projected/539150a9-fc2d-4bd2-ad45-0f485ede80ef-kube-api-access-b44vb\") pod \"kube-state-metrics-56c5594674-rzrhp\" (UID: \"539150a9-fc2d-4bd2-ad45-0f485ede80ef\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rzrhp" Jul 21 19:39:12.731241 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.731109 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/539150a9-fc2d-4bd2-ad45-0f485ede80ef-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-rzrhp\" (UID: \"539150a9-fc2d-4bd2-ad45-0f485ede80ef\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rzrhp" Jul 21 19:39:12.731241 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.731125 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/980db5a5-ca83-4603-8408-40169686abc2-node-exporter-wtmp\") pod \"node-exporter-rks8q\" (UID: \"980db5a5-ca83-4603-8408-40169686abc2\") " pod="openshift-monitoring/node-exporter-rks8q" Jul 21 19:39:12.731241 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.731157 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/539150a9-fc2d-4bd2-ad45-0f485ede80ef-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-rzrhp\" (UID: \"539150a9-fc2d-4bd2-ad45-0f485ede80ef\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rzrhp" Jul 21 19:39:12.731516 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.731276 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz57n\" (UniqueName: \"kubernetes.io/projected/53364f5c-6e45-469d-9869-b8455fa40af5-kube-api-access-qz57n\") pod \"openshift-state-metrics-79f6958cdf-5wzgw\" (UID: \"53364f5c-6e45-469d-9869-b8455fa40af5\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5wzgw" Jul 21 19:39:12.731516 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.731323 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvk4r\" (UniqueName: \"kubernetes.io/projected/980db5a5-ca83-4603-8408-40169686abc2-kube-api-access-zvk4r\") pod \"node-exporter-rks8q\" (UID: \"980db5a5-ca83-4603-8408-40169686abc2\") " pod="openshift-monitoring/node-exporter-rks8q" Jul 21 19:39:12.731516 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.731350 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/980db5a5-ca83-4603-8408-40169686abc2-node-exporter-tls\") pod \"node-exporter-rks8q\" (UID: \"980db5a5-ca83-4603-8408-40169686abc2\") " pod="openshift-monitoring/node-exporter-rks8q" Jul 21 19:39:12.732022 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.731970 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/539150a9-fc2d-4bd2-ad45-0f485ede80ef-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-rzrhp\" (UID: \"539150a9-fc2d-4bd2-ad45-0f485ede80ef\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rzrhp" Jul 21 19:39:12.732287 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.732241 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53364f5c-6e45-469d-9869-b8455fa40af5-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-5wzgw\" (UID: \"53364f5c-6e45-469d-9869-b8455fa40af5\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5wzgw" Jul 21 19:39:12.733356 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.733329 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53364f5c-6e45-469d-9869-b8455fa40af5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-5wzgw\" (UID: \"53364f5c-6e45-469d-9869-b8455fa40af5\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5wzgw" Jul 21 19:39:12.734063 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.733920 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/539150a9-fc2d-4bd2-ad45-0f485ede80ef-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-rzrhp\" (UID: \"539150a9-fc2d-4bd2-ad45-0f485ede80ef\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rzrhp" Jul 21 19:39:12.734063 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.734000 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/53364f5c-6e45-469d-9869-b8455fa40af5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-5wzgw\" (UID: \"53364f5c-6e45-469d-9869-b8455fa40af5\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5wzgw" Jul 21 19:39:12.734226 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.734114 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/539150a9-fc2d-4bd2-ad45-0f485ede80ef-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-rzrhp\" (UID: \"539150a9-fc2d-4bd2-ad45-0f485ede80ef\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rzrhp" Jul 21 19:39:12.739495 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.739473 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz57n\" (UniqueName: \"kubernetes.io/projected/53364f5c-6e45-469d-9869-b8455fa40af5-kube-api-access-qz57n\") pod \"openshift-state-metrics-79f6958cdf-5wzgw\" (UID: \"53364f5c-6e45-469d-9869-b8455fa40af5\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5wzgw" Jul 21 19:39:12.739595 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.739548 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b44vb\" (UniqueName: \"kubernetes.io/projected/539150a9-fc2d-4bd2-ad45-0f485ede80ef-kube-api-access-b44vb\") pod \"kube-state-metrics-56c5594674-rzrhp\" (UID: \"539150a9-fc2d-4bd2-ad45-0f485ede80ef\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rzrhp" Jul 21 19:39:12.817316 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.817229 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5wzgw" Jul 21 19:39:12.832308 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.832261 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/980db5a5-ca83-4603-8408-40169686abc2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rks8q\" (UID: \"980db5a5-ca83-4603-8408-40169686abc2\") " pod="openshift-monitoring/node-exporter-rks8q" Jul 21 19:39:12.832444 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.832340 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/980db5a5-ca83-4603-8408-40169686abc2-node-exporter-accelerators-collector-config\") pod \"node-exporter-rks8q\" (UID: \"980db5a5-ca83-4603-8408-40169686abc2\") " pod="openshift-monitoring/node-exporter-rks8q" Jul 21 19:39:12.832444 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.832374 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/980db5a5-ca83-4603-8408-40169686abc2-node-exporter-textfile\") pod \"node-exporter-rks8q\" (UID: \"980db5a5-ca83-4603-8408-40169686abc2\") " pod="openshift-monitoring/node-exporter-rks8q" Jul 21 19:39:12.832444 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.832421 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/980db5a5-ca83-4603-8408-40169686abc2-root\") pod \"node-exporter-rks8q\" (UID: \"980db5a5-ca83-4603-8408-40169686abc2\") " pod="openshift-monitoring/node-exporter-rks8q" Jul 21 19:39:12.832600 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.832447 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/980db5a5-ca83-4603-8408-40169686abc2-sys\") pod \"node-exporter-rks8q\" (UID: \"980db5a5-ca83-4603-8408-40169686abc2\") " pod="openshift-monitoring/node-exporter-rks8q" Jul 21 19:39:12.832600 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.832480 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/980db5a5-ca83-4603-8408-40169686abc2-metrics-client-ca\") pod \"node-exporter-rks8q\" (UID: \"980db5a5-ca83-4603-8408-40169686abc2\") " pod="openshift-monitoring/node-exporter-rks8q" Jul 21 19:39:12.832600 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.832512 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/980db5a5-ca83-4603-8408-40169686abc2-node-exporter-wtmp\") pod \"node-exporter-rks8q\" (UID: \"980db5a5-ca83-4603-8408-40169686abc2\") " pod="openshift-monitoring/node-exporter-rks8q" Jul 21 19:39:12.832600 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.832552 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvk4r\" (UniqueName: \"kubernetes.io/projected/980db5a5-ca83-4603-8408-40169686abc2-kube-api-access-zvk4r\") pod \"node-exporter-rks8q\" (UID: \"980db5a5-ca83-4603-8408-40169686abc2\") " pod="openshift-monitoring/node-exporter-rks8q" Jul 21 19:39:12.832600 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.832551 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/980db5a5-ca83-4603-8408-40169686abc2-root\") pod \"node-exporter-rks8q\" (UID: \"980db5a5-ca83-4603-8408-40169686abc2\") " pod="openshift-monitoring/node-exporter-rks8q" Jul 21 19:39:12.832600 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.832578 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/980db5a5-ca83-4603-8408-40169686abc2-node-exporter-tls\") pod \"node-exporter-rks8q\" (UID: \"980db5a5-ca83-4603-8408-40169686abc2\") " pod="openshift-monitoring/node-exporter-rks8q" Jul 21 19:39:12.832871 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:39:12.832690 2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 21 19:39:12.832871 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.832551 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/980db5a5-ca83-4603-8408-40169686abc2-sys\") pod \"node-exporter-rks8q\" (UID: \"980db5a5-ca83-4603-8408-40169686abc2\") " pod="openshift-monitoring/node-exporter-rks8q" Jul 21 19:39:12.832871 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:39:12.832742 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/980db5a5-ca83-4603-8408-40169686abc2-node-exporter-tls podName:980db5a5-ca83-4603-8408-40169686abc2 nodeName:}" failed. No retries permitted until 2026-07-21 19:39:13.332723962 +0000 UTC m=+118.292736380 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/980db5a5-ca83-4603-8408-40169686abc2-node-exporter-tls") pod "node-exporter-rks8q" (UID: "980db5a5-ca83-4603-8408-40169686abc2") : secret "node-exporter-tls" not found Jul 21 19:39:12.832871 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.832740 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/980db5a5-ca83-4603-8408-40169686abc2-node-exporter-textfile\") pod \"node-exporter-rks8q\" (UID: \"980db5a5-ca83-4603-8408-40169686abc2\") " pod="openshift-monitoring/node-exporter-rks8q" Jul 21 19:39:12.832871 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.832847 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/980db5a5-ca83-4603-8408-40169686abc2-node-exporter-wtmp\") pod \"node-exporter-rks8q\" (UID: \"980db5a5-ca83-4603-8408-40169686abc2\") " pod="openshift-monitoring/node-exporter-rks8q" Jul 21 19:39:12.833089 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.833034 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/980db5a5-ca83-4603-8408-40169686abc2-metrics-client-ca\") pod \"node-exporter-rks8q\" (UID: \"980db5a5-ca83-4603-8408-40169686abc2\") " pod="openshift-monitoring/node-exporter-rks8q" Jul 21 19:39:12.833089 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.833044 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/980db5a5-ca83-4603-8408-40169686abc2-node-exporter-accelerators-collector-config\") pod \"node-exporter-rks8q\" (UID: \"980db5a5-ca83-4603-8408-40169686abc2\") " pod="openshift-monitoring/node-exporter-rks8q" Jul 21 19:39:12.834947 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.834922 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/980db5a5-ca83-4603-8408-40169686abc2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rks8q\" (UID: \"980db5a5-ca83-4603-8408-40169686abc2\") " pod="openshift-monitoring/node-exporter-rks8q" Jul 21 19:39:12.842572 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.842549 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-rzrhp" Jul 21 19:39:12.843759 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:12.843738 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvk4r\" (UniqueName: \"kubernetes.io/projected/980db5a5-ca83-4603-8408-40169686abc2-kube-api-access-zvk4r\") pod \"node-exporter-rks8q\" (UID: \"980db5a5-ca83-4603-8408-40169686abc2\") " pod="openshift-monitoring/node-exporter-rks8q" Jul 21 19:39:13.337281 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.337240 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/980db5a5-ca83-4603-8408-40169686abc2-node-exporter-tls\") pod \"node-exporter-rks8q\" (UID: \"980db5a5-ca83-4603-8408-40169686abc2\") " pod="openshift-monitoring/node-exporter-rks8q" Jul 21 19:39:13.340080 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.339866 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/980db5a5-ca83-4603-8408-40169686abc2-node-exporter-tls\") pod \"node-exporter-rks8q\" (UID: \"980db5a5-ca83-4603-8408-40169686abc2\") " pod="openshift-monitoring/node-exporter-rks8q" Jul 21 19:39:13.454272 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.454237 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rks8q" Jul 21 19:39:13.633480 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.633392 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 19:39:13.636549 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.636522 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.640515 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.640006 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 21 19:39:13.640515 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.640373 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 21 19:39:13.640817 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.640790 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 21 19:39:13.640817 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.640800 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 21 19:39:13.640817 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.640810 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 21 19:39:13.641168 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.641136 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 21 19:39:13.641263 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.641187 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 21 19:39:13.641495 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.641460 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 21 19:39:13.641591 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.641579 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 21 19:39:13.641728 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.641705 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jpqgj\"" Jul 21 19:39:13.658002 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.657979 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 19:39:13.740004 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.739966 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9c60c579-8121-4947-9ccd-1dc39341ec56-config-out\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.740004 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.740011 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9c60c579-8121-4947-9ccd-1dc39341ec56-config-volume\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.740235 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.740029 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c60c579-8121-4947-9ccd-1dc39341ec56-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.740235 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.740052 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c60c579-8121-4947-9ccd-1dc39341ec56-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.740235 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.740159 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9c60c579-8121-4947-9ccd-1dc39341ec56-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.740235 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.740203 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c60c579-8121-4947-9ccd-1dc39341ec56-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.740445 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.740270 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9c60c579-8121-4947-9ccd-1dc39341ec56-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.740445 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.740302 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9c60c579-8121-4947-9ccd-1dc39341ec56-web-config\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.740445 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.740333 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9c60c579-8121-4947-9ccd-1dc39341ec56-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.740445 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.740368 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9c60c579-8121-4947-9ccd-1dc39341ec56-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.740445 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.740384 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9c60c579-8121-4947-9ccd-1dc39341ec56-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.740445 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.740416 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxv8n\" (UniqueName: \"kubernetes.io/projected/9c60c579-8121-4947-9ccd-1dc39341ec56-kube-api-access-gxv8n\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.740748 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.740450 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c60c579-8121-4947-9ccd-1dc39341ec56-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.841590 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.841552 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9c60c579-8121-4947-9ccd-1dc39341ec56-config-out\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.841590 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.841601 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9c60c579-8121-4947-9ccd-1dc39341ec56-config-volume\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.841830 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.841734 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c60c579-8121-4947-9ccd-1dc39341ec56-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.841830 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.841783 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c60c579-8121-4947-9ccd-1dc39341ec56-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.842053 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.841832 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9c60c579-8121-4947-9ccd-1dc39341ec56-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.842053 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.841870 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c60c579-8121-4947-9ccd-1dc39341ec56-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.842053 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.841923 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9c60c579-8121-4947-9ccd-1dc39341ec56-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.842053 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.841956 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9c60c579-8121-4947-9ccd-1dc39341ec56-web-config\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.842053 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.841988 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9c60c579-8121-4947-9ccd-1dc39341ec56-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.842053 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.842022 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9c60c579-8121-4947-9ccd-1dc39341ec56-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.842053 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.842044 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9c60c579-8121-4947-9ccd-1dc39341ec56-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.842404 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.842079 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxv8n\" (UniqueName: \"kubernetes.io/projected/9c60c579-8121-4947-9ccd-1dc39341ec56-kube-api-access-gxv8n\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.842404 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.842109 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c60c579-8121-4947-9ccd-1dc39341ec56-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.843137 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.843105 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c60c579-8121-4947-9ccd-1dc39341ec56-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.843690 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.843661 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9c60c579-8121-4947-9ccd-1dc39341ec56-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.844979 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.844936 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c60c579-8121-4947-9ccd-1dc39341ec56-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.845511 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.845488 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c60c579-8121-4947-9ccd-1dc39341ec56-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.845814 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.845782 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c60c579-8121-4947-9ccd-1dc39341ec56-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.845919 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.845823 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9c60c579-8121-4947-9ccd-1dc39341ec56-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.846433 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.846038 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9c60c579-8121-4947-9ccd-1dc39341ec56-config-out\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.846433 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.846381 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9c60c579-8121-4947-9ccd-1dc39341ec56-config-volume\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.847587 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.847546 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9c60c579-8121-4947-9ccd-1dc39341ec56-web-config\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.847757 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.847731 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9c60c579-8121-4947-9ccd-1dc39341ec56-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.848113 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.848093 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9c60c579-8121-4947-9ccd-1dc39341ec56-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.848406 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.848381 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9c60c579-8121-4947-9ccd-1dc39341ec56-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.853442 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.853403 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxv8n\" (UniqueName: \"kubernetes.io/projected/9c60c579-8121-4947-9ccd-1dc39341ec56-kube-api-access-gxv8n\") pod \"alertmanager-main-0\" (UID: \"9c60c579-8121-4947-9ccd-1dc39341ec56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:13.948472 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:13.948403 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 21 19:39:14.147342 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:14.147310 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69c5f6c8bb-8j8cl"] Jul 21 19:39:16.757063 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:39:16.755009 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod980db5a5_ca83_4603_8408_40169686abc2.slice/crio-cd910a3e4f085289fb4deee4c8633ec4098589e3deabc004972375acfd32d8c8 WatchSource:0}: Error finding container cd910a3e4f085289fb4deee4c8633ec4098589e3deabc004972375acfd32d8c8: Status 404 returned error can't find the container with id cd910a3e4f085289fb4deee4c8633ec4098589e3deabc004972375acfd32d8c8 Jul 21 19:39:16.915851 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:16.915823 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-5wzgw"] Jul 21 19:39:16.919492 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:39:16.919465 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53364f5c_6e45_469d_9869_b8455fa40af5.slice/crio-a00c026d5c21c66702017baaa97ea6f0ba6bbc0744cf3c38945f88f5b18688c8 WatchSource:0}: Error finding container a00c026d5c21c66702017baaa97ea6f0ba6bbc0744cf3c38945f88f5b18688c8: Status 404 returned error can't find the container with id a00c026d5c21c66702017baaa97ea6f0ba6bbc0744cf3c38945f88f5b18688c8 Jul 21 19:39:17.007334 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.007306 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rks8q" event={"ID":"980db5a5-ca83-4603-8408-40169686abc2","Type":"ContainerStarted","Data":"cd910a3e4f085289fb4deee4c8633ec4098589e3deabc004972375acfd32d8c8"} Jul 21 19:39:17.009184 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.009161 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5wzgw" event={"ID":"53364f5c-6e45-469d-9869-b8455fa40af5","Type":"ContainerStarted","Data":"fe85b0ed7d994db9f59e06ae5f1d324b82c1d009677bda5fb030ef81795c153c"} Jul 21 19:39:17.009284 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.009247 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5wzgw" event={"ID":"53364f5c-6e45-469d-9869-b8455fa40af5","Type":"ContainerStarted","Data":"a00c026d5c21c66702017baaa97ea6f0ba6bbc0744cf3c38945f88f5b18688c8"} Jul 21 19:39:17.011497 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.011085 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-4fk66" event={"ID":"82871ec4-5735-4674-8938-338a3bdc268e","Type":"ContainerStarted","Data":"85639d943519193e024af21f7c57f4bdad758b4b3d529ed62258c56c71bcf639"} Jul 21 19:39:17.011497 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.011242 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-4fk66" Jul 21 19:39:17.012757 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.012727 2581 patch_prober.go:28] interesting pod/downloads-5bc67dcd46-4fk66 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.15:8080/\": dial tcp 10.133.0.15:8080: connect: connection refused" start-of-body= Jul 21 19:39:17.012863 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.012785 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-5bc67dcd46-4fk66" podUID="82871ec4-5735-4674-8938-338a3bdc268e" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.15:8080/\": dial tcp 10.133.0.15:8080: connect: connection refused" Jul 21 19:39:17.013195 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.013177 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z4wl4" event={"ID":"21fbc355-5f0b-495a-bb69-38730c31a5b2","Type":"ContainerStarted","Data":"c5e2229c1ae9b3ee562bb6f153e26edd4848c9da39dd85979e3e83475bc0517f"} Jul 21 19:39:17.029951 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.029871 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-4fk66" podStartSLOduration=1.008526529 podStartE2EDuration="20.02985344s" totalImagesPullingTime="19.021326911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:38:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:39:17.028516014 +0000 UTC m=+121.988528450" watchObservedRunningTime="2026-07-21 19:39:17.02985344 +0000 UTC m=+121.989865875" Jul 21 19:39:17.137966 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.137931 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-rzrhp"] Jul 21 19:39:17.142224 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:39:17.142189 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod539150a9_fc2d_4bd2_ad45_0f485ede80ef.slice/crio-8eab5e6b26c1ddac17193940a33d7abcab9eaf28720086501e1cbf2dbb6e0949 WatchSource:0}: Error finding container 8eab5e6b26c1ddac17193940a33d7abcab9eaf28720086501e1cbf2dbb6e0949: Status 404 returned error can't find the container with id 8eab5e6b26c1ddac17193940a33d7abcab9eaf28720086501e1cbf2dbb6e0949 Jul 21 19:39:17.146403 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.146378 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 19:39:17.151669 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:39:17.151639 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c60c579_8121_4947_9ccd_1dc39341ec56.slice/crio-e8f945de74c0c75dc7924581db569d352bebcd393a5b75fc3474c1465bcfbde1 WatchSource:0}: Error finding container e8f945de74c0c75dc7924581db569d352bebcd393a5b75fc3474c1465bcfbde1: Status 404 returned error can't find the container with id e8f945de74c0c75dc7924581db569d352bebcd393a5b75fc3474c1465bcfbde1 Jul 21 19:39:17.813944 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.812445 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-8f5d459fb-6tl5k"] Jul 21 19:39:17.821186 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.821163 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8f5d459fb-6tl5k" Jul 21 19:39:17.825758 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.824168 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 21 19:39:17.825758 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.824232 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 21 19:39:17.825758 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.824178 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 21 19:39:17.825758 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.824982 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 21 19:39:17.825758 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.825132 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 21 19:39:17.825758 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.825263 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-ktc87\"" Jul 21 19:39:17.827434 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.827341 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8f5d459fb-6tl5k"] Jul 21 19:39:17.836189 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.836170 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 21 19:39:17.876020 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.875977 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7f54a745-6b4d-4961-afbe-a8578b9cddab-telemeter-client-tls\") pod \"telemeter-client-8f5d459fb-6tl5k\" (UID: \"7f54a745-6b4d-4961-afbe-a8578b9cddab\") " pod="openshift-monitoring/telemeter-client-8f5d459fb-6tl5k" Jul 21 19:39:17.876234 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.876041 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7f54a745-6b4d-4961-afbe-a8578b9cddab-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8f5d459fb-6tl5k\" (UID: \"7f54a745-6b4d-4961-afbe-a8578b9cddab\") " pod="openshift-monitoring/telemeter-client-8f5d459fb-6tl5k" Jul 21 19:39:17.876234 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.876077 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd7hs\" (UniqueName: \"kubernetes.io/projected/7f54a745-6b4d-4961-afbe-a8578b9cddab-kube-api-access-zd7hs\") pod \"telemeter-client-8f5d459fb-6tl5k\" (UID: \"7f54a745-6b4d-4961-afbe-a8578b9cddab\") " pod="openshift-monitoring/telemeter-client-8f5d459fb-6tl5k" Jul 21 19:39:17.876234 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.876106 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f54a745-6b4d-4961-afbe-a8578b9cddab-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8f5d459fb-6tl5k\" (UID: \"7f54a745-6b4d-4961-afbe-a8578b9cddab\") " pod="openshift-monitoring/telemeter-client-8f5d459fb-6tl5k" Jul 21 19:39:17.876234 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.876164 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7f54a745-6b4d-4961-afbe-a8578b9cddab-federate-client-tls\") pod \"telemeter-client-8f5d459fb-6tl5k\" (UID: \"7f54a745-6b4d-4961-afbe-a8578b9cddab\") " pod="openshift-monitoring/telemeter-client-8f5d459fb-6tl5k" Jul 21 19:39:17.876234 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.876207 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7f54a745-6b4d-4961-afbe-a8578b9cddab-secret-telemeter-client\") pod \"telemeter-client-8f5d459fb-6tl5k\" (UID: \"7f54a745-6b4d-4961-afbe-a8578b9cddab\") " pod="openshift-monitoring/telemeter-client-8f5d459fb-6tl5k" Jul 21 19:39:17.876234 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.876243 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f54a745-6b4d-4961-afbe-a8578b9cddab-serving-certs-ca-bundle\") pod \"telemeter-client-8f5d459fb-6tl5k\" (UID: \"7f54a745-6b4d-4961-afbe-a8578b9cddab\") " pod="openshift-monitoring/telemeter-client-8f5d459fb-6tl5k" Jul 21 19:39:17.876234 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.876270 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f54a745-6b4d-4961-afbe-a8578b9cddab-metrics-client-ca\") pod \"telemeter-client-8f5d459fb-6tl5k\" (UID: \"7f54a745-6b4d-4961-afbe-a8578b9cddab\") " pod="openshift-monitoring/telemeter-client-8f5d459fb-6tl5k" Jul 21 19:39:17.932848 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.932820 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" Jul 21 19:39:17.981470 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.980623 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7f54a745-6b4d-4961-afbe-a8578b9cddab-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8f5d459fb-6tl5k\" (UID: \"7f54a745-6b4d-4961-afbe-a8578b9cddab\") " pod="openshift-monitoring/telemeter-client-8f5d459fb-6tl5k" Jul 21 19:39:17.981470 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.980675 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd7hs\" (UniqueName: \"kubernetes.io/projected/7f54a745-6b4d-4961-afbe-a8578b9cddab-kube-api-access-zd7hs\") pod \"telemeter-client-8f5d459fb-6tl5k\" (UID: \"7f54a745-6b4d-4961-afbe-a8578b9cddab\") " pod="openshift-monitoring/telemeter-client-8f5d459fb-6tl5k" Jul 21 19:39:17.981470 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.980708 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f54a745-6b4d-4961-afbe-a8578b9cddab-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8f5d459fb-6tl5k\" (UID: \"7f54a745-6b4d-4961-afbe-a8578b9cddab\") " pod="openshift-monitoring/telemeter-client-8f5d459fb-6tl5k" Jul 21 19:39:17.981470 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.980766 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7f54a745-6b4d-4961-afbe-a8578b9cddab-federate-client-tls\") pod \"telemeter-client-8f5d459fb-6tl5k\" (UID: \"7f54a745-6b4d-4961-afbe-a8578b9cddab\") " pod="openshift-monitoring/telemeter-client-8f5d459fb-6tl5k" Jul 21 19:39:17.981470 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.980810 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7f54a745-6b4d-4961-afbe-a8578b9cddab-secret-telemeter-client\") pod \"telemeter-client-8f5d459fb-6tl5k\" (UID: \"7f54a745-6b4d-4961-afbe-a8578b9cddab\") " pod="openshift-monitoring/telemeter-client-8f5d459fb-6tl5k" Jul 21 19:39:17.981470 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.980844 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f54a745-6b4d-4961-afbe-a8578b9cddab-serving-certs-ca-bundle\") pod \"telemeter-client-8f5d459fb-6tl5k\" (UID: \"7f54a745-6b4d-4961-afbe-a8578b9cddab\") " pod="openshift-monitoring/telemeter-client-8f5d459fb-6tl5k" Jul 21 19:39:17.981470 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.980866 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f54a745-6b4d-4961-afbe-a8578b9cddab-metrics-client-ca\") pod \"telemeter-client-8f5d459fb-6tl5k\" (UID: \"7f54a745-6b4d-4961-afbe-a8578b9cddab\") " pod="openshift-monitoring/telemeter-client-8f5d459fb-6tl5k" Jul 21 19:39:17.981470 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.980924 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7f54a745-6b4d-4961-afbe-a8578b9cddab-telemeter-client-tls\") pod \"telemeter-client-8f5d459fb-6tl5k\" (UID: \"7f54a745-6b4d-4961-afbe-a8578b9cddab\") " pod="openshift-monitoring/telemeter-client-8f5d459fb-6tl5k" Jul 21 19:39:17.985342 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.983908 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f54a745-6b4d-4961-afbe-a8578b9cddab-serving-certs-ca-bundle\") pod \"telemeter-client-8f5d459fb-6tl5k\" (UID: \"7f54a745-6b4d-4961-afbe-a8578b9cddab\") " pod="openshift-monitoring/telemeter-client-8f5d459fb-6tl5k" Jul 21 19:39:17.985342 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.984477 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f54a745-6b4d-4961-afbe-a8578b9cddab-metrics-client-ca\") pod \"telemeter-client-8f5d459fb-6tl5k\" (UID: \"7f54a745-6b4d-4961-afbe-a8578b9cddab\") " pod="openshift-monitoring/telemeter-client-8f5d459fb-6tl5k" Jul 21 19:39:17.985342 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.985294 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f54a745-6b4d-4961-afbe-a8578b9cddab-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8f5d459fb-6tl5k\" (UID: \"7f54a745-6b4d-4961-afbe-a8578b9cddab\") " pod="openshift-monitoring/telemeter-client-8f5d459fb-6tl5k" Jul 21 19:39:17.986769 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.986728 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7f54a745-6b4d-4961-afbe-a8578b9cddab-federate-client-tls\") pod \"telemeter-client-8f5d459fb-6tl5k\" (UID: \"7f54a745-6b4d-4961-afbe-a8578b9cddab\") " pod="openshift-monitoring/telemeter-client-8f5d459fb-6tl5k" Jul 21 19:39:17.989731 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.989705 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7f54a745-6b4d-4961-afbe-a8578b9cddab-secret-telemeter-client\") pod \"telemeter-client-8f5d459fb-6tl5k\" (UID: \"7f54a745-6b4d-4961-afbe-a8578b9cddab\") " pod="openshift-monitoring/telemeter-client-8f5d459fb-6tl5k" Jul 21 19:39:17.990812 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.990790 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7f54a745-6b4d-4961-afbe-a8578b9cddab-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8f5d459fb-6tl5k\" (UID: \"7f54a745-6b4d-4961-afbe-a8578b9cddab\") " pod="openshift-monitoring/telemeter-client-8f5d459fb-6tl5k" Jul 21 19:39:17.995486 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.995466 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7f54a745-6b4d-4961-afbe-a8578b9cddab-telemeter-client-tls\") pod \"telemeter-client-8f5d459fb-6tl5k\" (UID: \"7f54a745-6b4d-4961-afbe-a8578b9cddab\") " pod="openshift-monitoring/telemeter-client-8f5d459fb-6tl5k" Jul 21 19:39:17.997102 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:17.997062 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd7hs\" (UniqueName: \"kubernetes.io/projected/7f54a745-6b4d-4961-afbe-a8578b9cddab-kube-api-access-zd7hs\") pod \"telemeter-client-8f5d459fb-6tl5k\" (UID: \"7f54a745-6b4d-4961-afbe-a8578b9cddab\") " pod="openshift-monitoring/telemeter-client-8f5d459fb-6tl5k" Jul 21 19:39:18.024132 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.024033 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c60c579-8121-4947-9ccd-1dc39341ec56","Type":"ContainerStarted","Data":"e8f945de74c0c75dc7924581db569d352bebcd393a5b75fc3474c1465bcfbde1"} Jul 21 19:39:18.028066 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.027999 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-rzrhp" event={"ID":"539150a9-fc2d-4bd2-ad45-0f485ede80ef","Type":"ContainerStarted","Data":"8eab5e6b26c1ddac17193940a33d7abcab9eaf28720086501e1cbf2dbb6e0949"} Jul 21 19:39:18.034192 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.034067 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5wzgw" event={"ID":"53364f5c-6e45-469d-9869-b8455fa40af5","Type":"ContainerStarted","Data":"8fb3b1ae5cf404cb052bfc8349550a517c06b04617f92a9c76fbf2fb91cf3f0e"} Jul 21 19:39:18.037119 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.037098 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-4fk66" Jul 21 19:39:18.139025 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.138949 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8f5d459fb-6tl5k" Jul 21 19:39:18.339199 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.339161 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8f5d459fb-6tl5k"] Jul 21 19:39:18.698799 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.698212 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 19:39:18.714149 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.714119 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.718161 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.717937 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 21 19:39:18.718729 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.718711 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 21 19:39:18.722806 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.719099 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 21 19:39:18.723125 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.719141 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 21 19:39:18.723375 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.719174 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 21 19:39:18.723617 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.719214 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 21 19:39:18.723856 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.719307 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 21 19:39:18.724118 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.719344 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 21 19:39:18.724357 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.719387 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 21 19:39:18.724604 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.719430 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 21 19:39:18.724842 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.719981 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-m5khm\"" Jul 21 19:39:18.725098 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.720033 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 21 19:39:18.725343 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.720560 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 21 19:39:18.725604 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.720606 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-d460555ro3iea\"" Jul 21 19:39:18.725851 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.720672 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 21 19:39:18.730239 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.730218 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 19:39:18.740441 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.739670 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 21 19:39:18.740517 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.740440 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 21 19:39:18.890967 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.890032 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/210b4174-7e76-4e8d-90c6-537f472d5a4b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.890967 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.890079 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/210b4174-7e76-4e8d-90c6-537f472d5a4b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.890967 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.890132 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/210b4174-7e76-4e8d-90c6-537f472d5a4b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.890967 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.890166 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/210b4174-7e76-4e8d-90c6-537f472d5a4b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.890967 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.890191 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/210b4174-7e76-4e8d-90c6-537f472d5a4b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.890967 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.890212 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/210b4174-7e76-4e8d-90c6-537f472d5a4b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.890967 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.890234 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/210b4174-7e76-4e8d-90c6-537f472d5a4b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.890967 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.890266 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/210b4174-7e76-4e8d-90c6-537f472d5a4b-web-config\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.890967 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.890290 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/210b4174-7e76-4e8d-90c6-537f472d5a4b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.890967 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.890317 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/210b4174-7e76-4e8d-90c6-537f472d5a4b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.890967 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.890338 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/210b4174-7e76-4e8d-90c6-537f472d5a4b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.890967 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.890378 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/210b4174-7e76-4e8d-90c6-537f472d5a4b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.890967 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.890403 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/210b4174-7e76-4e8d-90c6-537f472d5a4b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.890967 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.890425 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/210b4174-7e76-4e8d-90c6-537f472d5a4b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.890967 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.890451 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrq9b\" (UniqueName: \"kubernetes.io/projected/210b4174-7e76-4e8d-90c6-537f472d5a4b-kube-api-access-lrq9b\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.890967 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.890501 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/210b4174-7e76-4e8d-90c6-537f472d5a4b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.892273 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.890536 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/210b4174-7e76-4e8d-90c6-537f472d5a4b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.892273 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.890560 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/210b4174-7e76-4e8d-90c6-537f472d5a4b-config\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.892273 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.890581 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/210b4174-7e76-4e8d-90c6-537f472d5a4b-config-out\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.892273 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.890618 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/210b4174-7e76-4e8d-90c6-537f472d5a4b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.951787 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:39:18.951710 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f54a745_6b4d_4961_afbe_a8578b9cddab.slice/crio-647c0e8ecd26b03d7fa5f237c58e74caa9bd445aab6c68827b0365699f3aca7f WatchSource:0}: Error finding container 647c0e8ecd26b03d7fa5f237c58e74caa9bd445aab6c68827b0365699f3aca7f: Status 404 returned error can't find the container with id 647c0e8ecd26b03d7fa5f237c58e74caa9bd445aab6c68827b0365699f3aca7f Jul 21 19:39:18.992078 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.992038 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/210b4174-7e76-4e8d-90c6-537f472d5a4b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.992190 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.992078 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/210b4174-7e76-4e8d-90c6-537f472d5a4b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.992190 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.992104 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/210b4174-7e76-4e8d-90c6-537f472d5a4b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.992190 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.992131 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/210b4174-7e76-4e8d-90c6-537f472d5a4b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.992190 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.992154 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/210b4174-7e76-4e8d-90c6-537f472d5a4b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.992190 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.992184 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/210b4174-7e76-4e8d-90c6-537f472d5a4b-web-config\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.992459 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.992210 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/210b4174-7e76-4e8d-90c6-537f472d5a4b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.992459 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.992242 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/210b4174-7e76-4e8d-90c6-537f472d5a4b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.992459 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.992264 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/210b4174-7e76-4e8d-90c6-537f472d5a4b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.992459 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.992305 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/210b4174-7e76-4e8d-90c6-537f472d5a4b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.992459 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.992331 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/210b4174-7e76-4e8d-90c6-537f472d5a4b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.992459 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.992354 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/210b4174-7e76-4e8d-90c6-537f472d5a4b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.992459 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.992383 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrq9b\" (UniqueName: \"kubernetes.io/projected/210b4174-7e76-4e8d-90c6-537f472d5a4b-kube-api-access-lrq9b\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.992459 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.992432 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/210b4174-7e76-4e8d-90c6-537f472d5a4b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.992838 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.992487 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/210b4174-7e76-4e8d-90c6-537f472d5a4b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.992838 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.992516 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/210b4174-7e76-4e8d-90c6-537f472d5a4b-config\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.992838 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.992539 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/210b4174-7e76-4e8d-90c6-537f472d5a4b-config-out\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.992838 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.992573 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/210b4174-7e76-4e8d-90c6-537f472d5a4b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.992838 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.992618 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/210b4174-7e76-4e8d-90c6-537f472d5a4b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.992838 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.992642 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/210b4174-7e76-4e8d-90c6-537f472d5a4b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.995734 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.993820 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/210b4174-7e76-4e8d-90c6-537f472d5a4b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.995734 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.995382 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/210b4174-7e76-4e8d-90c6-537f472d5a4b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.996689 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.996066 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/210b4174-7e76-4e8d-90c6-537f472d5a4b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.996689 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.996544 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/210b4174-7e76-4e8d-90c6-537f472d5a4b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:18.997326 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.997299 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/210b4174-7e76-4e8d-90c6-537f472d5a4b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:19.000494 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:18.999682 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/210b4174-7e76-4e8d-90c6-537f472d5a4b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:19.001844 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:19.001189 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/210b4174-7e76-4e8d-90c6-537f472d5a4b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:19.004831 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:19.004809 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/210b4174-7e76-4e8d-90c6-537f472d5a4b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:19.005151 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:19.005126 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/210b4174-7e76-4e8d-90c6-537f472d5a4b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:19.006286 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:19.006195 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/210b4174-7e76-4e8d-90c6-537f472d5a4b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:19.009333 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:19.009314 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/210b4174-7e76-4e8d-90c6-537f472d5a4b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:19.011368 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:19.011348 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrq9b\" (UniqueName: \"kubernetes.io/projected/210b4174-7e76-4e8d-90c6-537f472d5a4b-kube-api-access-lrq9b\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:19.026607 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:19.023596 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/210b4174-7e76-4e8d-90c6-537f472d5a4b-config\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:19.026607 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:19.023701 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/210b4174-7e76-4e8d-90c6-537f472d5a4b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:19.026607 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:19.023829 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/210b4174-7e76-4e8d-90c6-537f472d5a4b-config-out\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:19.026607 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:19.025817 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/210b4174-7e76-4e8d-90c6-537f472d5a4b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:19.026607 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:19.026307 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/210b4174-7e76-4e8d-90c6-537f472d5a4b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:19.026607 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:19.026498 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/210b4174-7e76-4e8d-90c6-537f472d5a4b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:19.027079 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:19.026840 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/210b4174-7e76-4e8d-90c6-537f472d5a4b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:19.027079 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:19.027069 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/210b4174-7e76-4e8d-90c6-537f472d5a4b-web-config\") pod \"prometheus-k8s-0\" (UID: \"210b4174-7e76-4e8d-90c6-537f472d5a4b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:19.041619 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:19.041542 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:19.045080 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:19.045005 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8f5d459fb-6tl5k" event={"ID":"7f54a745-6b4d-4961-afbe-a8578b9cddab","Type":"ContainerStarted","Data":"647c0e8ecd26b03d7fa5f237c58e74caa9bd445aab6c68827b0365699f3aca7f"} Jul 21 19:39:19.267931 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:19.267852 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 19:39:19.273231 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:39:19.273199 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod210b4174_7e76_4e8d_90c6_537f472d5a4b.slice/crio-b53b86a1037d1881ff3a77d37babbc8882afd1fe869b7ff1aefe51f74d935740 WatchSource:0}: Error finding container b53b86a1037d1881ff3a77d37babbc8882afd1fe869b7ff1aefe51f74d935740: Status 404 returned error can't find the container with id b53b86a1037d1881ff3a77d37babbc8882afd1fe869b7ff1aefe51f74d935740 Jul 21 19:39:20.054217 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:20.054063 2581 generic.go:356] "Generic (PLEG): container finished" podID="980db5a5-ca83-4603-8408-40169686abc2" containerID="03fb03c0e9a60aee7e234d938e755a9a23004351efdf30b496dfc531706dc7b2" exitCode=0 Jul 21 19:39:20.054839 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:20.054797 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rks8q" event={"ID":"980db5a5-ca83-4603-8408-40169686abc2","Type":"ContainerDied","Data":"03fb03c0e9a60aee7e234d938e755a9a23004351efdf30b496dfc531706dc7b2"} Jul 21 19:39:20.058178 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:20.058098 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5wzgw" event={"ID":"53364f5c-6e45-469d-9869-b8455fa40af5","Type":"ContainerStarted","Data":"e5d4fd4da34a3dc1b62514616e847294027d6266e941d3956824a457d97aabd3"} Jul 21 19:39:20.060695 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:20.060609 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"210b4174-7e76-4e8d-90c6-537f472d5a4b","Type":"ContainerStarted","Data":"b53b86a1037d1881ff3a77d37babbc8882afd1fe869b7ff1aefe51f74d935740"} Jul 21 19:39:22.943447 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:22.943338 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" podUID="2c159abd-90aa-4655-a6a4-b4cb928e7f16" containerName="registry" containerID="cri-o://f7d645577ccb45c8c89d62d72baeef31bc6847382d0cb78587ac332be4f9dd33" gracePeriod=30 Jul 21 19:39:23.075007 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:23.074978 2581 generic.go:356] "Generic (PLEG): container finished" podID="2c159abd-90aa-4655-a6a4-b4cb928e7f16" containerID="f7d645577ccb45c8c89d62d72baeef31bc6847382d0cb78587ac332be4f9dd33" exitCode=0 Jul 21 19:39:23.075141 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:23.075050 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" event={"ID":"2c159abd-90aa-4655-a6a4-b4cb928e7f16","Type":"ContainerDied","Data":"f7d645577ccb45c8c89d62d72baeef31bc6847382d0cb78587ac332be4f9dd33"} Jul 21 19:39:24.171554 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:24.171516 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" Jul 21 19:39:24.192233 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:24.192177 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5wzgw" podStartSLOduration=9.929777391 podStartE2EDuration="12.192155284s" totalImagesPullingTime="2.262377893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:39:20.098091012 +0000 UTC m=+125.058103447" watchObservedRunningTime="2026-07-21 19:39:24.192155284 +0000 UTC m=+129.152167719" Jul 21 19:39:24.246452 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:24.246375 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fg7m\" (UniqueName: \"kubernetes.io/projected/2c159abd-90aa-4655-a6a4-b4cb928e7f16-kube-api-access-9fg7m\") pod \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " Jul 21 19:39:24.246452 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:24.246418 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c159abd-90aa-4655-a6a4-b4cb928e7f16-trusted-ca\") pod \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " Jul 21 19:39:24.246674 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:24.246459 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c159abd-90aa-4655-a6a4-b4cb928e7f16-registry-certificates\") pod \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " Jul 21 19:39:24.246674 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:24.246576 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c159abd-90aa-4655-a6a4-b4cb928e7f16-bound-sa-token\") pod \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " Jul 21 19:39:24.246674 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:24.246643 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c159abd-90aa-4655-a6a4-b4cb928e7f16-image-registry-private-configuration\") pod \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " Jul 21 19:39:24.246962 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:24.246842 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c159abd-90aa-4655-a6a4-b4cb928e7f16-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2c159abd-90aa-4655-a6a4-b4cb928e7f16" (UID: "2c159abd-90aa-4655-a6a4-b4cb928e7f16"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 19:39:24.246962 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:24.246875 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c159abd-90aa-4655-a6a4-b4cb928e7f16-installation-pull-secrets\") pod \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " Jul 21 19:39:24.246962 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:24.246878 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c159abd-90aa-4655-a6a4-b4cb928e7f16-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2c159abd-90aa-4655-a6a4-b4cb928e7f16" (UID: "2c159abd-90aa-4655-a6a4-b4cb928e7f16"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 19:39:24.246962 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:24.246949 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c159abd-90aa-4655-a6a4-b4cb928e7f16-ca-trust-extracted\") pod \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " Jul 21 19:39:24.247865 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:24.247007 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c159abd-90aa-4655-a6a4-b4cb928e7f16-registry-tls\") pod \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\" (UID: \"2c159abd-90aa-4655-a6a4-b4cb928e7f16\") " Jul 21 19:39:24.247865 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:24.247296 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c159abd-90aa-4655-a6a4-b4cb928e7f16-trusted-ca\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 19:39:24.247865 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:24.247317 2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c159abd-90aa-4655-a6a4-b4cb928e7f16-registry-certificates\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 19:39:24.249994 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:24.249944 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c159abd-90aa-4655-a6a4-b4cb928e7f16-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2c159abd-90aa-4655-a6a4-b4cb928e7f16" (UID: "2c159abd-90aa-4655-a6a4-b4cb928e7f16"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 19:39:24.250290 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:24.250264 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c159abd-90aa-4655-a6a4-b4cb928e7f16-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2c159abd-90aa-4655-a6a4-b4cb928e7f16" (UID: "2c159abd-90aa-4655-a6a4-b4cb928e7f16"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 19:39:24.250656 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:24.250628 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c159abd-90aa-4655-a6a4-b4cb928e7f16-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2c159abd-90aa-4655-a6a4-b4cb928e7f16" (UID: "2c159abd-90aa-4655-a6a4-b4cb928e7f16"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 19:39:24.250739 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:24.250679 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c159abd-90aa-4655-a6a4-b4cb928e7f16-kube-api-access-9fg7m" (OuterVolumeSpecName: "kube-api-access-9fg7m") pod "2c159abd-90aa-4655-a6a4-b4cb928e7f16" (UID: "2c159abd-90aa-4655-a6a4-b4cb928e7f16"). InnerVolumeSpecName "kube-api-access-9fg7m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 19:39:24.251001 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:24.250966 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c159abd-90aa-4655-a6a4-b4cb928e7f16-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2c159abd-90aa-4655-a6a4-b4cb928e7f16" (UID: "2c159abd-90aa-4655-a6a4-b4cb928e7f16"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 19:39:24.258918 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:24.258875 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c159abd-90aa-4655-a6a4-b4cb928e7f16-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2c159abd-90aa-4655-a6a4-b4cb928e7f16" (UID: "2c159abd-90aa-4655-a6a4-b4cb928e7f16"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 19:39:24.348650 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:24.348624 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c159abd-90aa-4655-a6a4-b4cb928e7f16-registry-tls\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 19:39:24.348753 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:24.348667 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fg7m\" (UniqueName: \"kubernetes.io/projected/2c159abd-90aa-4655-a6a4-b4cb928e7f16-kube-api-access-9fg7m\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 19:39:24.348753 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:24.348682 2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c159abd-90aa-4655-a6a4-b4cb928e7f16-bound-sa-token\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 19:39:24.348753 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:24.348695 2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c159abd-90aa-4655-a6a4-b4cb928e7f16-image-registry-private-configuration\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 19:39:24.348753 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:24.348707 2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c159abd-90aa-4655-a6a4-b4cb928e7f16-installation-pull-secrets\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 19:39:24.348753 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:24.348720 2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c159abd-90aa-4655-a6a4-b4cb928e7f16-ca-trust-extracted\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 19:39:25.085415 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:25.085337 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" event={"ID":"2c159abd-90aa-4655-a6a4-b4cb928e7f16","Type":"ContainerDied","Data":"ea2c290a4908ec2603ed5e95cb40b52e06368d11f49b3a5eeba65e9cc92fde63"} Jul 21 19:39:25.085415 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:25.085410 2581 scope.go:117] "RemoveContainer" containerID="f7d645577ccb45c8c89d62d72baeef31bc6847382d0cb78587ac332be4f9dd33" Jul 21 19:39:25.085643 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:25.085345 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d8497d4b5-7g956" Jul 21 19:39:25.087701 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:25.087675 2581 generic.go:356] "Generic (PLEG): container finished" podID="210b4174-7e76-4e8d-90c6-537f472d5a4b" containerID="6655b034f1777fa935c9159a7415f4608fb35473dbefa99e4da976f094d8ef2f" exitCode=0 Jul 21 19:39:25.087794 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:25.087763 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"210b4174-7e76-4e8d-90c6-537f472d5a4b","Type":"ContainerDied","Data":"6655b034f1777fa935c9159a7415f4608fb35473dbefa99e4da976f094d8ef2f"} Jul 21 19:39:25.091680 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:25.091656 2581 generic.go:356] "Generic (PLEG): container finished" podID="9c60c579-8121-4947-9ccd-1dc39341ec56" containerID="0336fa57cbe19eee4e08a4ed4f44b2d94d9ab2b01a7e43603c347601a3b8688d" exitCode=0 Jul 21 19:39:25.091782 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:25.091743 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c60c579-8121-4947-9ccd-1dc39341ec56","Type":"ContainerDied","Data":"0336fa57cbe19eee4e08a4ed4f44b2d94d9ab2b01a7e43603c347601a3b8688d"} Jul 21 19:39:25.095103 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:25.095077 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z4wl4" event={"ID":"21fbc355-5f0b-495a-bb69-38730c31a5b2","Type":"ContainerStarted","Data":"5239003be8242eac1e9a393327510ded45c3f137fefcb739f1ac642ff93b51a2"} Jul 21 19:39:25.097727 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:25.097703 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-rzrhp" event={"ID":"539150a9-fc2d-4bd2-ad45-0f485ede80ef","Type":"ContainerStarted","Data":"0907dbb36ed110cb99fdc8fbde387c1972cd577ebc7becab54bc3e854c2e51a7"} Jul 21 19:39:25.097851 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:25.097753 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-rzrhp" event={"ID":"539150a9-fc2d-4bd2-ad45-0f485ede80ef","Type":"ContainerStarted","Data":"d5db65033d3096f8e04ff06a0e4a236dcd3a82e87cc107515d8fa9a3a747cb16"} Jul 21 19:39:25.097851 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:25.097776 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-rzrhp" event={"ID":"539150a9-fc2d-4bd2-ad45-0f485ede80ef","Type":"ContainerStarted","Data":"8c5adba4bdf47a37c2d2399acb0d99bdb99b86f50e66df8d717a3dc168cd4734"} Jul 21 19:39:25.100440 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:25.100417 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8f5d459fb-6tl5k" event={"ID":"7f54a745-6b4d-4961-afbe-a8578b9cddab","Type":"ContainerStarted","Data":"5a485aa3d61acc7f8e0028358dac6701802d008407b2554c4b735b180ed564e1"} Jul 21 19:39:25.100540 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:25.100466 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8f5d459fb-6tl5k" event={"ID":"7f54a745-6b4d-4961-afbe-a8578b9cddab","Type":"ContainerStarted","Data":"d138193402ad3b35844459b4933e52afce1d86a2f2cd8c272e22b681b6461929"} Jul 21 19:39:25.100540 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:25.100498 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8f5d459fb-6tl5k" event={"ID":"7f54a745-6b4d-4961-afbe-a8578b9cddab","Type":"ContainerStarted","Data":"eef3e33f0ddaa9b537ce8ff1d5b7f1dbba2ac296b054254d52301cf292a152b9"} Jul 21 19:39:25.102776 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:25.102753 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rks8q" event={"ID":"980db5a5-ca83-4603-8408-40169686abc2","Type":"ContainerStarted","Data":"25009221ded51488b9e6f9e64dab15b76c38d048653cfa7c8b33ff186e9eef25"} Jul 21 19:39:25.102875 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:25.102796 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rks8q" event={"ID":"980db5a5-ca83-4603-8408-40169686abc2","Type":"ContainerStarted","Data":"b66892510f906684660559b92c65621385c20735505d35d5d8adfd05da198ab4"} Jul 21 19:39:25.151830 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:25.151790 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d8497d4b5-7g956"] Jul 21 19:39:25.159184 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:25.159157 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5d8497d4b5-7g956"] Jul 21 19:39:25.176171 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:25.176108 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rks8q" podStartSLOduration=10.824752769 podStartE2EDuration="13.17608953s" totalImagesPullingTime="2.220765832s" totalInitContainerRuntime="130.570929ms" isStatefulPod=true podCreationTimestamp="2026-07-21 19:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:39:25.174671492 +0000 UTC m=+130.134683926" watchObservedRunningTime="2026-07-21 19:39:25.17608953 +0000 UTC m=+130.136101969" Jul 21 19:39:25.200176 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:25.200137 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-8f5d459fb-6tl5k" podStartSLOduration=2.7939301050000003 podStartE2EDuration="8.200124591s" totalImagesPullingTime="5.406194486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:39:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:39:25.198802612 +0000 UTC m=+130.158815047" watchObservedRunningTime="2026-07-21 19:39:25.200124591 +0000 UTC m=+130.160137024" Jul 21 19:39:25.221590 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:25.221543 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-rzrhp" podStartSLOduration=6.058930167 podStartE2EDuration="13.221528234s" totalImagesPullingTime="7.162598067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:39:25.220344174 +0000 UTC m=+130.180356609" watchObservedRunningTime="2026-07-21 19:39:25.221528234 +0000 UTC m=+130.181540668" Jul 21 19:39:25.259867 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:25.259830 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f593837e-f6e2-4b42-aa46-5dbee27cf83a-metrics-certs\") pod \"network-metrics-daemon-wzkph\" (UID: \"f593837e-f6e2-4b42-aa46-5dbee27cf83a\") " pod="openshift-multus/network-metrics-daemon-wzkph" Jul 21 19:39:25.262344 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:25.262316 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f593837e-f6e2-4b42-aa46-5dbee27cf83a-metrics-certs\") pod \"network-metrics-daemon-wzkph\" (UID: \"f593837e-f6e2-4b42-aa46-5dbee27cf83a\") " pod="openshift-multus/network-metrics-daemon-wzkph" Jul 21 19:39:25.358771 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:25.358705 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tcjpf\"" Jul 21 19:39:25.366109 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:25.366077 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzkph" Jul 21 19:39:25.535174 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:25.535138 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c159abd-90aa-4655-a6a4-b4cb928e7f16" path="/var/lib/kubelet/pods/2c159abd-90aa-4655-a6a4-b4cb928e7f16/volumes" Jul 21 19:39:25.564951 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:25.564929 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wzkph"] Jul 21 19:39:25.567681 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:39:25.567654 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf593837e_f6e2_4b42_aa46_5dbee27cf83a.slice/crio-3ea0ffdebaf85020582fb4eb2518daae9a2cd204f8fd4b62b094bab8c4bc3622 WatchSource:0}: Error finding container 3ea0ffdebaf85020582fb4eb2518daae9a2cd204f8fd4b62b094bab8c4bc3622: Status 404 returned error can't find the container with id 3ea0ffdebaf85020582fb4eb2518daae9a2cd204f8fd4b62b094bab8c4bc3622 Jul 21 19:39:26.110964 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:26.110811 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wzkph" event={"ID":"f593837e-f6e2-4b42-aa46-5dbee27cf83a","Type":"ContainerStarted","Data":"3ea0ffdebaf85020582fb4eb2518daae9a2cd204f8fd4b62b094bab8c4bc3622"} Jul 21 19:39:32.139940 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:32.139906 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z4wl4" event={"ID":"21fbc355-5f0b-495a-bb69-38730c31a5b2","Type":"ContainerStarted","Data":"22fb3e6bca407c4bc757a6c89ae05dce09091f54bce90ae1222acff1881cf22f"} Jul 21 19:39:32.142044 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:32.142019 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"210b4174-7e76-4e8d-90c6-537f472d5a4b","Type":"ContainerStarted","Data":"95ce4fd3179bd04bcf5c747e7089518affc4c577b35b111046866c9674b5c246"} Jul 21 19:39:32.142179 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:32.142079 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"210b4174-7e76-4e8d-90c6-537f472d5a4b","Type":"ContainerStarted","Data":"baf9ad668c5cec2524bdb55e088a3093b62b5da2b8699f476c61af2b4feca0f9"} Jul 21 19:39:32.143774 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:32.143750 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wzkph" event={"ID":"f593837e-f6e2-4b42-aa46-5dbee27cf83a","Type":"ContainerStarted","Data":"bc0b9bdb866754901e9c8d10ffad44cbea2852087252ae47baac1e9113f9b076"} Jul 21 19:39:32.143912 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:32.143805 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wzkph" event={"ID":"f593837e-f6e2-4b42-aa46-5dbee27cf83a","Type":"ContainerStarted","Data":"a6f142cf6fa1584ff5d33806119cd4d95e8e7531a56fcd6fec7f91068aaa2225"} Jul 21 19:39:32.146529 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:32.146509 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c60c579-8121-4947-9ccd-1dc39341ec56","Type":"ContainerStarted","Data":"cc676734eb01755eac2bd900e18b2850fc4682f9ac3a43a119428ff04114f512"} Jul 21 19:39:32.146618 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:32.146559 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c60c579-8121-4947-9ccd-1dc39341ec56","Type":"ContainerStarted","Data":"0336cb0faa248683e5fdc51f9908ad0f05ad4c506541657cbcf8d339791f8e70"} Jul 21 19:39:32.146618 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:32.146582 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c60c579-8121-4947-9ccd-1dc39341ec56","Type":"ContainerStarted","Data":"6780d699ed5bf4d043357b5b4ab7e99bb83c48a94ea757d5baccac34fdd11a01"} Jul 21 19:39:32.146618 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:32.146605 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c60c579-8121-4947-9ccd-1dc39341ec56","Type":"ContainerStarted","Data":"dbc1200c0223c9ddeefd4cbb12dcd7fb5c8910778a0bf609933565011c3ec0ce"} Jul 21 19:39:32.146716 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:32.146628 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c60c579-8121-4947-9ccd-1dc39341ec56","Type":"ContainerStarted","Data":"3064b757381367f54fdb9640293770898a38e7cf5c21c93012bb30d44b2c7e51"} Jul 21 19:39:32.163424 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:32.162680 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-z4wl4" podStartSLOduration=34.178492188 podStartE2EDuration="1m1.162663777s" totalImagesPullingTime="26.984171589s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 19:38:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:39:32.157602408 +0000 UTC m=+137.117614842" watchObservedRunningTime="2026-07-21 19:39:32.162663777 +0000 UTC m=+137.122676201" Jul 21 19:39:32.178032 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:32.177990 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wzkph" podStartSLOduration=131.680303792 podStartE2EDuration="2m17.177978246s" totalImagesPullingTime="5.497674454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:39:32.176372766 +0000 UTC m=+137.136385202" watchObservedRunningTime="2026-07-21 19:39:32.177978246 +0000 UTC m=+137.137990718" Jul 21 19:39:34.158473 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:34.158433 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c60c579-8121-4947-9ccd-1dc39341ec56","Type":"ContainerStarted","Data":"8dfcca69e320460c80d05fa120ba5f4127b7940d332e0b6671df84dfa79bd870"} Jul 21 19:39:34.191205 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:34.191120 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=7.098452679 podStartE2EDuration="21.19110076s" totalImagesPullingTime="14.069737685s" totalInitContainerRuntime="22.910396ms" isStatefulPod=false podCreationTimestamp="2026-07-21 19:39:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:39:34.188165624 +0000 UTC m=+139.148178111" watchObservedRunningTime="2026-07-21 19:39:34.19110076 +0000 UTC m=+139.151113194" Jul 21 19:39:35.166068 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:35.166028 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"210b4174-7e76-4e8d-90c6-537f472d5a4b","Type":"ContainerStarted","Data":"bf838951f5267de67c6a432ea333d69877adc4c8c73614462ae4b35de830d659"} Jul 21 19:39:35.166545 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:35.166115 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"210b4174-7e76-4e8d-90c6-537f472d5a4b","Type":"ContainerStarted","Data":"b9da12766147d8514e078429c798bbbe707d9c4fc3eb952f80467cc588475a67"} Jul 21 19:39:35.166545 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:35.166164 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"210b4174-7e76-4e8d-90c6-537f472d5a4b","Type":"ContainerStarted","Data":"6902aaeddb2cfd3dfb39c3e511f247e351f0f4bd37e24697c619b12dca35ebff"} Jul 21 19:39:35.166545 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:35.166209 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"210b4174-7e76-4e8d-90c6-537f472d5a4b","Type":"ContainerStarted","Data":"b8fbf858096653abc5f088bd9ce78681930daab6fb77f5f8ed4154a5f09b1667"} Jul 21 19:39:35.201260 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:35.201207 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.064191371 podStartE2EDuration="17.201190512s" totalImagesPullingTime="14.108293299s" totalInitContainerRuntime="28.705842ms" isStatefulPod=false podCreationTimestamp="2026-07-21 19:39:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:39:35.199742728 +0000 UTC m=+140.159755161" watchObservedRunningTime="2026-07-21 19:39:35.201190512 +0000 UTC m=+140.161202947" Jul 21 19:39:39.042471 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:39.042436 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:39:39.171968 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:39.171933 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-69c5f6c8bb-8j8cl" podUID="252c47fa-fc69-463a-a137-693698551a5c" containerName="console" containerID="cri-o://a37ebb026de0faed3bbc23fdffd86d782be0653ea123a731e001f37d15c72c25" gracePeriod=15 Jul 21 19:39:39.433738 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:39.433713 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69c5f6c8bb-8j8cl" Jul 21 19:39:39.495301 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:39.495272 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/252c47fa-fc69-463a-a137-693698551a5c-service-ca\") pod \"252c47fa-fc69-463a-a137-693698551a5c\" (UID: \"252c47fa-fc69-463a-a137-693698551a5c\") " Jul 21 19:39:39.495426 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:39.495309 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/252c47fa-fc69-463a-a137-693698551a5c-console-config\") pod \"252c47fa-fc69-463a-a137-693698551a5c\" (UID: \"252c47fa-fc69-463a-a137-693698551a5c\") " Jul 21 19:39:39.495426 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:39.495338 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/252c47fa-fc69-463a-a137-693698551a5c-console-oauth-config\") pod \"252c47fa-fc69-463a-a137-693698551a5c\" (UID: \"252c47fa-fc69-463a-a137-693698551a5c\") " Jul 21 19:39:39.495505 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:39.495466 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/252c47fa-fc69-463a-a137-693698551a5c-oauth-serving-cert\") pod \"252c47fa-fc69-463a-a137-693698551a5c\" (UID: \"252c47fa-fc69-463a-a137-693698551a5c\") " Jul 21 19:39:39.495617 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:39.495580 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/252c47fa-fc69-463a-a137-693698551a5c-console-serving-cert\") pod \"252c47fa-fc69-463a-a137-693698551a5c\" (UID: \"252c47fa-fc69-463a-a137-693698551a5c\") " Jul 21 19:39:39.495669 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:39.495638 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gx4dj\" (UniqueName: \"kubernetes.io/projected/252c47fa-fc69-463a-a137-693698551a5c-kube-api-access-gx4dj\") pod \"252c47fa-fc69-463a-a137-693698551a5c\" (UID: \"252c47fa-fc69-463a-a137-693698551a5c\") " Jul 21 19:39:39.495669 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:39.495635 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/252c47fa-fc69-463a-a137-693698551a5c-console-config" (OuterVolumeSpecName: "console-config") pod "252c47fa-fc69-463a-a137-693698551a5c" (UID: "252c47fa-fc69-463a-a137-693698551a5c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 19:39:39.495776 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:39.495694 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/252c47fa-fc69-463a-a137-693698551a5c-service-ca" (OuterVolumeSpecName: "service-ca") pod "252c47fa-fc69-463a-a137-693698551a5c" (UID: "252c47fa-fc69-463a-a137-693698551a5c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 19:39:39.495836 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:39.495802 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/252c47fa-fc69-463a-a137-693698551a5c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "252c47fa-fc69-463a-a137-693698551a5c" (UID: "252c47fa-fc69-463a-a137-693698551a5c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 19:39:39.495914 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:39.495886 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/252c47fa-fc69-463a-a137-693698551a5c-service-ca\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 19:39:39.495983 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:39.495916 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/252c47fa-fc69-463a-a137-693698551a5c-console-config\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 19:39:39.495983 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:39.495925 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/252c47fa-fc69-463a-a137-693698551a5c-oauth-serving-cert\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 19:39:39.497539 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:39.497519 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/252c47fa-fc69-463a-a137-693698551a5c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "252c47fa-fc69-463a-a137-693698551a5c" (UID: "252c47fa-fc69-463a-a137-693698551a5c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 19:39:39.497622 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:39.497604 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/252c47fa-fc69-463a-a137-693698551a5c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "252c47fa-fc69-463a-a137-693698551a5c" (UID: "252c47fa-fc69-463a-a137-693698551a5c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 19:39:39.497694 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:39.497676 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/252c47fa-fc69-463a-a137-693698551a5c-kube-api-access-gx4dj" (OuterVolumeSpecName: "kube-api-access-gx4dj") pod "252c47fa-fc69-463a-a137-693698551a5c" (UID: "252c47fa-fc69-463a-a137-693698551a5c"). InnerVolumeSpecName "kube-api-access-gx4dj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 19:39:39.596805 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:39.596746 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/252c47fa-fc69-463a-a137-693698551a5c-console-serving-cert\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 19:39:39.596805 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:39.596793 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gx4dj\" (UniqueName: \"kubernetes.io/projected/252c47fa-fc69-463a-a137-693698551a5c-kube-api-access-gx4dj\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 19:39:39.596805 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:39.596804 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/252c47fa-fc69-463a-a137-693698551a5c-console-oauth-config\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 19:39:40.187981 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:40.187944 2581 generic.go:356] "Generic (PLEG): container finished" podID="252c47fa-fc69-463a-a137-693698551a5c" containerID="a37ebb026de0faed3bbc23fdffd86d782be0653ea123a731e001f37d15c72c25" exitCode=0 Jul 21 19:39:40.188467 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:40.188004 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69c5f6c8bb-8j8cl" Jul 21 19:39:40.188467 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:40.188029 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69c5f6c8bb-8j8cl" event={"ID":"252c47fa-fc69-463a-a137-693698551a5c","Type":"ContainerDied","Data":"a37ebb026de0faed3bbc23fdffd86d782be0653ea123a731e001f37d15c72c25"} Jul 21 19:39:40.188467 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:40.188082 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69c5f6c8bb-8j8cl" event={"ID":"252c47fa-fc69-463a-a137-693698551a5c","Type":"ContainerDied","Data":"37fed0f24f981d0497783a16b2cd104ed3a86a3cfab6003df909258a0c9d7d0d"} Jul 21 19:39:40.188467 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:40.188103 2581 scope.go:117] "RemoveContainer" containerID="a37ebb026de0faed3bbc23fdffd86d782be0653ea123a731e001f37d15c72c25" Jul 21 19:39:40.196304 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:40.196287 2581 scope.go:117] "RemoveContainer" containerID="a37ebb026de0faed3bbc23fdffd86d782be0653ea123a731e001f37d15c72c25" Jul 21 19:39:40.196602 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:39:40.196585 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a37ebb026de0faed3bbc23fdffd86d782be0653ea123a731e001f37d15c72c25\": container with ID starting with a37ebb026de0faed3bbc23fdffd86d782be0653ea123a731e001f37d15c72c25 not found: ID does not exist" containerID="a37ebb026de0faed3bbc23fdffd86d782be0653ea123a731e001f37d15c72c25" Jul 21 19:39:40.196674 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:40.196612 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a37ebb026de0faed3bbc23fdffd86d782be0653ea123a731e001f37d15c72c25"} err="failed to get container status \"a37ebb026de0faed3bbc23fdffd86d782be0653ea123a731e001f37d15c72c25\": rpc error: code = NotFound desc = could not find container \"a37ebb026de0faed3bbc23fdffd86d782be0653ea123a731e001f37d15c72c25\": container with ID starting with a37ebb026de0faed3bbc23fdffd86d782be0653ea123a731e001f37d15c72c25 not found: ID does not exist" Jul 21 19:39:40.206169 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:40.206146 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69c5f6c8bb-8j8cl"] Jul 21 19:39:40.210224 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:40.210204 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69c5f6c8bb-8j8cl"] Jul 21 19:39:41.533574 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:39:41.533540 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="252c47fa-fc69-463a-a137-693698551a5c" path="/var/lib/kubelet/pods/252c47fa-fc69-463a-a137-693698551a5c/volumes" Jul 21 19:40:19.042599 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:40:19.042567 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:40:19.061171 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:40:19.061146 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:40:19.363515 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:40:19.363448 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 19:42:15.382662 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:15.382636 2581 kubelet.go:1648] "Image garbage collection succeeded" Jul 21 19:42:40.811180 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:40.811148 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tgf55"] Jul 21 19:42:40.812533 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:40.811452 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="252c47fa-fc69-463a-a137-693698551a5c" containerName="console" Jul 21 19:42:40.812533 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:40.811465 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="252c47fa-fc69-463a-a137-693698551a5c" containerName="console" Jul 21 19:42:40.812533 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:40.811491 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c159abd-90aa-4655-a6a4-b4cb928e7f16" containerName="registry" Jul 21 19:42:40.812533 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:40.811497 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c159abd-90aa-4655-a6a4-b4cb928e7f16" containerName="registry" Jul 21 19:42:40.812533 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:40.811544 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="252c47fa-fc69-463a-a137-693698551a5c" containerName="console" Jul 21 19:42:40.812533 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:40.811555 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c159abd-90aa-4655-a6a4-b4cb928e7f16" containerName="registry" Jul 21 19:42:40.813074 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:40.813058 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tgf55" Jul 21 19:42:40.816429 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:40.816410 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-lxhq5\"" Jul 21 19:42:40.817661 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:40.817642 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 21 19:42:40.817729 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:40.817650 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 21 19:42:40.826172 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:40.826152 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tgf55"] Jul 21 19:42:40.924187 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:40.924148 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dx4n\" (UniqueName: \"kubernetes.io/projected/d30a5a0f-85e0-46e0-9e31-2dbf5d1c4636-kube-api-access-9dx4n\") pod \"openshift-lws-operator-fd8ccff4c-tgf55\" (UID: \"d30a5a0f-85e0-46e0-9e31-2dbf5d1c4636\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tgf55" Jul 21 19:42:40.924312 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:40.924202 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d30a5a0f-85e0-46e0-9e31-2dbf5d1c4636-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tgf55\" (UID: \"d30a5a0f-85e0-46e0-9e31-2dbf5d1c4636\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tgf55" Jul 21 19:42:41.024906 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:41.024861 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dx4n\" (UniqueName: \"kubernetes.io/projected/d30a5a0f-85e0-46e0-9e31-2dbf5d1c4636-kube-api-access-9dx4n\") pod \"openshift-lws-operator-fd8ccff4c-tgf55\" (UID: \"d30a5a0f-85e0-46e0-9e31-2dbf5d1c4636\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tgf55" Jul 21 19:42:41.025043 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:41.024914 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d30a5a0f-85e0-46e0-9e31-2dbf5d1c4636-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tgf55\" (UID: \"d30a5a0f-85e0-46e0-9e31-2dbf5d1c4636\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tgf55" Jul 21 19:42:41.025226 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:41.025211 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d30a5a0f-85e0-46e0-9e31-2dbf5d1c4636-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tgf55\" (UID: \"d30a5a0f-85e0-46e0-9e31-2dbf5d1c4636\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tgf55" Jul 21 19:42:41.033966 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:41.033943 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dx4n\" (UniqueName: \"kubernetes.io/projected/d30a5a0f-85e0-46e0-9e31-2dbf5d1c4636-kube-api-access-9dx4n\") pod \"openshift-lws-operator-fd8ccff4c-tgf55\" (UID: \"d30a5a0f-85e0-46e0-9e31-2dbf5d1c4636\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tgf55" Jul 21 19:42:41.121394 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:41.121335 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tgf55" Jul 21 19:42:41.247302 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:41.247264 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tgf55"] Jul 21 19:42:41.250370 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:42:41.250340 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd30a5a0f_85e0_46e0_9e31_2dbf5d1c4636.slice/crio-908e2d5c033503b742e4bf485963c025b39b7cd4fa13a9a6e79118a9142c84c2 WatchSource:0}: Error finding container 908e2d5c033503b742e4bf485963c025b39b7cd4fa13a9a6e79118a9142c84c2: Status 404 returned error can't find the container with id 908e2d5c033503b742e4bf485963c025b39b7cd4fa13a9a6e79118a9142c84c2 Jul 21 19:42:41.251985 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:41.251962 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 19:42:41.876022 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:41.875980 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tgf55" event={"ID":"d30a5a0f-85e0-46e0-9e31-2dbf5d1c4636","Type":"ContainerStarted","Data":"908e2d5c033503b742e4bf485963c025b39b7cd4fa13a9a6e79118a9142c84c2"} Jul 21 19:42:43.886510 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:43.886476 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tgf55" event={"ID":"d30a5a0f-85e0-46e0-9e31-2dbf5d1c4636","Type":"ContainerStarted","Data":"d2cc4535481acf3283c69e67c14d826d42cf41b5e6c7733c0de0005aba073ce8"} Jul 21 19:42:43.905927 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:43.905861 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tgf55" podStartSLOduration=1.357432551 podStartE2EDuration="3.905845627s" totalImagesPullingTime="2.548413076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:42:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:42:43.903973295 +0000 UTC m=+328.863985731" watchObservedRunningTime="2026-07-21 19:42:43.905845627 +0000 UTC m=+328.865858060" Jul 21 19:42:55.244442 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:55.244405 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-bc6b5d4fd-hf27m"] Jul 21 19:42:55.247105 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:55.247088 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-hf27m" Jul 21 19:42:55.251378 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:55.251356 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-qlwsm\"" Jul 21 19:42:55.251575 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:55.251560 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 21 19:42:55.251656 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:55.251583 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 21 19:42:55.251711 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:55.251670 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 21 19:42:55.259421 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:55.259400 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-bc6b5d4fd-hf27m"] Jul 21 19:42:55.335015 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:55.334976 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f09c827-c7c6-4323-af77-2cac4da9ef3a-metrics-cert\") pod \"lws-controller-manager-bc6b5d4fd-hf27m\" (UID: \"8f09c827-c7c6-4323-af77-2cac4da9ef3a\") " pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-hf27m" Jul 21 19:42:55.335015 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:55.335013 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqb6j\" (UniqueName: \"kubernetes.io/projected/8f09c827-c7c6-4323-af77-2cac4da9ef3a-kube-api-access-rqb6j\") pod \"lws-controller-manager-bc6b5d4fd-hf27m\" (UID: \"8f09c827-c7c6-4323-af77-2cac4da9ef3a\") " pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-hf27m" Jul 21 19:42:55.335258 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:55.335110 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f09c827-c7c6-4323-af77-2cac4da9ef3a-cert\") pod \"lws-controller-manager-bc6b5d4fd-hf27m\" (UID: \"8f09c827-c7c6-4323-af77-2cac4da9ef3a\") " pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-hf27m" Jul 21 19:42:55.335258 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:55.335138 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8f09c827-c7c6-4323-af77-2cac4da9ef3a-manager-config\") pod \"lws-controller-manager-bc6b5d4fd-hf27m\" (UID: \"8f09c827-c7c6-4323-af77-2cac4da9ef3a\") " pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-hf27m" Jul 21 19:42:55.436114 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:55.436081 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f09c827-c7c6-4323-af77-2cac4da9ef3a-cert\") pod \"lws-controller-manager-bc6b5d4fd-hf27m\" (UID: \"8f09c827-c7c6-4323-af77-2cac4da9ef3a\") " pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-hf27m" Jul 21 19:42:55.436114 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:55.436115 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8f09c827-c7c6-4323-af77-2cac4da9ef3a-manager-config\") pod \"lws-controller-manager-bc6b5d4fd-hf27m\" (UID: \"8f09c827-c7c6-4323-af77-2cac4da9ef3a\") " pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-hf27m" Jul 21 19:42:55.436301 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:55.436170 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f09c827-c7c6-4323-af77-2cac4da9ef3a-metrics-cert\") pod \"lws-controller-manager-bc6b5d4fd-hf27m\" (UID: \"8f09c827-c7c6-4323-af77-2cac4da9ef3a\") " pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-hf27m" Jul 21 19:42:55.436301 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:55.436187 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqb6j\" (UniqueName: \"kubernetes.io/projected/8f09c827-c7c6-4323-af77-2cac4da9ef3a-kube-api-access-rqb6j\") pod \"lws-controller-manager-bc6b5d4fd-hf27m\" (UID: \"8f09c827-c7c6-4323-af77-2cac4da9ef3a\") " pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-hf27m" Jul 21 19:42:55.436874 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:55.436851 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8f09c827-c7c6-4323-af77-2cac4da9ef3a-manager-config\") pod \"lws-controller-manager-bc6b5d4fd-hf27m\" (UID: \"8f09c827-c7c6-4323-af77-2cac4da9ef3a\") " pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-hf27m" Jul 21 19:42:55.438506 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:55.438478 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f09c827-c7c6-4323-af77-2cac4da9ef3a-cert\") pod \"lws-controller-manager-bc6b5d4fd-hf27m\" (UID: \"8f09c827-c7c6-4323-af77-2cac4da9ef3a\") " pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-hf27m" Jul 21 19:42:55.438660 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:55.438640 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f09c827-c7c6-4323-af77-2cac4da9ef3a-metrics-cert\") pod \"lws-controller-manager-bc6b5d4fd-hf27m\" (UID: \"8f09c827-c7c6-4323-af77-2cac4da9ef3a\") " pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-hf27m" Jul 21 19:42:55.445133 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:55.445110 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqb6j\" (UniqueName: \"kubernetes.io/projected/8f09c827-c7c6-4323-af77-2cac4da9ef3a-kube-api-access-rqb6j\") pod \"lws-controller-manager-bc6b5d4fd-hf27m\" (UID: \"8f09c827-c7c6-4323-af77-2cac4da9ef3a\") " pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-hf27m" Jul 21 19:42:55.556636 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:55.556562 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-hf27m" Jul 21 19:42:55.699754 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:42:55.699722 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f09c827_c7c6_4323_af77_2cac4da9ef3a.slice/crio-34b853099c98c32fb6e94d422f999929d58ed714ffce640cbd9d81784aeb551f WatchSource:0}: Error finding container 34b853099c98c32fb6e94d422f999929d58ed714ffce640cbd9d81784aeb551f: Status 404 returned error can't find the container with id 34b853099c98c32fb6e94d422f999929d58ed714ffce640cbd9d81784aeb551f Jul 21 19:42:55.704285 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:55.704258 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-bc6b5d4fd-hf27m"] Jul 21 19:42:55.932827 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:55.932757 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-hf27m" event={"ID":"8f09c827-c7c6-4323-af77-2cac4da9ef3a","Type":"ContainerStarted","Data":"34b853099c98c32fb6e94d422f999929d58ed714ffce640cbd9d81784aeb551f"} Jul 21 19:42:57.941930 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:57.941877 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-hf27m" event={"ID":"8f09c827-c7c6-4323-af77-2cac4da9ef3a","Type":"ContainerStarted","Data":"2f88aa05f19624deb6c855098b1cdd97e8a479e0f62f6b4f2a6e3bcfaee5b6e5"} Jul 21 19:42:57.942309 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:57.941967 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-hf27m" Jul 21 19:42:57.959383 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:42:57.959339 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-hf27m" podStartSLOduration=1.600890067 podStartE2EDuration="2.959320173s" totalImagesPullingTime="1.358430106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:42:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:42:57.959003818 +0000 UTC m=+342.919016253" watchObservedRunningTime="2026-07-21 19:42:57.959320173 +0000 UTC m=+342.919332607" Jul 21 19:43:03.207417 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:03.207373 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f74b88589-mqh4z"] Jul 21 19:43:03.210253 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:03.210229 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-mqh4z" Jul 21 19:43:03.215102 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:03.215079 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 21 19:43:03.215206 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:03.215102 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 21 19:43:03.215309 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:03.215246 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 21 19:43:03.215309 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:03.215290 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-brd8z\"" Jul 21 19:43:03.216175 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:03.216156 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 21 19:43:03.231123 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:03.231101 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f74b88589-mqh4z"] Jul 21 19:43:03.299369 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:03.299340 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c59ba46-4c1a-456e-8652-fa0755666e19-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f74b88589-mqh4z\" (UID: \"0c59ba46-4c1a-456e-8652-fa0755666e19\") " pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-mqh4z" Jul 21 19:43:03.299508 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:03.299387 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0c59ba46-4c1a-456e-8652-fa0755666e19-manifests\") pod \"opendatahub-operator-controller-manager-7f74b88589-mqh4z\" (UID: \"0c59ba46-4c1a-456e-8652-fa0755666e19\") " pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-mqh4z" Jul 21 19:43:03.299508 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:03.299408 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwgp5\" (UniqueName: \"kubernetes.io/projected/0c59ba46-4c1a-456e-8652-fa0755666e19-kube-api-access-jwgp5\") pod \"opendatahub-operator-controller-manager-7f74b88589-mqh4z\" (UID: \"0c59ba46-4c1a-456e-8652-fa0755666e19\") " pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-mqh4z" Jul 21 19:43:03.299508 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:03.299439 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c59ba46-4c1a-456e-8652-fa0755666e19-tmp\") pod \"opendatahub-operator-controller-manager-7f74b88589-mqh4z\" (UID: \"0c59ba46-4c1a-456e-8652-fa0755666e19\") " pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-mqh4z" Jul 21 19:43:03.299508 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:03.299466 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0c59ba46-4c1a-456e-8652-fa0755666e19-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f74b88589-mqh4z\" (UID: \"0c59ba46-4c1a-456e-8652-fa0755666e19\") " pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-mqh4z" Jul 21 19:43:03.399837 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:03.399809 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c59ba46-4c1a-456e-8652-fa0755666e19-tmp\") pod \"opendatahub-operator-controller-manager-7f74b88589-mqh4z\" (UID: \"0c59ba46-4c1a-456e-8652-fa0755666e19\") " pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-mqh4z" Jul 21 19:43:03.399993 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:03.399849 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0c59ba46-4c1a-456e-8652-fa0755666e19-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f74b88589-mqh4z\" (UID: \"0c59ba46-4c1a-456e-8652-fa0755666e19\") " pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-mqh4z" Jul 21 19:43:03.399993 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:03.399911 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c59ba46-4c1a-456e-8652-fa0755666e19-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f74b88589-mqh4z\" (UID: \"0c59ba46-4c1a-456e-8652-fa0755666e19\") " pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-mqh4z" Jul 21 19:43:03.400067 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:03.399988 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0c59ba46-4c1a-456e-8652-fa0755666e19-manifests\") pod \"opendatahub-operator-controller-manager-7f74b88589-mqh4z\" (UID: \"0c59ba46-4c1a-456e-8652-fa0755666e19\") " pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-mqh4z" Jul 21 19:43:03.400067 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:03.400023 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwgp5\" (UniqueName: \"kubernetes.io/projected/0c59ba46-4c1a-456e-8652-fa0755666e19-kube-api-access-jwgp5\") pod \"opendatahub-operator-controller-manager-7f74b88589-mqh4z\" (UID: \"0c59ba46-4c1a-456e-8652-fa0755666e19\") " pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-mqh4z" Jul 21 19:43:03.400405 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:03.400376 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0c59ba46-4c1a-456e-8652-fa0755666e19-manifests\") pod \"opendatahub-operator-controller-manager-7f74b88589-mqh4z\" (UID: \"0c59ba46-4c1a-456e-8652-fa0755666e19\") " pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-mqh4z" Jul 21 19:43:03.402249 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:03.402224 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c59ba46-4c1a-456e-8652-fa0755666e19-tmp\") pod \"opendatahub-operator-controller-manager-7f74b88589-mqh4z\" (UID: \"0c59ba46-4c1a-456e-8652-fa0755666e19\") " pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-mqh4z" Jul 21 19:43:03.402360 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:03.402342 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c59ba46-4c1a-456e-8652-fa0755666e19-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f74b88589-mqh4z\" (UID: \"0c59ba46-4c1a-456e-8652-fa0755666e19\") " pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-mqh4z" Jul 21 19:43:03.402466 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:03.402449 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0c59ba46-4c1a-456e-8652-fa0755666e19-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f74b88589-mqh4z\" (UID: \"0c59ba46-4c1a-456e-8652-fa0755666e19\") " pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-mqh4z" Jul 21 19:43:03.413182 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:03.413156 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwgp5\" (UniqueName: \"kubernetes.io/projected/0c59ba46-4c1a-456e-8652-fa0755666e19-kube-api-access-jwgp5\") pod \"opendatahub-operator-controller-manager-7f74b88589-mqh4z\" (UID: \"0c59ba46-4c1a-456e-8652-fa0755666e19\") " pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-mqh4z" Jul 21 19:43:03.521232 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:03.521208 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-mqh4z" Jul 21 19:43:03.691776 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:03.691743 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f74b88589-mqh4z"] Jul 21 19:43:03.695384 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:43:03.695351 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c59ba46_4c1a_456e_8652_fa0755666e19.slice/crio-63e1f5929a234330cd281cb720153908c0af7c0da1d396baae7eb064bb966d94 WatchSource:0}: Error finding container 63e1f5929a234330cd281cb720153908c0af7c0da1d396baae7eb064bb966d94: Status 404 returned error can't find the container with id 63e1f5929a234330cd281cb720153908c0af7c0da1d396baae7eb064bb966d94 Jul 21 19:43:03.965945 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:03.965870 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-mqh4z" event={"ID":"0c59ba46-4c1a-456e-8652-fa0755666e19","Type":"ContainerStarted","Data":"63e1f5929a234330cd281cb720153908c0af7c0da1d396baae7eb064bb966d94"} Jul 21 19:43:06.984331 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:06.984297 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-mqh4z" event={"ID":"0c59ba46-4c1a-456e-8652-fa0755666e19","Type":"ContainerStarted","Data":"137fc4dda8cf080b95485f49178aac60eba787bade4551b692d8820cc517a281"} Jul 21 19:43:07.989765 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:07.989737 2581 generic.go:356] "Generic (PLEG): container finished" podID="0c59ba46-4c1a-456e-8652-fa0755666e19" containerID="137fc4dda8cf080b95485f49178aac60eba787bade4551b692d8820cc517a281" exitCode=0 Jul 21 19:43:07.990085 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:07.989826 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-mqh4z" event={"ID":"0c59ba46-4c1a-456e-8652-fa0755666e19","Type":"ContainerDied","Data":"137fc4dda8cf080b95485f49178aac60eba787bade4551b692d8820cc517a281"} Jul 21 19:43:08.947312 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:08.947276 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-hf27m" Jul 21 19:43:08.998863 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:08.998820 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-mqh4z" event={"ID":"0c59ba46-4c1a-456e-8652-fa0755666e19","Type":"ContainerStarted","Data":"30486aee07ba9aab26b84c51bfedcbd7b8c98327c16cf515870fe2da44c8c4f1"} Jul 21 19:43:08.999327 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:08.998945 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-mqh4z" Jul 21 19:43:09.022614 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:09.022477 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-mqh4z" podStartSLOduration=1.40747017 podStartE2EDuration="6.022459425s" totalImagesPullingTime="3.542750149s" totalInitContainerRuntime="1.072239106s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:43:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:43:09.021917947 +0000 UTC m=+353.981930383" watchObservedRunningTime="2026-07-21 19:43:09.022459425 +0000 UTC m=+353.982471860" Jul 21 19:43:20.005758 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:20.005729 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-mqh4z" Jul 21 19:43:23.429115 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:23.429081 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7db7f7c8d6-m29dt"] Jul 21 19:43:23.437073 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:23.437053 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7db7f7c8d6-m29dt" Jul 21 19:43:23.465772 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:23.465748 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 21 19:43:23.466023 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:23.465857 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 21 19:43:23.466023 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:23.465866 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 21 19:43:23.472345 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:23.472325 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 21 19:43:23.472457 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:23.472424 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-hjcjb\"" Jul 21 19:43:23.500017 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:23.499987 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7db7f7c8d6-m29dt"] Jul 21 19:43:23.565451 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:23.565421 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt7z5\" (UniqueName: \"kubernetes.io/projected/7c3c1e0f-96a1-4f73-b4b6-2a7c01044873-kube-api-access-jt7z5\") pod \"kube-auth-proxy-7db7f7c8d6-m29dt\" (UID: \"7c3c1e0f-96a1-4f73-b4b6-2a7c01044873\") " pod="openshift-ingress/kube-auth-proxy-7db7f7c8d6-m29dt" Jul 21 19:43:23.565646 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:23.565476 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c3c1e0f-96a1-4f73-b4b6-2a7c01044873-tls-certs\") pod \"kube-auth-proxy-7db7f7c8d6-m29dt\" (UID: \"7c3c1e0f-96a1-4f73-b4b6-2a7c01044873\") " pod="openshift-ingress/kube-auth-proxy-7db7f7c8d6-m29dt" Jul 21 19:43:23.565646 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:23.565496 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c3c1e0f-96a1-4f73-b4b6-2a7c01044873-tmp\") pod \"kube-auth-proxy-7db7f7c8d6-m29dt\" (UID: \"7c3c1e0f-96a1-4f73-b4b6-2a7c01044873\") " pod="openshift-ingress/kube-auth-proxy-7db7f7c8d6-m29dt" Jul 21 19:43:23.666388 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:23.666352 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt7z5\" (UniqueName: \"kubernetes.io/projected/7c3c1e0f-96a1-4f73-b4b6-2a7c01044873-kube-api-access-jt7z5\") pod \"kube-auth-proxy-7db7f7c8d6-m29dt\" (UID: \"7c3c1e0f-96a1-4f73-b4b6-2a7c01044873\") " pod="openshift-ingress/kube-auth-proxy-7db7f7c8d6-m29dt" Jul 21 19:43:23.666571 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:23.666404 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c3c1e0f-96a1-4f73-b4b6-2a7c01044873-tls-certs\") pod \"kube-auth-proxy-7db7f7c8d6-m29dt\" (UID: \"7c3c1e0f-96a1-4f73-b4b6-2a7c01044873\") " pod="openshift-ingress/kube-auth-proxy-7db7f7c8d6-m29dt" Jul 21 19:43:23.666571 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:23.666431 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c3c1e0f-96a1-4f73-b4b6-2a7c01044873-tmp\") pod \"kube-auth-proxy-7db7f7c8d6-m29dt\" (UID: \"7c3c1e0f-96a1-4f73-b4b6-2a7c01044873\") " pod="openshift-ingress/kube-auth-proxy-7db7f7c8d6-m29dt" Jul 21 19:43:23.668932 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:23.668879 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c3c1e0f-96a1-4f73-b4b6-2a7c01044873-tmp\") pod \"kube-auth-proxy-7db7f7c8d6-m29dt\" (UID: \"7c3c1e0f-96a1-4f73-b4b6-2a7c01044873\") " pod="openshift-ingress/kube-auth-proxy-7db7f7c8d6-m29dt" Jul 21 19:43:23.669209 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:23.669188 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c3c1e0f-96a1-4f73-b4b6-2a7c01044873-tls-certs\") pod \"kube-auth-proxy-7db7f7c8d6-m29dt\" (UID: \"7c3c1e0f-96a1-4f73-b4b6-2a7c01044873\") " pod="openshift-ingress/kube-auth-proxy-7db7f7c8d6-m29dt" Jul 21 19:43:23.688233 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:23.688172 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt7z5\" (UniqueName: \"kubernetes.io/projected/7c3c1e0f-96a1-4f73-b4b6-2a7c01044873-kube-api-access-jt7z5\") pod \"kube-auth-proxy-7db7f7c8d6-m29dt\" (UID: \"7c3c1e0f-96a1-4f73-b4b6-2a7c01044873\") " pod="openshift-ingress/kube-auth-proxy-7db7f7c8d6-m29dt" Jul 21 19:43:23.746585 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:23.746551 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7db7f7c8d6-m29dt" Jul 21 19:43:23.905861 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:23.905822 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7db7f7c8d6-m29dt"] Jul 21 19:43:23.909247 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:43:23.909219 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c3c1e0f_96a1_4f73_b4b6_2a7c01044873.slice/crio-21e1d3e039610e76502e11a982b7afa9bcb1fc2f4da56e9143b3b0dab9fd9b47 WatchSource:0}: Error finding container 21e1d3e039610e76502e11a982b7afa9bcb1fc2f4da56e9143b3b0dab9fd9b47: Status 404 returned error can't find the container with id 21e1d3e039610e76502e11a982b7afa9bcb1fc2f4da56e9143b3b0dab9fd9b47 Jul 21 19:43:24.069954 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:24.069874 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7db7f7c8d6-m29dt" event={"ID":"7c3c1e0f-96a1-4f73-b4b6-2a7c01044873","Type":"ContainerStarted","Data":"21e1d3e039610e76502e11a982b7afa9bcb1fc2f4da56e9143b3b0dab9fd9b47"} Jul 21 19:43:27.086414 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:27.086380 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7db7f7c8d6-m29dt" event={"ID":"7c3c1e0f-96a1-4f73-b4b6-2a7c01044873","Type":"ContainerStarted","Data":"9821d4f6f500f1c31da330bbf0e5bccf6d9e8eb78c083f73abd6efe04dd5df34"} Jul 21 19:43:27.106560 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:43:27.106502 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7db7f7c8d6-m29dt" podStartSLOduration=1.541898674 podStartE2EDuration="4.106481215s" totalImagesPullingTime="2.564582541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:43:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:43:27.104973269 +0000 UTC m=+372.064985703" watchObservedRunningTime="2026-07-21 19:43:27.106481215 +0000 UTC m=+372.066493649" Jul 21 19:45:13.766459 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:13.766424 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-x8qrl"] Jul 21 19:45:13.769565 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:13.769548 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8qrl" Jul 21 19:45:13.772319 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:13.772291 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 21 19:45:13.772447 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:13.772332 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 21 19:45:13.772447 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:13.772422 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zcmqw\"" Jul 21 19:45:13.772546 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:13.772527 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 21 19:45:13.773390 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:13.773373 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 21 19:45:13.780992 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:13.780973 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-x8qrl"] Jul 21 19:45:13.825862 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:13.825837 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a1c983f4-752e-4516-bea3-32208ba90872-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-x8qrl\" (UID: \"a1c983f4-752e-4516-bea3-32208ba90872\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8qrl" Jul 21 19:45:13.825983 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:13.825881 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1c983f4-752e-4516-bea3-32208ba90872-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-x8qrl\" (UID: \"a1c983f4-752e-4516-bea3-32208ba90872\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8qrl" Jul 21 19:45:13.826028 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:13.825979 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6ns9\" (UniqueName: \"kubernetes.io/projected/a1c983f4-752e-4516-bea3-32208ba90872-kube-api-access-n6ns9\") pod \"kuadrant-console-plugin-66b5774985-x8qrl\" (UID: \"a1c983f4-752e-4516-bea3-32208ba90872\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8qrl" Jul 21 19:45:13.927390 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:13.927362 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1c983f4-752e-4516-bea3-32208ba90872-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-x8qrl\" (UID: \"a1c983f4-752e-4516-bea3-32208ba90872\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8qrl" Jul 21 19:45:13.927498 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:13.927405 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6ns9\" (UniqueName: \"kubernetes.io/projected/a1c983f4-752e-4516-bea3-32208ba90872-kube-api-access-n6ns9\") pod \"kuadrant-console-plugin-66b5774985-x8qrl\" (UID: \"a1c983f4-752e-4516-bea3-32208ba90872\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8qrl" Jul 21 19:45:13.927498 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:13.927444 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a1c983f4-752e-4516-bea3-32208ba90872-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-x8qrl\" (UID: \"a1c983f4-752e-4516-bea3-32208ba90872\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8qrl" Jul 21 19:45:13.927986 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:13.927971 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a1c983f4-752e-4516-bea3-32208ba90872-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-x8qrl\" (UID: \"a1c983f4-752e-4516-bea3-32208ba90872\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8qrl" Jul 21 19:45:13.929820 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:13.929794 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1c983f4-752e-4516-bea3-32208ba90872-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-x8qrl\" (UID: \"a1c983f4-752e-4516-bea3-32208ba90872\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8qrl" Jul 21 19:45:13.936488 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:13.936470 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6ns9\" (UniqueName: \"kubernetes.io/projected/a1c983f4-752e-4516-bea3-32208ba90872-kube-api-access-n6ns9\") pod \"kuadrant-console-plugin-66b5774985-x8qrl\" (UID: \"a1c983f4-752e-4516-bea3-32208ba90872\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8qrl" Jul 21 19:45:14.079312 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:14.079254 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8qrl" Jul 21 19:45:14.219209 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:14.219186 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-x8qrl"] Jul 21 19:45:14.221333 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:45:14.221304 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda1c983f4_752e_4516_bea3_32208ba90872.slice/crio-316a2e07a61bd563e28b2b0a1e055de0afb2042fb29677b58b03f1d697570a49 WatchSource:0}: Error finding container 316a2e07a61bd563e28b2b0a1e055de0afb2042fb29677b58b03f1d697570a49: Status 404 returned error can't find the container with id 316a2e07a61bd563e28b2b0a1e055de0afb2042fb29677b58b03f1d697570a49 Jul 21 19:45:14.546557 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:14.546526 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8qrl" event={"ID":"a1c983f4-752e-4516-bea3-32208ba90872","Type":"ContainerStarted","Data":"316a2e07a61bd563e28b2b0a1e055de0afb2042fb29677b58b03f1d697570a49"} Jul 21 19:45:38.660979 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:38.660936 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8qrl" event={"ID":"a1c983f4-752e-4516-bea3-32208ba90872","Type":"ContainerStarted","Data":"d54bf2de019ace1c301193d34887f3f52f8455cc374f5cbf3760dea17dfdc110"} Jul 21 19:45:38.683042 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:38.682994 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8qrl" podStartSLOduration=2.050140174 podStartE2EDuration="25.682979544s" totalImagesPullingTime="23.63283937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:45:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:45:38.681405901 +0000 UTC m=+503.641418337" watchObservedRunningTime="2026-07-21 19:45:38.682979544 +0000 UTC m=+503.642991977" Jul 21 19:45:56.015020 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:56.014982 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kl5j9"] Jul 21 19:45:56.051433 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:56.051405 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kl5j9"] Jul 21 19:45:56.051566 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:56.051494 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-kl5j9" Jul 21 19:45:56.054228 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:56.054201 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 21 19:45:56.076528 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:56.076499 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6w5v\" (UniqueName: \"kubernetes.io/projected/84fb9db1-a06e-4dbd-b23b-6a33b1fd9518-kube-api-access-c6w5v\") pod \"limitador-limitador-64c94fd64f-kl5j9\" (UID: \"84fb9db1-a06e-4dbd-b23b-6a33b1fd9518\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-kl5j9" Jul 21 19:45:56.076674 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:56.076569 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/84fb9db1-a06e-4dbd-b23b-6a33b1fd9518-config-file\") pod \"limitador-limitador-64c94fd64f-kl5j9\" (UID: \"84fb9db1-a06e-4dbd-b23b-6a33b1fd9518\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-kl5j9" Jul 21 19:45:56.109836 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:56.109804 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kl5j9"] Jul 21 19:45:56.177364 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:56.177330 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6w5v\" (UniqueName: \"kubernetes.io/projected/84fb9db1-a06e-4dbd-b23b-6a33b1fd9518-kube-api-access-c6w5v\") pod \"limitador-limitador-64c94fd64f-kl5j9\" (UID: \"84fb9db1-a06e-4dbd-b23b-6a33b1fd9518\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-kl5j9" Jul 21 19:45:56.177501 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:56.177421 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/84fb9db1-a06e-4dbd-b23b-6a33b1fd9518-config-file\") pod \"limitador-limitador-64c94fd64f-kl5j9\" (UID: \"84fb9db1-a06e-4dbd-b23b-6a33b1fd9518\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-kl5j9" Jul 21 19:45:56.178085 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:56.178067 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/84fb9db1-a06e-4dbd-b23b-6a33b1fd9518-config-file\") pod \"limitador-limitador-64c94fd64f-kl5j9\" (UID: \"84fb9db1-a06e-4dbd-b23b-6a33b1fd9518\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-kl5j9" Jul 21 19:45:56.186409 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:56.186386 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6w5v\" (UniqueName: \"kubernetes.io/projected/84fb9db1-a06e-4dbd-b23b-6a33b1fd9518-kube-api-access-c6w5v\") pod \"limitador-limitador-64c94fd64f-kl5j9\" (UID: \"84fb9db1-a06e-4dbd-b23b-6a33b1fd9518\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-kl5j9" Jul 21 19:45:56.361592 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:56.361517 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-kl5j9" Jul 21 19:45:56.490446 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:56.490423 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kl5j9"] Jul 21 19:45:56.747017 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:56.746981 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-kl5j9" event={"ID":"84fb9db1-a06e-4dbd-b23b-6a33b1fd9518","Type":"ContainerStarted","Data":"1474e4f61ed8c5c5a1ef52fbcf9321326125145620322e807cf249d076d7cc87"} Jul 21 19:45:56.824991 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:56.824962 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-vnff6"] Jul 21 19:45:56.827499 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:56.827482 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vnff6" Jul 21 19:45:56.835481 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:56.835462 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-vhxmq\"" Jul 21 19:45:56.838433 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:56.838415 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-vnff6"] Jul 21 19:45:56.883737 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:56.883714 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knm4j\" (UniqueName: \"kubernetes.io/projected/8627f111-ba8b-4a6a-9c87-c01e9fe81c12-kube-api-access-knm4j\") pod \"authorino-58cd955675-vnff6\" (UID: \"8627f111-ba8b-4a6a-9c87-c01e9fe81c12\") " pod="kuadrant-system/authorino-58cd955675-vnff6" Jul 21 19:45:56.985123 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:56.985096 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knm4j\" (UniqueName: \"kubernetes.io/projected/8627f111-ba8b-4a6a-9c87-c01e9fe81c12-kube-api-access-knm4j\") pod \"authorino-58cd955675-vnff6\" (UID: \"8627f111-ba8b-4a6a-9c87-c01e9fe81c12\") " pod="kuadrant-system/authorino-58cd955675-vnff6" Jul 21 19:45:57.007276 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:57.007214 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knm4j\" (UniqueName: \"kubernetes.io/projected/8627f111-ba8b-4a6a-9c87-c01e9fe81c12-kube-api-access-knm4j\") pod \"authorino-58cd955675-vnff6\" (UID: \"8627f111-ba8b-4a6a-9c87-c01e9fe81c12\") " pod="kuadrant-system/authorino-58cd955675-vnff6" Jul 21 19:45:57.137524 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:57.137451 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vnff6" Jul 21 19:45:57.302733 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:57.302559 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-vnff6"] Jul 21 19:45:57.310295 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:45:57.310260 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8627f111_ba8b_4a6a_9c87_c01e9fe81c12.slice/crio-cb4cc81041b79933db9dfb7181439bdc79491deb7c87dbe7f2fbd6f01115f6c1 WatchSource:0}: Error finding container cb4cc81041b79933db9dfb7181439bdc79491deb7c87dbe7f2fbd6f01115f6c1: Status 404 returned error can't find the container with id cb4cc81041b79933db9dfb7181439bdc79491deb7c87dbe7f2fbd6f01115f6c1 Jul 21 19:45:57.753732 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:45:57.753689 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vnff6" event={"ID":"8627f111-ba8b-4a6a-9c87-c01e9fe81c12","Type":"ContainerStarted","Data":"cb4cc81041b79933db9dfb7181439bdc79491deb7c87dbe7f2fbd6f01115f6c1"} Jul 21 19:46:01.513438 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:01.513400 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-vnff6"] Jul 21 19:46:01.774950 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:01.774843 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-kl5j9" event={"ID":"84fb9db1-a06e-4dbd-b23b-6a33b1fd9518","Type":"ContainerStarted","Data":"723e7cf11df6a28d58e4863b0a1630ef58002488357674ead19d24cf3289615b"} Jul 21 19:46:01.775124 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:01.774953 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-kl5j9" Jul 21 19:46:01.776336 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:01.776312 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vnff6" event={"ID":"8627f111-ba8b-4a6a-9c87-c01e9fe81c12","Type":"ContainerStarted","Data":"d720ccea4385fc1115ad0a8708efc2214e45434c0046862f6e88e0a2b8a7620e"} Jul 21 19:46:01.794526 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:01.794483 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-kl5j9" podStartSLOduration=2.168996681 podStartE2EDuration="6.79447046s" totalImagesPullingTime="4.625473779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:45:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:46:01.792818663 +0000 UTC m=+526.752831096" watchObservedRunningTime="2026-07-21 19:46:01.79447046 +0000 UTC m=+526.754482893" Jul 21 19:46:01.810464 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:01.810426 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-vnff6" podStartSLOduration=1.987500132 podStartE2EDuration="5.810413028s" totalImagesPullingTime="3.822912896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:45:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:46:01.809039854 +0000 UTC m=+526.769052266" watchObservedRunningTime="2026-07-21 19:46:01.810413028 +0000 UTC m=+526.770425481" Jul 21 19:46:02.780525 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:02.780484 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-vnff6" podUID="8627f111-ba8b-4a6a-9c87-c01e9fe81c12" containerName="authorino" containerID="cri-o://d720ccea4385fc1115ad0a8708efc2214e45434c0046862f6e88e0a2b8a7620e" gracePeriod=30 Jul 21 19:46:03.017623 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:03.017600 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vnff6" Jul 21 19:46:03.036456 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:03.036384 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knm4j\" (UniqueName: \"kubernetes.io/projected/8627f111-ba8b-4a6a-9c87-c01e9fe81c12-kube-api-access-knm4j\") pod \"8627f111-ba8b-4a6a-9c87-c01e9fe81c12\" (UID: \"8627f111-ba8b-4a6a-9c87-c01e9fe81c12\") " Jul 21 19:46:03.038754 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:03.038725 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8627f111-ba8b-4a6a-9c87-c01e9fe81c12-kube-api-access-knm4j" (OuterVolumeSpecName: "kube-api-access-knm4j") pod "8627f111-ba8b-4a6a-9c87-c01e9fe81c12" (UID: "8627f111-ba8b-4a6a-9c87-c01e9fe81c12"). InnerVolumeSpecName "kube-api-access-knm4j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 19:46:03.137003 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:03.136977 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knm4j\" (UniqueName: \"kubernetes.io/projected/8627f111-ba8b-4a6a-9c87-c01e9fe81c12-kube-api-access-knm4j\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 19:46:03.785707 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:03.785669 2581 generic.go:356] "Generic (PLEG): container finished" podID="8627f111-ba8b-4a6a-9c87-c01e9fe81c12" containerID="d720ccea4385fc1115ad0a8708efc2214e45434c0046862f6e88e0a2b8a7620e" exitCode=0 Jul 21 19:46:03.785707 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:03.785710 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vnff6" Jul 21 19:46:03.786198 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:03.785749 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vnff6" event={"ID":"8627f111-ba8b-4a6a-9c87-c01e9fe81c12","Type":"ContainerDied","Data":"d720ccea4385fc1115ad0a8708efc2214e45434c0046862f6e88e0a2b8a7620e"} Jul 21 19:46:03.786198 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:03.785790 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vnff6" event={"ID":"8627f111-ba8b-4a6a-9c87-c01e9fe81c12","Type":"ContainerDied","Data":"cb4cc81041b79933db9dfb7181439bdc79491deb7c87dbe7f2fbd6f01115f6c1"} Jul 21 19:46:03.786198 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:03.785809 2581 scope.go:117] "RemoveContainer" containerID="d720ccea4385fc1115ad0a8708efc2214e45434c0046862f6e88e0a2b8a7620e" Jul 21 19:46:03.793994 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:03.793978 2581 scope.go:117] "RemoveContainer" containerID="d720ccea4385fc1115ad0a8708efc2214e45434c0046862f6e88e0a2b8a7620e" Jul 21 19:46:03.794267 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:46:03.794247 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d720ccea4385fc1115ad0a8708efc2214e45434c0046862f6e88e0a2b8a7620e\": container with ID starting with d720ccea4385fc1115ad0a8708efc2214e45434c0046862f6e88e0a2b8a7620e not found: ID does not exist" containerID="d720ccea4385fc1115ad0a8708efc2214e45434c0046862f6e88e0a2b8a7620e" Jul 21 19:46:03.794325 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:03.794275 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d720ccea4385fc1115ad0a8708efc2214e45434c0046862f6e88e0a2b8a7620e"} err="failed to get container status \"d720ccea4385fc1115ad0a8708efc2214e45434c0046862f6e88e0a2b8a7620e\": rpc error: code = NotFound desc = could not find container \"d720ccea4385fc1115ad0a8708efc2214e45434c0046862f6e88e0a2b8a7620e\": container with ID starting with d720ccea4385fc1115ad0a8708efc2214e45434c0046862f6e88e0a2b8a7620e not found: ID does not exist" Jul 21 19:46:03.806298 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:03.806274 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-vnff6"] Jul 21 19:46:03.815819 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:03.815797 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-vnff6"] Jul 21 19:46:05.534388 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:05.534358 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8627f111-ba8b-4a6a-9c87-c01e9fe81c12" path="/var/lib/kubelet/pods/8627f111-ba8b-4a6a-9c87-c01e9fe81c12/volumes" Jul 21 19:46:11.070748 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:11.070669 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kl5j9"] Jul 21 19:46:11.071241 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:11.070925 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-kl5j9" podUID="84fb9db1-a06e-4dbd-b23b-6a33b1fd9518" containerName="limitador" containerID="cri-o://723e7cf11df6a28d58e4863b0a1630ef58002488357674ead19d24cf3289615b" gracePeriod=30 Jul 21 19:46:11.071616 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:11.071587 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-kl5j9" Jul 21 19:46:11.618411 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:11.618389 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-kl5j9" Jul 21 19:46:11.711404 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:11.711336 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6w5v\" (UniqueName: \"kubernetes.io/projected/84fb9db1-a06e-4dbd-b23b-6a33b1fd9518-kube-api-access-c6w5v\") pod \"84fb9db1-a06e-4dbd-b23b-6a33b1fd9518\" (UID: \"84fb9db1-a06e-4dbd-b23b-6a33b1fd9518\") " Jul 21 19:46:11.711404 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:11.711400 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/84fb9db1-a06e-4dbd-b23b-6a33b1fd9518-config-file\") pod \"84fb9db1-a06e-4dbd-b23b-6a33b1fd9518\" (UID: \"84fb9db1-a06e-4dbd-b23b-6a33b1fd9518\") " Jul 21 19:46:11.711772 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:11.711747 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84fb9db1-a06e-4dbd-b23b-6a33b1fd9518-config-file" (OuterVolumeSpecName: "config-file") pod "84fb9db1-a06e-4dbd-b23b-6a33b1fd9518" (UID: "84fb9db1-a06e-4dbd-b23b-6a33b1fd9518"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 19:46:11.713321 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:11.713296 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84fb9db1-a06e-4dbd-b23b-6a33b1fd9518-kube-api-access-c6w5v" (OuterVolumeSpecName: "kube-api-access-c6w5v") pod "84fb9db1-a06e-4dbd-b23b-6a33b1fd9518" (UID: "84fb9db1-a06e-4dbd-b23b-6a33b1fd9518"). InnerVolumeSpecName "kube-api-access-c6w5v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 19:46:11.812232 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:11.812205 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6w5v\" (UniqueName: \"kubernetes.io/projected/84fb9db1-a06e-4dbd-b23b-6a33b1fd9518-kube-api-access-c6w5v\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 19:46:11.812232 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:11.812229 2581 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/84fb9db1-a06e-4dbd-b23b-6a33b1fd9518-config-file\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 19:46:11.825264 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:11.825237 2581 generic.go:356] "Generic (PLEG): container finished" podID="84fb9db1-a06e-4dbd-b23b-6a33b1fd9518" containerID="723e7cf11df6a28d58e4863b0a1630ef58002488357674ead19d24cf3289615b" exitCode=0 Jul 21 19:46:11.825378 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:11.825278 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-kl5j9" event={"ID":"84fb9db1-a06e-4dbd-b23b-6a33b1fd9518","Type":"ContainerDied","Data":"723e7cf11df6a28d58e4863b0a1630ef58002488357674ead19d24cf3289615b"} Jul 21 19:46:11.825378 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:11.825287 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-kl5j9" Jul 21 19:46:11.825378 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:11.825318 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-kl5j9" event={"ID":"84fb9db1-a06e-4dbd-b23b-6a33b1fd9518","Type":"ContainerDied","Data":"1474e4f61ed8c5c5a1ef52fbcf9321326125145620322e807cf249d076d7cc87"} Jul 21 19:46:11.825378 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:11.825341 2581 scope.go:117] "RemoveContainer" containerID="723e7cf11df6a28d58e4863b0a1630ef58002488357674ead19d24cf3289615b" Jul 21 19:46:11.833281 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:11.833266 2581 scope.go:117] "RemoveContainer" containerID="723e7cf11df6a28d58e4863b0a1630ef58002488357674ead19d24cf3289615b" Jul 21 19:46:11.833523 ip-10-0-137-5 kubenswrapper[2581]: E0721 19:46:11.833501 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"723e7cf11df6a28d58e4863b0a1630ef58002488357674ead19d24cf3289615b\": container with ID starting with 723e7cf11df6a28d58e4863b0a1630ef58002488357674ead19d24cf3289615b not found: ID does not exist" containerID="723e7cf11df6a28d58e4863b0a1630ef58002488357674ead19d24cf3289615b" Jul 21 19:46:11.833567 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:11.833541 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"723e7cf11df6a28d58e4863b0a1630ef58002488357674ead19d24cf3289615b"} err="failed to get container status \"723e7cf11df6a28d58e4863b0a1630ef58002488357674ead19d24cf3289615b\": rpc error: code = NotFound desc = could not find container \"723e7cf11df6a28d58e4863b0a1630ef58002488357674ead19d24cf3289615b\": container with ID starting with 723e7cf11df6a28d58e4863b0a1630ef58002488357674ead19d24cf3289615b not found: ID does not exist" Jul 21 19:46:11.859064 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:11.859039 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kl5j9"] Jul 21 19:46:11.866789 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:11.866769 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kl5j9"] Jul 21 19:46:12.677858 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:12.677828 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-9pwp8"] Jul 21 19:46:12.678238 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:12.678193 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8627f111-ba8b-4a6a-9c87-c01e9fe81c12" containerName="authorino" Jul 21 19:46:12.678238 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:12.678205 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8627f111-ba8b-4a6a-9c87-c01e9fe81c12" containerName="authorino" Jul 21 19:46:12.678238 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:12.678217 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84fb9db1-a06e-4dbd-b23b-6a33b1fd9518" containerName="limitador" Jul 21 19:46:12.678238 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:12.678222 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="84fb9db1-a06e-4dbd-b23b-6a33b1fd9518" containerName="limitador" Jul 21 19:46:12.678368 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:12.678270 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="84fb9db1-a06e-4dbd-b23b-6a33b1fd9518" containerName="limitador" Jul 21 19:46:12.678368 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:12.678278 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8627f111-ba8b-4a6a-9c87-c01e9fe81c12" containerName="authorino" Jul 21 19:46:12.682111 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:12.682094 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9pwp8" Jul 21 19:46:12.685227 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:12.685194 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 21 19:46:12.685351 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:12.685228 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 21 19:46:12.685351 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:12.685228 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 21 19:46:12.686495 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:12.686468 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-629zp\"" Jul 21 19:46:12.691776 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:12.691753 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-9pwp8"] Jul 21 19:46:12.718545 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:12.718519 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/32625a43-85a6-4632-a6ee-7e8a8174007c-data\") pod \"postgres-69fb4594cf-9pwp8\" (UID: \"32625a43-85a6-4632-a6ee-7e8a8174007c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9pwp8" Jul 21 19:46:12.718650 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:12.718592 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8q24\" (UniqueName: \"kubernetes.io/projected/32625a43-85a6-4632-a6ee-7e8a8174007c-kube-api-access-k8q24\") pod \"postgres-69fb4594cf-9pwp8\" (UID: \"32625a43-85a6-4632-a6ee-7e8a8174007c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9pwp8" Jul 21 19:46:12.819782 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:12.819758 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8q24\" (UniqueName: \"kubernetes.io/projected/32625a43-85a6-4632-a6ee-7e8a8174007c-kube-api-access-k8q24\") pod \"postgres-69fb4594cf-9pwp8\" (UID: \"32625a43-85a6-4632-a6ee-7e8a8174007c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9pwp8" Jul 21 19:46:12.819875 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:12.819810 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/32625a43-85a6-4632-a6ee-7e8a8174007c-data\") pod \"postgres-69fb4594cf-9pwp8\" (UID: \"32625a43-85a6-4632-a6ee-7e8a8174007c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9pwp8" Jul 21 19:46:12.820157 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:12.820141 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/32625a43-85a6-4632-a6ee-7e8a8174007c-data\") pod \"postgres-69fb4594cf-9pwp8\" (UID: \"32625a43-85a6-4632-a6ee-7e8a8174007c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9pwp8" Jul 21 19:46:12.830513 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:12.830490 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8q24\" (UniqueName: \"kubernetes.io/projected/32625a43-85a6-4632-a6ee-7e8a8174007c-kube-api-access-k8q24\") pod \"postgres-69fb4594cf-9pwp8\" (UID: \"32625a43-85a6-4632-a6ee-7e8a8174007c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9pwp8" Jul 21 19:46:12.993767 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:12.993740 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9pwp8" Jul 21 19:46:13.118130 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:13.118103 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-9pwp8"] Jul 21 19:46:13.120608 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:46:13.120572 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32625a43_85a6_4632_a6ee_7e8a8174007c.slice/crio-19b4fc453a724aed0e9dfddcb300f503826fba902b65fc24f4f9fe088ad5c9a2 WatchSource:0}: Error finding container 19b4fc453a724aed0e9dfddcb300f503826fba902b65fc24f4f9fe088ad5c9a2: Status 404 returned error can't find the container with id 19b4fc453a724aed0e9dfddcb300f503826fba902b65fc24f4f9fe088ad5c9a2 Jul 21 19:46:13.533577 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:13.533545 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84fb9db1-a06e-4dbd-b23b-6a33b1fd9518" path="/var/lib/kubelet/pods/84fb9db1-a06e-4dbd-b23b-6a33b1fd9518/volumes" Jul 21 19:46:13.839135 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:13.839048 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9pwp8" event={"ID":"32625a43-85a6-4632-a6ee-7e8a8174007c","Type":"ContainerStarted","Data":"19b4fc453a724aed0e9dfddcb300f503826fba902b65fc24f4f9fe088ad5c9a2"} Jul 21 19:46:18.947081 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:18.947060 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 21 19:46:19.868476 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:19.868433 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9pwp8" event={"ID":"32625a43-85a6-4632-a6ee-7e8a8174007c","Type":"ContainerStarted","Data":"fbbdbe44d6ef0e37e6464ad883b14b409407cc8f7e00da780b3e9ede3e565dc3"} Jul 21 19:46:19.868631 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:19.868557 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9pwp8" Jul 21 19:46:19.887994 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:19.887935 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9pwp8" podStartSLOduration=2.066077408 podStartE2EDuration="7.887916342s" totalImagesPullingTime="5.821838934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:46:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:46:19.886743273 +0000 UTC m=+544.846755706" watchObservedRunningTime="2026-07-21 19:46:19.887916342 +0000 UTC m=+544.847928776" Jul 21 19:46:25.901582 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:25.901556 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9pwp8" Jul 21 19:46:33.871647 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:33.871613 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6dcdddffd4-2gvcc"] Jul 21 19:46:34.011150 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:34.011120 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6dcdddffd4-2gvcc"] Jul 21 19:46:34.011296 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:34.011230 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dcdddffd4-2gvcc" Jul 21 19:46:34.016641 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:34.016556 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 21 19:46:34.016641 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:34.016556 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rxdzz\"" Jul 21 19:46:34.016844 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:34.016592 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 21 19:46:34.104189 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:34.104161 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/552643c8-bf2d-422f-96c5-4fa06a871356-webhook-cert\") pod \"maas-controller-6dcdddffd4-2gvcc\" (UID: \"552643c8-bf2d-422f-96c5-4fa06a871356\") " pod="opendatahub/maas-controller-6dcdddffd4-2gvcc" Jul 21 19:46:34.104315 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:34.104216 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gtvs\" (UniqueName: \"kubernetes.io/projected/552643c8-bf2d-422f-96c5-4fa06a871356-kube-api-access-8gtvs\") pod \"maas-controller-6dcdddffd4-2gvcc\" (UID: \"552643c8-bf2d-422f-96c5-4fa06a871356\") " pod="opendatahub/maas-controller-6dcdddffd4-2gvcc" Jul 21 19:46:34.205042 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:34.204964 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gtvs\" (UniqueName: \"kubernetes.io/projected/552643c8-bf2d-422f-96c5-4fa06a871356-kube-api-access-8gtvs\") pod \"maas-controller-6dcdddffd4-2gvcc\" (UID: \"552643c8-bf2d-422f-96c5-4fa06a871356\") " pod="opendatahub/maas-controller-6dcdddffd4-2gvcc" Jul 21 19:46:34.205165 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:34.205053 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/552643c8-bf2d-422f-96c5-4fa06a871356-webhook-cert\") pod \"maas-controller-6dcdddffd4-2gvcc\" (UID: \"552643c8-bf2d-422f-96c5-4fa06a871356\") " pod="opendatahub/maas-controller-6dcdddffd4-2gvcc" Jul 21 19:46:34.207501 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:34.207480 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/552643c8-bf2d-422f-96c5-4fa06a871356-webhook-cert\") pod \"maas-controller-6dcdddffd4-2gvcc\" (UID: \"552643c8-bf2d-422f-96c5-4fa06a871356\") " pod="opendatahub/maas-controller-6dcdddffd4-2gvcc" Jul 21 19:46:34.214850 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:34.214830 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gtvs\" (UniqueName: \"kubernetes.io/projected/552643c8-bf2d-422f-96c5-4fa06a871356-kube-api-access-8gtvs\") pod \"maas-controller-6dcdddffd4-2gvcc\" (UID: \"552643c8-bf2d-422f-96c5-4fa06a871356\") " pod="opendatahub/maas-controller-6dcdddffd4-2gvcc" Jul 21 19:46:34.321020 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:34.320992 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dcdddffd4-2gvcc" Jul 21 19:46:34.445776 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:34.445752 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6dcdddffd4-2gvcc"] Jul 21 19:46:34.448424 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:46:34.448395 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod552643c8_bf2d_422f_96c5_4fa06a871356.slice/crio-e1db996af593c3cc05b8f9f95fcf9f3469684490e5ce9e4e2c21b9a3d8dfd3bd WatchSource:0}: Error finding container e1db996af593c3cc05b8f9f95fcf9f3469684490e5ce9e4e2c21b9a3d8dfd3bd: Status 404 returned error can't find the container with id e1db996af593c3cc05b8f9f95fcf9f3469684490e5ce9e4e2c21b9a3d8dfd3bd Jul 21 19:46:34.936429 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:34.936395 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dcdddffd4-2gvcc" event={"ID":"552643c8-bf2d-422f-96c5-4fa06a871356","Type":"ContainerStarted","Data":"e1db996af593c3cc05b8f9f95fcf9f3469684490e5ce9e4e2c21b9a3d8dfd3bd"} Jul 21 19:46:36.949034 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:36.948939 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dcdddffd4-2gvcc" event={"ID":"552643c8-bf2d-422f-96c5-4fa06a871356","Type":"ContainerStarted","Data":"655dab3cb93d2f5773b6a9f56c3bfd1b16147de072c40dec90a6628df59c740c"} Jul 21 19:46:36.949034 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:36.949014 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6dcdddffd4-2gvcc" Jul 21 19:46:36.971528 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:36.971481 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6dcdddffd4-2gvcc" podStartSLOduration=1.7818928870000001 podStartE2EDuration="3.971467186s" totalImagesPullingTime="2.189574299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:46:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:46:36.97063816 +0000 UTC m=+561.930650596" watchObservedRunningTime="2026-07-21 19:46:36.971467186 +0000 UTC m=+561.931479681" Jul 21 19:46:47.956882 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:46:47.956845 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6dcdddffd4-2gvcc" Jul 21 19:47:09.792746 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:09.792709 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-84sqw"] Jul 21 19:47:09.795800 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:09.795776 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-84sqw" Jul 21 19:47:09.798464 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:09.798443 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 21 19:47:09.812129 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:09.812104 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-84sqw"] Jul 21 19:47:09.865600 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:09.865573 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-sw49t"] Jul 21 19:47:09.868071 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:09.868053 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-sw49t" Jul 21 19:47:09.871394 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:09.871373 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-td7q4\"" Jul 21 19:47:09.881215 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:09.881196 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-sw49t"] Jul 21 19:47:09.902856 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:09.902822 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xprw2\" (UniqueName: \"kubernetes.io/projected/d1d874d7-1da8-432c-9b9b-c1e32e35509e-kube-api-access-xprw2\") pod \"payload-processing-5bf47cd988-84sqw\" (UID: \"d1d874d7-1da8-432c-9b9b-c1e32e35509e\") " pod="openshift-ingress/payload-processing-5bf47cd988-84sqw" Jul 21 19:47:09.903009 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:09.902965 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1d874d7-1da8-432c-9b9b-c1e32e35509e-plugins-config-volume\") pod \"payload-processing-5bf47cd988-84sqw\" (UID: \"d1d874d7-1da8-432c-9b9b-c1e32e35509e\") " pod="openshift-ingress/payload-processing-5bf47cd988-84sqw" Jul 21 19:47:10.003644 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:10.003614 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1d874d7-1da8-432c-9b9b-c1e32e35509e-plugins-config-volume\") pod \"payload-processing-5bf47cd988-84sqw\" (UID: \"d1d874d7-1da8-432c-9b9b-c1e32e35509e\") " pod="openshift-ingress/payload-processing-5bf47cd988-84sqw" Jul 21 19:47:10.003818 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:10.003655 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g8tr\" (UniqueName: \"kubernetes.io/projected/4667253c-46b9-4dc7-a4e0-3ce04a17910e-kube-api-access-2g8tr\") pod \"payload-pre-processing-7677b774bb-sw49t\" (UID: \"4667253c-46b9-4dc7-a4e0-3ce04a17910e\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-sw49t" Jul 21 19:47:10.003818 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:10.003694 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xprw2\" (UniqueName: \"kubernetes.io/projected/d1d874d7-1da8-432c-9b9b-c1e32e35509e-kube-api-access-xprw2\") pod \"payload-processing-5bf47cd988-84sqw\" (UID: \"d1d874d7-1da8-432c-9b9b-c1e32e35509e\") " pod="openshift-ingress/payload-processing-5bf47cd988-84sqw" Jul 21 19:47:10.003818 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:10.003713 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4667253c-46b9-4dc7-a4e0-3ce04a17910e-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-sw49t\" (UID: \"4667253c-46b9-4dc7-a4e0-3ce04a17910e\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-sw49t" Jul 21 19:47:10.004474 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:10.004453 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1d874d7-1da8-432c-9b9b-c1e32e35509e-plugins-config-volume\") pod \"payload-processing-5bf47cd988-84sqw\" (UID: \"d1d874d7-1da8-432c-9b9b-c1e32e35509e\") " pod="openshift-ingress/payload-processing-5bf47cd988-84sqw" Jul 21 19:47:10.012574 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:10.012551 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xprw2\" (UniqueName: \"kubernetes.io/projected/d1d874d7-1da8-432c-9b9b-c1e32e35509e-kube-api-access-xprw2\") pod \"payload-processing-5bf47cd988-84sqw\" (UID: \"d1d874d7-1da8-432c-9b9b-c1e32e35509e\") " pod="openshift-ingress/payload-processing-5bf47cd988-84sqw" Jul 21 19:47:10.105139 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:10.105058 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2g8tr\" (UniqueName: \"kubernetes.io/projected/4667253c-46b9-4dc7-a4e0-3ce04a17910e-kube-api-access-2g8tr\") pod \"payload-pre-processing-7677b774bb-sw49t\" (UID: \"4667253c-46b9-4dc7-a4e0-3ce04a17910e\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-sw49t" Jul 21 19:47:10.105139 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:10.105113 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4667253c-46b9-4dc7-a4e0-3ce04a17910e-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-sw49t\" (UID: \"4667253c-46b9-4dc7-a4e0-3ce04a17910e\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-sw49t" Jul 21 19:47:10.105388 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:10.105366 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-84sqw" Jul 21 19:47:10.105863 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:10.105847 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4667253c-46b9-4dc7-a4e0-3ce04a17910e-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-sw49t\" (UID: \"4667253c-46b9-4dc7-a4e0-3ce04a17910e\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-sw49t" Jul 21 19:47:10.118727 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:10.118705 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g8tr\" (UniqueName: \"kubernetes.io/projected/4667253c-46b9-4dc7-a4e0-3ce04a17910e-kube-api-access-2g8tr\") pod \"payload-pre-processing-7677b774bb-sw49t\" (UID: \"4667253c-46b9-4dc7-a4e0-3ce04a17910e\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-sw49t" Jul 21 19:47:10.178152 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:10.178124 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-sw49t" Jul 21 19:47:10.251254 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:10.251226 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-84sqw"] Jul 21 19:47:10.252912 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:47:10.252866 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1d874d7_1da8_432c_9b9b_c1e32e35509e.slice/crio-a196ef7b1cd6d5c64f22e2a81d56765b4b3fb0f26f437857307127655d0a923d WatchSource:0}: Error finding container a196ef7b1cd6d5c64f22e2a81d56765b4b3fb0f26f437857307127655d0a923d: Status 404 returned error can't find the container with id a196ef7b1cd6d5c64f22e2a81d56765b4b3fb0f26f437857307127655d0a923d Jul 21 19:47:10.320117 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:10.320092 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-sw49t"] Jul 21 19:47:10.322537 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:47:10.322510 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4667253c_46b9_4dc7_a4e0_3ce04a17910e.slice/crio-2d25f08e0a9f9fbb8e14807e186b7b0e3a5b29fc3ff56d00bbd1021d01b7f457 WatchSource:0}: Error finding container 2d25f08e0a9f9fbb8e14807e186b7b0e3a5b29fc3ff56d00bbd1021d01b7f457: Status 404 returned error can't find the container with id 2d25f08e0a9f9fbb8e14807e186b7b0e3a5b29fc3ff56d00bbd1021d01b7f457 Jul 21 19:47:11.134567 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:11.134479 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-sw49t" event={"ID":"4667253c-46b9-4dc7-a4e0-3ce04a17910e","Type":"ContainerStarted","Data":"2d25f08e0a9f9fbb8e14807e186b7b0e3a5b29fc3ff56d00bbd1021d01b7f457"} Jul 21 19:47:11.136593 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:11.136560 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-84sqw" event={"ID":"d1d874d7-1da8-432c-9b9b-c1e32e35509e","Type":"ContainerStarted","Data":"a196ef7b1cd6d5c64f22e2a81d56765b4b3fb0f26f437857307127655d0a923d"} Jul 21 19:47:13.147712 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:13.147628 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-84sqw" event={"ID":"d1d874d7-1da8-432c-9b9b-c1e32e35509e","Type":"ContainerStarted","Data":"cc3671e8a3055b9b39a2fcee352c3a811485caf9fec63f6da8a51b104cee457b"} Jul 21 19:47:13.148142 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:13.147723 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-84sqw" Jul 21 19:47:13.149172 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:13.149144 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-sw49t" event={"ID":"4667253c-46b9-4dc7-a4e0-3ce04a17910e","Type":"ContainerStarted","Data":"925ac43a92bb871e386080d6b2d6d11da624758d39f2d76f9379c208c632df5d"} Jul 21 19:47:13.149306 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:13.149281 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-sw49t" Jul 21 19:47:13.170032 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:13.169978 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-84sqw" podStartSLOduration=1.687780225 podStartE2EDuration="4.169961455s" totalImagesPullingTime="2.48218123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:47:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:47:13.167764064 +0000 UTC m=+598.127776501" watchObservedRunningTime="2026-07-21 19:47:13.169961455 +0000 UTC m=+598.129973891" Jul 21 19:47:13.184609 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:13.184567 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-sw49t" podStartSLOduration=1.7676137779999999 podStartE2EDuration="4.184554539s" totalImagesPullingTime="2.416940761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:47:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:47:13.183821847 +0000 UTC m=+598.143834282" watchObservedRunningTime="2026-07-21 19:47:13.184554539 +0000 UTC m=+598.144566973" Jul 21 19:47:24.155640 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:24.155614 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-sw49t" Jul 21 19:47:24.156216 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:24.155685 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-84sqw" Jul 21 19:47:25.705302 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:25.705271 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4"] Jul 21 19:47:25.708416 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:25.708392 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4" Jul 21 19:47:25.712522 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:25.712495 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 21 19:47:25.712654 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:25.712552 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 21 19:47:25.712654 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:25.712505 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wn54b\"" Jul 21 19:47:25.712783 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:25.712684 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 21 19:47:25.719389 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:25.719367 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4"] Jul 21 19:47:25.850152 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:25.850115 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b2154fa-d62a-4972-9fbd-666d149a5cab-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4\" (UID: \"4b2154fa-d62a-4972-9fbd-666d149a5cab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4" Jul 21 19:47:25.850152 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:25.850152 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b2154fa-d62a-4972-9fbd-666d149a5cab-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4\" (UID: \"4b2154fa-d62a-4972-9fbd-666d149a5cab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4" Jul 21 19:47:25.850353 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:25.850169 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b2154fa-d62a-4972-9fbd-666d149a5cab-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4\" (UID: \"4b2154fa-d62a-4972-9fbd-666d149a5cab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4" Jul 21 19:47:25.850353 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:25.850254 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhdhn\" (UniqueName: \"kubernetes.io/projected/4b2154fa-d62a-4972-9fbd-666d149a5cab-kube-api-access-fhdhn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4\" (UID: \"4b2154fa-d62a-4972-9fbd-666d149a5cab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4" Jul 21 19:47:25.850353 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:25.850298 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b2154fa-d62a-4972-9fbd-666d149a5cab-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4\" (UID: \"4b2154fa-d62a-4972-9fbd-666d149a5cab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4" Jul 21 19:47:25.850353 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:25.850316 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b2154fa-d62a-4972-9fbd-666d149a5cab-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4\" (UID: \"4b2154fa-d62a-4972-9fbd-666d149a5cab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4" Jul 21 19:47:25.951554 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:25.951517 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhdhn\" (UniqueName: \"kubernetes.io/projected/4b2154fa-d62a-4972-9fbd-666d149a5cab-kube-api-access-fhdhn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4\" (UID: \"4b2154fa-d62a-4972-9fbd-666d149a5cab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4" Jul 21 19:47:25.951720 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:25.951568 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b2154fa-d62a-4972-9fbd-666d149a5cab-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4\" (UID: \"4b2154fa-d62a-4972-9fbd-666d149a5cab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4" Jul 21 19:47:25.951720 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:25.951598 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b2154fa-d62a-4972-9fbd-666d149a5cab-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4\" (UID: \"4b2154fa-d62a-4972-9fbd-666d149a5cab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4" Jul 21 19:47:25.951720 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:25.951697 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b2154fa-d62a-4972-9fbd-666d149a5cab-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4\" (UID: \"4b2154fa-d62a-4972-9fbd-666d149a5cab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4" Jul 21 19:47:25.951878 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:25.951722 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b2154fa-d62a-4972-9fbd-666d149a5cab-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4\" (UID: \"4b2154fa-d62a-4972-9fbd-666d149a5cab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4" Jul 21 19:47:25.951878 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:25.951745 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b2154fa-d62a-4972-9fbd-666d149a5cab-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4\" (UID: \"4b2154fa-d62a-4972-9fbd-666d149a5cab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4" Jul 21 19:47:25.952021 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:25.951951 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b2154fa-d62a-4972-9fbd-666d149a5cab-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4\" (UID: \"4b2154fa-d62a-4972-9fbd-666d149a5cab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4" Jul 21 19:47:25.952103 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:25.952084 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b2154fa-d62a-4972-9fbd-666d149a5cab-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4\" (UID: \"4b2154fa-d62a-4972-9fbd-666d149a5cab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4" Jul 21 19:47:25.952159 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:25.952092 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b2154fa-d62a-4972-9fbd-666d149a5cab-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4\" (UID: \"4b2154fa-d62a-4972-9fbd-666d149a5cab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4" Jul 21 19:47:25.953800 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:25.953782 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b2154fa-d62a-4972-9fbd-666d149a5cab-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4\" (UID: \"4b2154fa-d62a-4972-9fbd-666d149a5cab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4" Jul 21 19:47:25.954087 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:25.954072 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b2154fa-d62a-4972-9fbd-666d149a5cab-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4\" (UID: \"4b2154fa-d62a-4972-9fbd-666d149a5cab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4" Jul 21 19:47:25.959772 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:25.959730 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhdhn\" (UniqueName: \"kubernetes.io/projected/4b2154fa-d62a-4972-9fbd-666d149a5cab-kube-api-access-fhdhn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4\" (UID: \"4b2154fa-d62a-4972-9fbd-666d149a5cab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4" Jul 21 19:47:26.019715 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:26.019681 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4" Jul 21 19:47:26.150261 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:26.150232 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4"] Jul 21 19:47:26.152098 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:47:26.152065 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b2154fa_d62a_4972_9fbd_666d149a5cab.slice/crio-9da5ff8283f090d85d479261d115a3a7e9576b930f9e9faa6bd5bda0a2dc319f WatchSource:0}: Error finding container 9da5ff8283f090d85d479261d115a3a7e9576b930f9e9faa6bd5bda0a2dc319f: Status 404 returned error can't find the container with id 9da5ff8283f090d85d479261d115a3a7e9576b930f9e9faa6bd5bda0a2dc319f Jul 21 19:47:26.211867 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:26.211792 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4" event={"ID":"4b2154fa-d62a-4972-9fbd-666d149a5cab","Type":"ContainerStarted","Data":"9da5ff8283f090d85d479261d115a3a7e9576b930f9e9faa6bd5bda0a2dc319f"} Jul 21 19:47:27.219190 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:27.219165 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4" event={"ID":"4b2154fa-d62a-4972-9fbd-666d149a5cab","Type":"ContainerStarted","Data":"a5fcfdd062194c8ef2bf5da8ece69607d026e187bf2b10f53020ec9102775be2"} Jul 21 19:47:27.242814 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:27.242745 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4" podStartSLOduration=1.280349411 podStartE2EDuration="2.242731992s" totalImagesPullingTime="962.382581ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:47:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:47:27.240995653 +0000 UTC m=+612.201008088" watchObservedRunningTime="2026-07-21 19:47:27.242731992 +0000 UTC m=+612.202744427" Jul 21 19:47:36.020798 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:36.020765 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4" Jul 21 19:47:36.021190 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:36.020814 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4" Jul 21 19:47:36.032977 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:36.032955 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4" Jul 21 19:47:36.278489 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:36.278410 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4" Jul 21 19:47:46.303106 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:46.303074 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vvwhv"] Jul 21 19:47:46.305491 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:46.305472 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvwhv" Jul 21 19:47:46.308907 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:46.308875 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 21 19:47:46.320518 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:46.320488 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vvwhv"] Jul 21 19:47:46.427541 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:46.427503 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c7c1507-9864-4026-bab9-e22ca5c2ee95-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vvwhv\" (UID: \"5c7c1507-9864-4026-bab9-e22ca5c2ee95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvwhv" Jul 21 19:47:46.427723 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:46.427562 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c7c1507-9864-4026-bab9-e22ca5c2ee95-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vvwhv\" (UID: \"5c7c1507-9864-4026-bab9-e22ca5c2ee95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvwhv" Jul 21 19:47:46.427723 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:46.427591 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfpcd\" (UniqueName: \"kubernetes.io/projected/5c7c1507-9864-4026-bab9-e22ca5c2ee95-kube-api-access-sfpcd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vvwhv\" (UID: \"5c7c1507-9864-4026-bab9-e22ca5c2ee95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvwhv" Jul 21 19:47:46.427723 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:46.427611 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c7c1507-9864-4026-bab9-e22ca5c2ee95-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vvwhv\" (UID: \"5c7c1507-9864-4026-bab9-e22ca5c2ee95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvwhv" Jul 21 19:47:46.427723 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:46.427638 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c7c1507-9864-4026-bab9-e22ca5c2ee95-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vvwhv\" (UID: \"5c7c1507-9864-4026-bab9-e22ca5c2ee95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvwhv" Jul 21 19:47:46.427723 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:46.427703 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c7c1507-9864-4026-bab9-e22ca5c2ee95-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vvwhv\" (UID: \"5c7c1507-9864-4026-bab9-e22ca5c2ee95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvwhv" Jul 21 19:47:46.528820 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:46.528786 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c7c1507-9864-4026-bab9-e22ca5c2ee95-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vvwhv\" (UID: \"5c7c1507-9864-4026-bab9-e22ca5c2ee95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvwhv" Jul 21 19:47:46.528820 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:46.528834 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c7c1507-9864-4026-bab9-e22ca5c2ee95-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vvwhv\" (UID: \"5c7c1507-9864-4026-bab9-e22ca5c2ee95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvwhv" Jul 21 19:47:46.529052 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:46.528868 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c7c1507-9864-4026-bab9-e22ca5c2ee95-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vvwhv\" (UID: \"5c7c1507-9864-4026-bab9-e22ca5c2ee95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvwhv" Jul 21 19:47:46.529052 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:46.528923 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c7c1507-9864-4026-bab9-e22ca5c2ee95-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vvwhv\" (UID: \"5c7c1507-9864-4026-bab9-e22ca5c2ee95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvwhv" Jul 21 19:47:46.529161 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:46.529079 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c7c1507-9864-4026-bab9-e22ca5c2ee95-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vvwhv\" (UID: \"5c7c1507-9864-4026-bab9-e22ca5c2ee95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvwhv" Jul 21 19:47:46.529161 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:46.529129 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfpcd\" (UniqueName: \"kubernetes.io/projected/5c7c1507-9864-4026-bab9-e22ca5c2ee95-kube-api-access-sfpcd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vvwhv\" (UID: \"5c7c1507-9864-4026-bab9-e22ca5c2ee95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvwhv" Jul 21 19:47:46.529282 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:46.529261 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c7c1507-9864-4026-bab9-e22ca5c2ee95-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vvwhv\" (UID: \"5c7c1507-9864-4026-bab9-e22ca5c2ee95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvwhv" Jul 21 19:47:46.529341 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:46.529319 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c7c1507-9864-4026-bab9-e22ca5c2ee95-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vvwhv\" (UID: \"5c7c1507-9864-4026-bab9-e22ca5c2ee95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvwhv" Jul 21 19:47:46.529395 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:46.529352 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c7c1507-9864-4026-bab9-e22ca5c2ee95-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vvwhv\" (UID: \"5c7c1507-9864-4026-bab9-e22ca5c2ee95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvwhv" Jul 21 19:47:46.531157 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:46.531137 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c7c1507-9864-4026-bab9-e22ca5c2ee95-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vvwhv\" (UID: \"5c7c1507-9864-4026-bab9-e22ca5c2ee95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvwhv" Jul 21 19:47:46.531426 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:46.531407 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c7c1507-9864-4026-bab9-e22ca5c2ee95-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vvwhv\" (UID: \"5c7c1507-9864-4026-bab9-e22ca5c2ee95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvwhv" Jul 21 19:47:46.537006 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:46.536986 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfpcd\" (UniqueName: \"kubernetes.io/projected/5c7c1507-9864-4026-bab9-e22ca5c2ee95-kube-api-access-sfpcd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vvwhv\" (UID: \"5c7c1507-9864-4026-bab9-e22ca5c2ee95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvwhv" Jul 21 19:47:46.619091 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:46.619025 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvwhv" Jul 21 19:47:46.746827 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:46.746799 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vvwhv"] Jul 21 19:47:46.748289 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:47:46.748264 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c7c1507_9864_4026_bab9_e22ca5c2ee95.slice/crio-2cb767e22f2da3fe615a628e1e1aa1780654b89c1ecea5de5c3d1798b8823c32 WatchSource:0}: Error finding container 2cb767e22f2da3fe615a628e1e1aa1780654b89c1ecea5de5c3d1798b8823c32: Status 404 returned error can't find the container with id 2cb767e22f2da3fe615a628e1e1aa1780654b89c1ecea5de5c3d1798b8823c32 Jul 21 19:47:46.749607 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:46.749589 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 19:47:47.318725 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:47.318688 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvwhv" event={"ID":"5c7c1507-9864-4026-bab9-e22ca5c2ee95","Type":"ContainerStarted","Data":"62e1843f4036e27adb464cc0ca102b36ff64731134ff737af53396b9a539f2e4"} Jul 21 19:47:47.319123 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:47.318745 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvwhv" event={"ID":"5c7c1507-9864-4026-bab9-e22ca5c2ee95","Type":"ContainerStarted","Data":"2cb767e22f2da3fe615a628e1e1aa1780654b89c1ecea5de5c3d1798b8823c32"} Jul 21 19:47:47.339486 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:47.339436 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvwhv" podStartSLOduration=1.145671613 podStartE2EDuration="1.339421222s" totalImagesPullingTime="193.749609ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:47:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:47:47.337565618 +0000 UTC m=+632.297578052" watchObservedRunningTime="2026-07-21 19:47:47.339421222 +0000 UTC m=+632.299433655" Jul 21 19:47:56.619944 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:56.619911 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvwhv" Jul 21 19:47:56.620404 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:56.619975 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvwhv" Jul 21 19:47:56.632356 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:56.632334 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvwhv" Jul 21 19:47:57.376485 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:47:57.376456 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvwhv" Jul 21 19:48:49.791556 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:48:49.791520 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-795ff4495d-nxbnf"] Jul 21 19:48:49.795047 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:48:49.795026 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-795ff4495d-nxbnf" Jul 21 19:48:49.798688 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:48:49.798666 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-vhxmq\"" Jul 21 19:48:49.799843 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:48:49.799828 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 21 19:48:49.806743 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:48:49.806720 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-795ff4495d-nxbnf"] Jul 21 19:48:49.966473 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:48:49.966445 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgd2b\" (UniqueName: \"kubernetes.io/projected/e03aa232-029a-4c6f-8410-d2b857463190-kube-api-access-hgd2b\") pod \"authorino-795ff4495d-nxbnf\" (UID: \"e03aa232-029a-4c6f-8410-d2b857463190\") " pod="kuadrant-system/authorino-795ff4495d-nxbnf" Jul 21 19:48:49.966613 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:48:49.966491 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e03aa232-029a-4c6f-8410-d2b857463190-tls-cert\") pod \"authorino-795ff4495d-nxbnf\" (UID: \"e03aa232-029a-4c6f-8410-d2b857463190\") " pod="kuadrant-system/authorino-795ff4495d-nxbnf" Jul 21 19:48:50.067630 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:48:50.067569 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e03aa232-029a-4c6f-8410-d2b857463190-tls-cert\") pod \"authorino-795ff4495d-nxbnf\" (UID: \"e03aa232-029a-4c6f-8410-d2b857463190\") " pod="kuadrant-system/authorino-795ff4495d-nxbnf" Jul 21 19:48:50.067749 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:48:50.067728 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgd2b\" (UniqueName: \"kubernetes.io/projected/e03aa232-029a-4c6f-8410-d2b857463190-kube-api-access-hgd2b\") pod \"authorino-795ff4495d-nxbnf\" (UID: \"e03aa232-029a-4c6f-8410-d2b857463190\") " pod="kuadrant-system/authorino-795ff4495d-nxbnf" Jul 21 19:48:50.069924 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:48:50.069882 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e03aa232-029a-4c6f-8410-d2b857463190-tls-cert\") pod \"authorino-795ff4495d-nxbnf\" (UID: \"e03aa232-029a-4c6f-8410-d2b857463190\") " pod="kuadrant-system/authorino-795ff4495d-nxbnf" Jul 21 19:48:50.078881 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:48:50.078861 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgd2b\" (UniqueName: \"kubernetes.io/projected/e03aa232-029a-4c6f-8410-d2b857463190-kube-api-access-hgd2b\") pod \"authorino-795ff4495d-nxbnf\" (UID: \"e03aa232-029a-4c6f-8410-d2b857463190\") " pod="kuadrant-system/authorino-795ff4495d-nxbnf" Jul 21 19:48:50.103801 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:48:50.103782 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-795ff4495d-nxbnf" Jul 21 19:48:50.238668 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:48:50.238644 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-795ff4495d-nxbnf"] Jul 21 19:48:50.241322 ip-10-0-137-5 kubenswrapper[2581]: W0721 19:48:50.241295 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode03aa232_029a_4c6f_8410_d2b857463190.slice/crio-75a393aec9c022db95599bf221691777f2a23bfcc52537ff4fba33a798e17180 WatchSource:0}: Error finding container 75a393aec9c022db95599bf221691777f2a23bfcc52537ff4fba33a798e17180: Status 404 returned error can't find the container with id 75a393aec9c022db95599bf221691777f2a23bfcc52537ff4fba33a798e17180 Jul 21 19:48:50.613433 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:48:50.613397 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-795ff4495d-nxbnf" event={"ID":"e03aa232-029a-4c6f-8410-d2b857463190","Type":"ContainerStarted","Data":"75a393aec9c022db95599bf221691777f2a23bfcc52537ff4fba33a798e17180"} Jul 21 19:48:51.620674 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:48:51.620640 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-795ff4495d-nxbnf" event={"ID":"e03aa232-029a-4c6f-8410-d2b857463190","Type":"ContainerStarted","Data":"5b69257b79ccdbb89d30d48b7127b3363a2ab5352a16de777bd3d6c45cf7e49c"} Jul 21 19:48:51.642797 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:48:51.642738 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-795ff4495d-nxbnf" podStartSLOduration=2.048687848 podStartE2EDuration="2.642717699s" totalImagesPullingTime="594.029851ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:48:51.640970136 +0000 UTC m=+696.600982570" watchObservedRunningTime="2026-07-21 19:48:51.642717699 +0000 UTC m=+696.602730132" Jul 21 19:49:37.649046 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:49:37.649014 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6dcdddffd4-2gvcc"] Jul 21 19:49:37.649546 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:49:37.649211 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6dcdddffd4-2gvcc" podUID="552643c8-bf2d-422f-96c5-4fa06a871356" containerName="manager" containerID="cri-o://655dab3cb93d2f5773b6a9f56c3bfd1b16147de072c40dec90a6628df59c740c" gracePeriod=30 Jul 21 19:49:37.849019 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:49:37.848972 2581 generic.go:356] "Generic (PLEG): container finished" podID="552643c8-bf2d-422f-96c5-4fa06a871356" containerID="655dab3cb93d2f5773b6a9f56c3bfd1b16147de072c40dec90a6628df59c740c" exitCode=0 Jul 21 19:49:37.849171 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:49:37.849042 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dcdddffd4-2gvcc" event={"ID":"552643c8-bf2d-422f-96c5-4fa06a871356","Type":"ContainerDied","Data":"655dab3cb93d2f5773b6a9f56c3bfd1b16147de072c40dec90a6628df59c740c"} Jul 21 19:49:37.887843 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:49:37.887822 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dcdddffd4-2gvcc" Jul 21 19:49:37.975687 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:49:37.975665 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gtvs\" (UniqueName: \"kubernetes.io/projected/552643c8-bf2d-422f-96c5-4fa06a871356-kube-api-access-8gtvs\") pod \"552643c8-bf2d-422f-96c5-4fa06a871356\" (UID: \"552643c8-bf2d-422f-96c5-4fa06a871356\") " Jul 21 19:49:37.975815 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:49:37.975753 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/552643c8-bf2d-422f-96c5-4fa06a871356-webhook-cert\") pod \"552643c8-bf2d-422f-96c5-4fa06a871356\" (UID: \"552643c8-bf2d-422f-96c5-4fa06a871356\") " Jul 21 19:49:37.977744 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:49:37.977712 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/552643c8-bf2d-422f-96c5-4fa06a871356-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "552643c8-bf2d-422f-96c5-4fa06a871356" (UID: "552643c8-bf2d-422f-96c5-4fa06a871356"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 19:49:37.977839 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:49:37.977749 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/552643c8-bf2d-422f-96c5-4fa06a871356-kube-api-access-8gtvs" (OuterVolumeSpecName: "kube-api-access-8gtvs") pod "552643c8-bf2d-422f-96c5-4fa06a871356" (UID: "552643c8-bf2d-422f-96c5-4fa06a871356"). InnerVolumeSpecName "kube-api-access-8gtvs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 19:49:38.076988 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:49:38.076961 2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/552643c8-bf2d-422f-96c5-4fa06a871356-webhook-cert\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 19:49:38.076988 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:49:38.076987 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gtvs\" (UniqueName: \"kubernetes.io/projected/552643c8-bf2d-422f-96c5-4fa06a871356-kube-api-access-8gtvs\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 19:49:38.855360 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:49:38.855332 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dcdddffd4-2gvcc" event={"ID":"552643c8-bf2d-422f-96c5-4fa06a871356","Type":"ContainerDied","Data":"e1db996af593c3cc05b8f9f95fcf9f3469684490e5ce9e4e2c21b9a3d8dfd3bd"} Jul 21 19:49:38.855781 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:49:38.855386 2581 scope.go:117] "RemoveContainer" containerID="655dab3cb93d2f5773b6a9f56c3bfd1b16147de072c40dec90a6628df59c740c" Jul 21 19:49:38.855781 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:49:38.855341 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dcdddffd4-2gvcc" Jul 21 19:49:38.878207 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:49:38.878184 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6dcdddffd4-2gvcc"] Jul 21 19:49:38.883728 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:49:38.883709 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6dcdddffd4-2gvcc"] Jul 21 19:49:39.534545 ip-10-0-137-5 kubenswrapper[2581]: I0721 19:49:39.534511 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="552643c8-bf2d-422f-96c5-4fa06a871356" path="/var/lib/kubelet/pods/552643c8-bf2d-422f-96c5-4fa06a871356/volumes" Jul 21 20:13:44.432905 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:44.432857 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk"] Jul 21 20:13:44.433349 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:44.433285 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="552643c8-bf2d-422f-96c5-4fa06a871356" containerName="manager" Jul 21 20:13:44.433349 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:44.433299 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="552643c8-bf2d-422f-96c5-4fa06a871356" containerName="manager" Jul 21 20:13:44.433471 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:44.433400 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="552643c8-bf2d-422f-96c5-4fa06a871356" containerName="manager" Jul 21 20:13:44.436255 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:44.436237 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk" Jul 21 20:13:44.439583 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:44.439561 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-839c41\"/\"default-dockercfg-xnx8n\"" Jul 21 20:13:44.440675 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:44.440652 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-839c41\"/\"openshift-service-ca.crt\"" Jul 21 20:13:44.440776 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:44.440662 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-839c41\"/\"test-model-839c41-kserve-self-signed-certs\"" Jul 21 20:13:44.441666 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:44.441650 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-839c41\"/\"kube-root-ca.crt\"" Jul 21 20:13:44.448308 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:44.448288 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk"] Jul 21 20:13:44.480583 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:44.480560 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5hpz\" (UniqueName: \"kubernetes.io/projected/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc-kube-api-access-l5hpz\") pod \"test-model-839c41-kserve-7c99596b85-cdczk\" (UID: \"ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc\") " pod="ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk" Jul 21 20:13:44.480687 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:44.480619 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc-home\") pod \"test-model-839c41-kserve-7c99596b85-cdczk\" (UID: \"ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc\") " pod="ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk" Jul 21 20:13:44.480687 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:44.480663 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc-tls-certs\") pod \"test-model-839c41-kserve-7c99596b85-cdczk\" (UID: \"ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc\") " pod="ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk" Jul 21 20:13:44.480757 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:44.480700 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc-dshm\") pod \"test-model-839c41-kserve-7c99596b85-cdczk\" (UID: \"ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc\") " pod="ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk" Jul 21 20:13:44.480791 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:44.480757 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc-model-cache\") pod \"test-model-839c41-kserve-7c99596b85-cdczk\" (UID: \"ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc\") " pod="ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk" Jul 21 20:13:44.480791 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:44.480777 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc-tmp-dir\") pod \"test-model-839c41-kserve-7c99596b85-cdczk\" (UID: \"ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc\") " pod="ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk" Jul 21 20:13:44.581375 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:44.581348 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5hpz\" (UniqueName: \"kubernetes.io/projected/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc-kube-api-access-l5hpz\") pod \"test-model-839c41-kserve-7c99596b85-cdczk\" (UID: \"ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc\") " pod="ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk" Jul 21 20:13:44.581487 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:44.581409 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc-home\") pod \"test-model-839c41-kserve-7c99596b85-cdczk\" (UID: \"ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc\") " pod="ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk" Jul 21 20:13:44.581568 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:44.581546 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc-tls-certs\") pod \"test-model-839c41-kserve-7c99596b85-cdczk\" (UID: \"ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc\") " pod="ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk" Jul 21 20:13:44.581630 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:44.581596 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc-dshm\") pod \"test-model-839c41-kserve-7c99596b85-cdczk\" (UID: \"ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc\") " pod="ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk" Jul 21 20:13:44.581689 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:44.581637 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc-model-cache\") pod \"test-model-839c41-kserve-7c99596b85-cdczk\" (UID: \"ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc\") " pod="ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk" Jul 21 20:13:44.581689 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:44.581666 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc-tmp-dir\") pod \"test-model-839c41-kserve-7c99596b85-cdczk\" (UID: \"ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc\") " pod="ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk" Jul 21 20:13:44.581800 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:44.581780 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc-home\") pod \"test-model-839c41-kserve-7c99596b85-cdczk\" (UID: \"ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc\") " pod="ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk" Jul 21 20:13:44.581982 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:44.581961 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc-model-cache\") pod \"test-model-839c41-kserve-7c99596b85-cdczk\" (UID: \"ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc\") " pod="ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk" Jul 21 20:13:44.582092 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:44.582052 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc-tmp-dir\") pod \"test-model-839c41-kserve-7c99596b85-cdczk\" (UID: \"ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc\") " pod="ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk" Jul 21 20:13:44.583673 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:44.583650 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc-dshm\") pod \"test-model-839c41-kserve-7c99596b85-cdczk\" (UID: \"ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc\") " pod="ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk" Jul 21 20:13:44.584019 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:44.584003 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc-tls-certs\") pod \"test-model-839c41-kserve-7c99596b85-cdczk\" (UID: \"ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc\") " pod="ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk" Jul 21 20:13:44.590745 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:44.590724 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5hpz\" (UniqueName: \"kubernetes.io/projected/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc-kube-api-access-l5hpz\") pod \"test-model-839c41-kserve-7c99596b85-cdczk\" (UID: \"ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc\") " pod="ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk" Jul 21 20:13:44.745772 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:44.745739 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk" Jul 21 20:13:44.878548 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:44.877517 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk"] Jul 21 20:13:44.880789 ip-10-0-137-5 kubenswrapper[2581]: W0721 20:13:44.880762 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef401fa0_7b2e_4fbb_a4f9_c9060ca06efc.slice/crio-24fb24067078d076c379589b06d8191833125ccb4e315f85cbcbcbe69c4a5b1a WatchSource:0}: Error finding container 24fb24067078d076c379589b06d8191833125ccb4e315f85cbcbcbe69c4a5b1a: Status 404 returned error can't find the container with id 24fb24067078d076c379589b06d8191833125ccb4e315f85cbcbcbe69c4a5b1a Jul 21 20:13:45.580454 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:45.580419 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk" event={"ID":"ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc","Type":"ContainerStarted","Data":"9900df2bc247138ab8a13ffed1999c4618cf3d905a11c4e47c474b5aca633ef9"} Jul 21 20:13:45.580454 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:45.580460 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk" event={"ID":"ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc","Type":"ContainerStarted","Data":"24fb24067078d076c379589b06d8191833125ccb4e315f85cbcbcbe69c4a5b1a"} Jul 21 20:13:45.604709 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:45.604656 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk" podStartSLOduration=1.604639443 podStartE2EDuration="1.604639443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:13:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:13:45.602688749 +0000 UTC m=+2190.562701182" watchObservedRunningTime="2026-07-21 20:13:45.604639443 +0000 UTC m=+2190.564651878" Jul 21 20:13:54.746561 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:54.746524 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk" Jul 21 20:13:54.747077 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:54.746580 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk" Jul 21 20:13:54.758873 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:54.758849 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk" Jul 21 20:13:55.642788 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:13:55.642762 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk" Jul 21 20:14:26.432783 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:26.432746 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk"] Jul 21 20:14:26.562579 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:26.562548 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c3ae20-kh496"] Jul 21 20:14:26.565765 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:26.565749 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c3ae20-kh496" Jul 21 20:14:26.569410 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:26.569390 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gbjhg\"" Jul 21 20:14:26.577324 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:26.577302 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c3ae20-kh496"] Jul 21 20:14:26.646069 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:26.646036 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45969103-8965-479f-9478-52ff26d35103-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-c3ae20-kh496\" (UID: \"45969103-8965-479f-9478-52ff26d35103\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c3ae20-kh496" Jul 21 20:14:26.746762 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:26.746718 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45969103-8965-479f-9478-52ff26d35103-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-c3ae20-kh496\" (UID: \"45969103-8965-479f-9478-52ff26d35103\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c3ae20-kh496" Jul 21 20:14:26.747380 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:26.747355 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45969103-8965-479f-9478-52ff26d35103-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-c3ae20-kh496\" (UID: \"45969103-8965-479f-9478-52ff26d35103\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c3ae20-kh496" Jul 21 20:14:26.876851 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:26.876825 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c3ae20-kh496" Jul 21 20:14:27.010488 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:27.010459 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c3ae20-kh496"] Jul 21 20:14:27.011954 ip-10-0-137-5 kubenswrapper[2581]: W0721 20:14:27.011882 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45969103_8965_479f_9478_52ff26d35103.slice/crio-09dfec27ff80ae4efc8a3ed4be314c0d1d26a5cd760f5641e8a463b83c643ad7 WatchSource:0}: Error finding container 09dfec27ff80ae4efc8a3ed4be314c0d1d26a5cd760f5641e8a463b83c643ad7: Status 404 returned error can't find the container with id 09dfec27ff80ae4efc8a3ed4be314c0d1d26a5cd760f5641e8a463b83c643ad7 Jul 21 20:14:27.013970 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:27.013954 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 20:14:27.784513 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:27.784477 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c3ae20-kh496" event={"ID":"45969103-8965-479f-9478-52ff26d35103","Type":"ContainerStarted","Data":"09dfec27ff80ae4efc8a3ed4be314c0d1d26a5cd760f5641e8a463b83c643ad7"} Jul 21 20:14:29.797436 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:29.797368 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c3ae20-kh496" event={"ID":"45969103-8965-479f-9478-52ff26d35103","Type":"ContainerStarted","Data":"66e0a587c891eee8301d18c9a97a6a7091fda6afd18420ad698841ebedec5074"} Jul 21 20:14:29.818474 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:29.818428 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c3ae20-kh496" podStartSLOduration=1.3010830119999999 podStartE2EDuration="3.8184141s" totalImagesPullingTime="2.517331088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:14:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:14:29.816120603 +0000 UTC m=+2234.776133037" watchObservedRunningTime="2026-07-21 20:14:29.8184141 +0000 UTC m=+2234.778426533" Jul 21 20:14:30.804129 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:30.804093 2581 generic.go:356] "Generic (PLEG): container finished" podID="45969103-8965-479f-9478-52ff26d35103" containerID="66e0a587c891eee8301d18c9a97a6a7091fda6afd18420ad698841ebedec5074" exitCode=0 Jul 21 20:14:30.804465 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:30.804172 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c3ae20-kh496" event={"ID":"45969103-8965-479f-9478-52ff26d35103","Type":"ContainerDied","Data":"66e0a587c891eee8301d18c9a97a6a7091fda6afd18420ad698841ebedec5074"} Jul 21 20:14:31.935987 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:31.935965 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c3ae20-kh496" Jul 21 20:14:31.992039 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:31.992007 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45969103-8965-479f-9478-52ff26d35103-maas-api-service-ca\") pod \"45969103-8965-479f-9478-52ff26d35103\" (UID: \"45969103-8965-479f-9478-52ff26d35103\") " Jul 21 20:14:31.992331 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:31.992310 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45969103-8965-479f-9478-52ff26d35103-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "45969103-8965-479f-9478-52ff26d35103" (UID: "45969103-8965-479f-9478-52ff26d35103"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 20:14:32.093329 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:32.093260 2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45969103-8965-479f-9478-52ff26d35103-maas-api-service-ca\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 20:14:32.814820 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:32.814785 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c3ae20-kh496" Jul 21 20:14:32.814820 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:32.814811 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c3ae20-kh496" event={"ID":"45969103-8965-479f-9478-52ff26d35103","Type":"ContainerDied","Data":"09dfec27ff80ae4efc8a3ed4be314c0d1d26a5cd760f5641e8a463b83c643ad7"} Jul 21 20:14:32.815052 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:32.814860 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09dfec27ff80ae4efc8a3ed4be314c0d1d26a5cd760f5641e8a463b83c643ad7" Jul 21 20:14:41.452547 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:41.452448 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk" podUID="ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc" containerName="main" containerID="cri-o://9900df2bc247138ab8a13ffed1999c4618cf3d905a11c4e47c474b5aca633ef9" gracePeriod=45 Jul 21 20:14:41.688299 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:41.688277 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk" Jul 21 20:14:41.718247 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:41.718188 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c3ae20-kh496"] Jul 21 20:14:41.724228 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:41.724205 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c3ae20-kh496"] Jul 21 20:14:41.773485 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:41.773454 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc-dshm\") pod \"ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc\" (UID: \"ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc\") " Jul 21 20:14:41.773640 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:41.773496 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc-tmp-dir\") pod \"ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc\" (UID: \"ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc\") " Jul 21 20:14:41.773640 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:41.773514 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc-model-cache\") pod \"ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc\" (UID: \"ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc\") " Jul 21 20:14:41.773640 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:41.773547 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5hpz\" (UniqueName: \"kubernetes.io/projected/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc-kube-api-access-l5hpz\") pod \"ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc\" (UID: \"ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc\") " Jul 21 20:14:41.773640 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:41.773577 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc-tls-certs\") pod \"ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc\" (UID: \"ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc\") " Jul 21 20:14:41.773640 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:41.773621 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc-home\") pod \"ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc\" (UID: \"ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc\") " Jul 21 20:14:41.773914 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:41.773781 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc-model-cache" (OuterVolumeSpecName: "model-cache") pod "ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc" (UID: "ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 20:14:41.773914 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:41.773794 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc" (UID: "ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 20:14:41.774020 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:41.773986 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc-home" (OuterVolumeSpecName: "home") pod "ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc" (UID: "ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 20:14:41.774095 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:41.774033 2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc-tmp-dir\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 20:14:41.774095 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:41.774058 2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc-model-cache\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 20:14:41.775816 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:41.775795 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc" (UID: "ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 20:14:41.776038 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:41.776006 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc-kube-api-access-l5hpz" (OuterVolumeSpecName: "kube-api-access-l5hpz") pod "ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc" (UID: "ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc"). InnerVolumeSpecName "kube-api-access-l5hpz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 20:14:41.776132 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:41.776061 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc-dshm" (OuterVolumeSpecName: "dshm") pod "ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc" (UID: "ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 20:14:41.864478 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:41.864441 2581 generic.go:356] "Generic (PLEG): container finished" podID="ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc" containerID="9900df2bc247138ab8a13ffed1999c4618cf3d905a11c4e47c474b5aca633ef9" exitCode=0 Jul 21 20:14:41.864632 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:41.864482 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk" Jul 21 20:14:41.864632 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:41.864508 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk" event={"ID":"ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc","Type":"ContainerDied","Data":"9900df2bc247138ab8a13ffed1999c4618cf3d905a11c4e47c474b5aca633ef9"} Jul 21 20:14:41.864632 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:41.864546 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk" event={"ID":"ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc","Type":"ContainerDied","Data":"24fb24067078d076c379589b06d8191833125ccb4e315f85cbcbcbe69c4a5b1a"} Jul 21 20:14:41.864632 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:41.864565 2581 scope.go:117] "RemoveContainer" containerID="9900df2bc247138ab8a13ffed1999c4618cf3d905a11c4e47c474b5aca633ef9" Jul 21 20:14:41.873735 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:41.873717 2581 scope.go:117] "RemoveContainer" containerID="9900df2bc247138ab8a13ffed1999c4618cf3d905a11c4e47c474b5aca633ef9" Jul 21 20:14:41.874035 ip-10-0-137-5 kubenswrapper[2581]: E0721 20:14:41.874015 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9900df2bc247138ab8a13ffed1999c4618cf3d905a11c4e47c474b5aca633ef9\": container with ID starting with 9900df2bc247138ab8a13ffed1999c4618cf3d905a11c4e47c474b5aca633ef9 not found: ID does not exist" containerID="9900df2bc247138ab8a13ffed1999c4618cf3d905a11c4e47c474b5aca633ef9" Jul 21 20:14:41.874105 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:41.874050 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9900df2bc247138ab8a13ffed1999c4618cf3d905a11c4e47c474b5aca633ef9"} err="failed to get container status \"9900df2bc247138ab8a13ffed1999c4618cf3d905a11c4e47c474b5aca633ef9\": rpc error: code = NotFound desc = could not find container \"9900df2bc247138ab8a13ffed1999c4618cf3d905a11c4e47c474b5aca633ef9\": container with ID starting with 9900df2bc247138ab8a13ffed1999c4618cf3d905a11c4e47c474b5aca633ef9 not found: ID does not exist" Jul 21 20:14:41.875414 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:41.875398 2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc-dshm\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 20:14:41.875462 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:41.875418 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5hpz\" (UniqueName: \"kubernetes.io/projected/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc-kube-api-access-l5hpz\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 20:14:41.875462 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:41.875429 2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc-tls-certs\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 20:14:41.875462 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:41.875437 2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc-home\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 20:14:41.892906 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:41.892862 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk"] Jul 21 20:14:41.900399 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:41.900378 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-839c41/test-model-839c41-kserve-7c99596b85-cdczk"] Jul 21 20:14:43.534228 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:43.534199 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45969103-8965-479f-9478-52ff26d35103" path="/var/lib/kubelet/pods/45969103-8965-479f-9478-52ff26d35103/volumes" Jul 21 20:14:43.534644 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:43.534571 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc" path="/var/lib/kubelet/pods/ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc/volumes" Jul 21 20:14:50.017879 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:50.017837 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-839c41-cclwv"] Jul 21 20:14:50.018435 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:50.018414 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45969103-8965-479f-9478-52ff26d35103" containerName="revoke-keys" Jul 21 20:14:50.018516 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:50.018438 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="45969103-8965-479f-9478-52ff26d35103" containerName="revoke-keys" Jul 21 20:14:50.018516 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:50.018459 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc" containerName="main" Jul 21 20:14:50.018516 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:50.018467 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc" containerName="main" Jul 21 20:14:50.018657 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:50.018562 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef401fa0-7b2e-4fbb-a4f9-c9060ca06efc" containerName="main" Jul 21 20:14:50.018657 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:50.018579 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="45969103-8965-479f-9478-52ff26d35103" containerName="revoke-keys" Jul 21 20:14:50.021509 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:50.021487 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-839c41-cclwv" Jul 21 20:14:50.025716 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:50.025698 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gbjhg\"" Jul 21 20:14:50.036317 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:50.036296 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-839c41-cclwv"] Jul 21 20:14:50.144541 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:50.144507 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f4fecbe-44cf-466b-b50c-1f4d2e27cb2e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-839c41-cclwv\" (UID: \"6f4fecbe-44cf-466b-b50c-1f4d2e27cb2e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-839c41-cclwv" Jul 21 20:14:50.244864 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:50.244832 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f4fecbe-44cf-466b-b50c-1f4d2e27cb2e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-839c41-cclwv\" (UID: \"6f4fecbe-44cf-466b-b50c-1f4d2e27cb2e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-839c41-cclwv" Jul 21 20:14:50.245433 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:50.245414 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f4fecbe-44cf-466b-b50c-1f4d2e27cb2e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-839c41-cclwv\" (UID: \"6f4fecbe-44cf-466b-b50c-1f4d2e27cb2e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-839c41-cclwv" Jul 21 20:14:50.331404 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:50.331332 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-839c41-cclwv" Jul 21 20:14:50.475735 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:50.475706 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-839c41-cclwv"] Jul 21 20:14:50.476761 ip-10-0-137-5 kubenswrapper[2581]: W0721 20:14:50.476736 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f4fecbe_44cf_466b_b50c_1f4d2e27cb2e.slice/crio-65a244dfe409db109641af35fb3dfaac0b7b69c0b45b70b10a5b9d3dc2e01a9b WatchSource:0}: Error finding container 65a244dfe409db109641af35fb3dfaac0b7b69c0b45b70b10a5b9d3dc2e01a9b: Status 404 returned error can't find the container with id 65a244dfe409db109641af35fb3dfaac0b7b69c0b45b70b10a5b9d3dc2e01a9b Jul 21 20:14:50.907075 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:50.907040 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-839c41-cclwv" event={"ID":"6f4fecbe-44cf-466b-b50c-1f4d2e27cb2e","Type":"ContainerStarted","Data":"57de2dfb5004ba491547d47a09c742fa1d1a065d5c6f30db099cda472598c26c"} Jul 21 20:14:50.907227 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:50.907098 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-839c41-cclwv" event={"ID":"6f4fecbe-44cf-466b-b50c-1f4d2e27cb2e","Type":"ContainerStarted","Data":"65a244dfe409db109641af35fb3dfaac0b7b69c0b45b70b10a5b9d3dc2e01a9b"} Jul 21 20:14:50.933005 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:50.932962 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-839c41-cclwv" podStartSLOduration=1.932945808 podStartE2EDuration="1.932945808s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:14:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:14:50.931696933 +0000 UTC m=+2255.891709367" watchObservedRunningTime="2026-07-21 20:14:50.932945808 +0000 UTC m=+2255.892958241" Jul 21 20:14:51.913407 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:51.913371 2581 generic.go:356] "Generic (PLEG): container finished" podID="6f4fecbe-44cf-466b-b50c-1f4d2e27cb2e" containerID="57de2dfb5004ba491547d47a09c742fa1d1a065d5c6f30db099cda472598c26c" exitCode=0 Jul 21 20:14:51.913773 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:51.913444 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-839c41-cclwv" event={"ID":"6f4fecbe-44cf-466b-b50c-1f4d2e27cb2e","Type":"ContainerDied","Data":"57de2dfb5004ba491547d47a09c742fa1d1a065d5c6f30db099cda472598c26c"} Jul 21 20:14:53.048865 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:53.048840 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-839c41-cclwv" Jul 21 20:14:53.170956 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:53.170832 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f4fecbe-44cf-466b-b50c-1f4d2e27cb2e-maas-api-service-ca\") pod \"6f4fecbe-44cf-466b-b50c-1f4d2e27cb2e\" (UID: \"6f4fecbe-44cf-466b-b50c-1f4d2e27cb2e\") " Jul 21 20:14:53.171251 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:53.171227 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f4fecbe-44cf-466b-b50c-1f4d2e27cb2e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6f4fecbe-44cf-466b-b50c-1f4d2e27cb2e" (UID: "6f4fecbe-44cf-466b-b50c-1f4d2e27cb2e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 20:14:53.272376 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:53.272339 2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f4fecbe-44cf-466b-b50c-1f4d2e27cb2e-maas-api-service-ca\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 20:14:53.922993 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:53.922923 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-839c41-cclwv" Jul 21 20:14:53.923128 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:53.922919 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-839c41-cclwv" event={"ID":"6f4fecbe-44cf-466b-b50c-1f4d2e27cb2e","Type":"ContainerDied","Data":"65a244dfe409db109641af35fb3dfaac0b7b69c0b45b70b10a5b9d3dc2e01a9b"} Jul 21 20:14:53.923128 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:14:53.923040 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="65a244dfe409db109641af35fb3dfaac0b7b69c0b45b70b10a5b9d3dc2e01a9b" Jul 21 20:15:05.121507 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:15:05.121471 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-839c41-cclwv"] Jul 21 20:15:05.126531 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:15:05.126505 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-839c41-cclwv"] Jul 21 20:15:05.533907 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:15:05.533857 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f4fecbe-44cf-466b-b50c-1f4d2e27cb2e" path="/var/lib/kubelet/pods/6f4fecbe-44cf-466b-b50c-1f4d2e27cb2e/volumes" Jul 21 20:15:38.523278 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:15:38.523246 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-661123-jn5vx"] Jul 21 20:15:38.523736 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:15:38.523630 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f4fecbe-44cf-466b-b50c-1f4d2e27cb2e" containerName="revoke-keys" Jul 21 20:15:38.523736 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:15:38.523642 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f4fecbe-44cf-466b-b50c-1f4d2e27cb2e" containerName="revoke-keys" Jul 21 20:15:38.523736 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:15:38.523723 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f4fecbe-44cf-466b-b50c-1f4d2e27cb2e" containerName="revoke-keys" Jul 21 20:15:38.527334 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:15:38.527313 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-661123-jn5vx" Jul 21 20:15:38.530884 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:15:38.530859 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gbjhg\"" Jul 21 20:15:38.535298 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:15:38.535271 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-661123-jn5vx"] Jul 21 20:15:38.666689 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:15:38.666657 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bf5e9db-e176-44e1-a47c-369eaac91986-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-661123-jn5vx\" (UID: \"0bf5e9db-e176-44e1-a47c-369eaac91986\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-661123-jn5vx" Jul 21 20:15:38.767041 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:15:38.767008 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bf5e9db-e176-44e1-a47c-369eaac91986-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-661123-jn5vx\" (UID: \"0bf5e9db-e176-44e1-a47c-369eaac91986\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-661123-jn5vx" Jul 21 20:15:38.767579 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:15:38.767559 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bf5e9db-e176-44e1-a47c-369eaac91986-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-661123-jn5vx\" (UID: \"0bf5e9db-e176-44e1-a47c-369eaac91986\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-661123-jn5vx" Jul 21 20:15:38.839271 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:15:38.839210 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-661123-jn5vx" Jul 21 20:15:38.970117 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:15:38.970084 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-661123-jn5vx"] Jul 21 20:15:38.970240 ip-10-0-137-5 kubenswrapper[2581]: W0721 20:15:38.970214 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bf5e9db_e176_44e1_a47c_369eaac91986.slice/crio-84f6006aab6bf9728266f48c3e87a9607b35629bc4b62f06b87e8ae8bf43d3c2 WatchSource:0}: Error finding container 84f6006aab6bf9728266f48c3e87a9607b35629bc4b62f06b87e8ae8bf43d3c2: Status 404 returned error can't find the container with id 84f6006aab6bf9728266f48c3e87a9607b35629bc4b62f06b87e8ae8bf43d3c2 Jul 21 20:15:39.130244 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:15:39.130171 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-661123-jn5vx" event={"ID":"0bf5e9db-e176-44e1-a47c-369eaac91986","Type":"ContainerStarted","Data":"84f6006aab6bf9728266f48c3e87a9607b35629bc4b62f06b87e8ae8bf43d3c2"} Jul 21 20:15:40.136363 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:15:40.136329 2581 generic.go:356] "Generic (PLEG): container finished" podID="0bf5e9db-e176-44e1-a47c-369eaac91986" containerID="dc86bffed890b90692cb05607fc2e3579c3fd84f1e518cdd3e91ce2b0fb591b0" exitCode=0 Jul 21 20:15:40.136746 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:15:40.136385 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-661123-jn5vx" event={"ID":"0bf5e9db-e176-44e1-a47c-369eaac91986","Type":"ContainerDied","Data":"dc86bffed890b90692cb05607fc2e3579c3fd84f1e518cdd3e91ce2b0fb591b0"} Jul 21 20:15:41.270526 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:15:41.270498 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-661123-jn5vx" Jul 21 20:15:41.391907 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:15:41.391823 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bf5e9db-e176-44e1-a47c-369eaac91986-maas-api-service-ca\") pod \"0bf5e9db-e176-44e1-a47c-369eaac91986\" (UID: \"0bf5e9db-e176-44e1-a47c-369eaac91986\") " Jul 21 20:15:41.392170 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:15:41.392149 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bf5e9db-e176-44e1-a47c-369eaac91986-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0bf5e9db-e176-44e1-a47c-369eaac91986" (UID: "0bf5e9db-e176-44e1-a47c-369eaac91986"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 20:15:41.492615 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:15:41.492583 2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bf5e9db-e176-44e1-a47c-369eaac91986-maas-api-service-ca\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 20:15:42.147429 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:15:42.147399 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-661123-jn5vx" Jul 21 20:15:42.147586 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:15:42.147432 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-661123-jn5vx" event={"ID":"0bf5e9db-e176-44e1-a47c-369eaac91986","Type":"ContainerDied","Data":"84f6006aab6bf9728266f48c3e87a9607b35629bc4b62f06b87e8ae8bf43d3c2"} Jul 21 20:15:42.147586 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:15:42.147483 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="84f6006aab6bf9728266f48c3e87a9607b35629bc4b62f06b87e8ae8bf43d3c2" Jul 21 20:15:58.640788 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:15:58.640752 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-661123-jn5vx"] Jul 21 20:15:58.645402 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:15:58.645379 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-661123-jn5vx"] Jul 21 20:15:59.534463 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:15:59.534421 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bf5e9db-e176-44e1-a47c-369eaac91986" path="/var/lib/kubelet/pods/0bf5e9db-e176-44e1-a47c-369eaac91986/volumes" Jul 21 20:17:33.124728 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:33.124695 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn"] Jul 21 20:17:33.126156 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:33.125758 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bf5e9db-e176-44e1-a47c-369eaac91986" containerName="revoke-keys" Jul 21 20:17:33.126156 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:33.125785 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bf5e9db-e176-44e1-a47c-369eaac91986" containerName="revoke-keys" Jul 21 20:17:33.126156 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:33.126037 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bf5e9db-e176-44e1-a47c-369eaac91986" containerName="revoke-keys" Jul 21 20:17:33.131947 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:33.130119 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn" Jul 21 20:17:33.134511 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:33.134488 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-464ec4\"/\"openshift-service-ca.crt\"" Jul 21 20:17:33.134644 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:33.134489 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-464ec4\"/\"kube-root-ca.crt\"" Jul 21 20:17:33.134644 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:33.134489 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-464ec4\"/\"auth-test-model-464ec4-kserve-self-signed-certs\"" Jul 21 20:17:33.134644 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:33.134497 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-464ec4\"/\"default-dockercfg-jjzk4\"" Jul 21 20:17:33.141689 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:33.141668 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn"] Jul 21 20:17:33.223466 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:33.223432 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kckhz\" (UniqueName: \"kubernetes.io/projected/bbcc5a7a-a31a-458c-8191-bc73e73518ad-kube-api-access-kckhz\") pod \"auth-test-model-464ec4-kserve-8647bb544c-slctn\" (UID: \"bbcc5a7a-a31a-458c-8191-bc73e73518ad\") " pod="ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn" Jul 21 20:17:33.223638 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:33.223472 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbcc5a7a-a31a-458c-8191-bc73e73518ad-home\") pod \"auth-test-model-464ec4-kserve-8647bb544c-slctn\" (UID: \"bbcc5a7a-a31a-458c-8191-bc73e73518ad\") " pod="ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn" Jul 21 20:17:33.223638 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:33.223547 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbcc5a7a-a31a-458c-8191-bc73e73518ad-tmp-dir\") pod \"auth-test-model-464ec4-kserve-8647bb544c-slctn\" (UID: \"bbcc5a7a-a31a-458c-8191-bc73e73518ad\") " pod="ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn" Jul 21 20:17:33.223638 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:33.223620 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbcc5a7a-a31a-458c-8191-bc73e73518ad-dshm\") pod \"auth-test-model-464ec4-kserve-8647bb544c-slctn\" (UID: \"bbcc5a7a-a31a-458c-8191-bc73e73518ad\") " pod="ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn" Jul 21 20:17:33.223638 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:33.223639 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbcc5a7a-a31a-458c-8191-bc73e73518ad-model-cache\") pod \"auth-test-model-464ec4-kserve-8647bb544c-slctn\" (UID: \"bbcc5a7a-a31a-458c-8191-bc73e73518ad\") " pod="ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn" Jul 21 20:17:33.223827 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:33.223681 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbcc5a7a-a31a-458c-8191-bc73e73518ad-tls-certs\") pod \"auth-test-model-464ec4-kserve-8647bb544c-slctn\" (UID: \"bbcc5a7a-a31a-458c-8191-bc73e73518ad\") " pod="ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn" Jul 21 20:17:33.325095 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:33.325061 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbcc5a7a-a31a-458c-8191-bc73e73518ad-tls-certs\") pod \"auth-test-model-464ec4-kserve-8647bb544c-slctn\" (UID: \"bbcc5a7a-a31a-458c-8191-bc73e73518ad\") " pod="ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn" Jul 21 20:17:33.325318 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:33.325101 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kckhz\" (UniqueName: \"kubernetes.io/projected/bbcc5a7a-a31a-458c-8191-bc73e73518ad-kube-api-access-kckhz\") pod \"auth-test-model-464ec4-kserve-8647bb544c-slctn\" (UID: \"bbcc5a7a-a31a-458c-8191-bc73e73518ad\") " pod="ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn" Jul 21 20:17:33.325318 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:33.325125 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbcc5a7a-a31a-458c-8191-bc73e73518ad-home\") pod \"auth-test-model-464ec4-kserve-8647bb544c-slctn\" (UID: \"bbcc5a7a-a31a-458c-8191-bc73e73518ad\") " pod="ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn" Jul 21 20:17:33.325318 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:33.325172 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbcc5a7a-a31a-458c-8191-bc73e73518ad-tmp-dir\") pod \"auth-test-model-464ec4-kserve-8647bb544c-slctn\" (UID: \"bbcc5a7a-a31a-458c-8191-bc73e73518ad\") " pod="ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn" Jul 21 20:17:33.325318 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:33.325191 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbcc5a7a-a31a-458c-8191-bc73e73518ad-dshm\") pod \"auth-test-model-464ec4-kserve-8647bb544c-slctn\" (UID: \"bbcc5a7a-a31a-458c-8191-bc73e73518ad\") " pod="ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn" Jul 21 20:17:33.325318 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:33.325208 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbcc5a7a-a31a-458c-8191-bc73e73518ad-model-cache\") pod \"auth-test-model-464ec4-kserve-8647bb544c-slctn\" (UID: \"bbcc5a7a-a31a-458c-8191-bc73e73518ad\") " pod="ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn" Jul 21 20:17:33.325609 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:33.325584 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbcc5a7a-a31a-458c-8191-bc73e73518ad-tmp-dir\") pod \"auth-test-model-464ec4-kserve-8647bb544c-slctn\" (UID: \"bbcc5a7a-a31a-458c-8191-bc73e73518ad\") " pod="ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn" Jul 21 20:17:33.325609 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:33.325601 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbcc5a7a-a31a-458c-8191-bc73e73518ad-model-cache\") pod \"auth-test-model-464ec4-kserve-8647bb544c-slctn\" (UID: \"bbcc5a7a-a31a-458c-8191-bc73e73518ad\") " pod="ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn" Jul 21 20:17:33.325701 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:33.325644 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbcc5a7a-a31a-458c-8191-bc73e73518ad-home\") pod \"auth-test-model-464ec4-kserve-8647bb544c-slctn\" (UID: \"bbcc5a7a-a31a-458c-8191-bc73e73518ad\") " pod="ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn" Jul 21 20:17:33.327544 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:33.327521 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbcc5a7a-a31a-458c-8191-bc73e73518ad-dshm\") pod \"auth-test-model-464ec4-kserve-8647bb544c-slctn\" (UID: \"bbcc5a7a-a31a-458c-8191-bc73e73518ad\") " pod="ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn" Jul 21 20:17:33.327699 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:33.327680 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbcc5a7a-a31a-458c-8191-bc73e73518ad-tls-certs\") pod \"auth-test-model-464ec4-kserve-8647bb544c-slctn\" (UID: \"bbcc5a7a-a31a-458c-8191-bc73e73518ad\") " pod="ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn" Jul 21 20:17:33.334200 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:33.334182 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kckhz\" (UniqueName: \"kubernetes.io/projected/bbcc5a7a-a31a-458c-8191-bc73e73518ad-kube-api-access-kckhz\") pod \"auth-test-model-464ec4-kserve-8647bb544c-slctn\" (UID: \"bbcc5a7a-a31a-458c-8191-bc73e73518ad\") " pod="ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn" Jul 21 20:17:33.440926 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:33.440837 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn" Jul 21 20:17:33.569425 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:33.569397 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn"] Jul 21 20:17:33.571324 ip-10-0-137-5 kubenswrapper[2581]: W0721 20:17:33.571297 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbbcc5a7a_a31a_458c_8191_bc73e73518ad.slice/crio-59cbaff1e2fd9372edece04536dccd0e34e086865b876ccbfba0b2e289a31a47 WatchSource:0}: Error finding container 59cbaff1e2fd9372edece04536dccd0e34e086865b876ccbfba0b2e289a31a47: Status 404 returned error can't find the container with id 59cbaff1e2fd9372edece04536dccd0e34e086865b876ccbfba0b2e289a31a47 Jul 21 20:17:33.672306 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:33.672274 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn" event={"ID":"bbcc5a7a-a31a-458c-8191-bc73e73518ad","Type":"ContainerStarted","Data":"a790c54bba31169efda5594bb368ad262bb03208b626095f5bca0bb66b75e27a"} Jul 21 20:17:33.672455 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:33.672316 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn" event={"ID":"bbcc5a7a-a31a-458c-8191-bc73e73518ad","Type":"ContainerStarted","Data":"59cbaff1e2fd9372edece04536dccd0e34e086865b876ccbfba0b2e289a31a47"} Jul 21 20:17:33.705492 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:33.705391 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn" podStartSLOduration=0.705374889 podStartE2EDuration="705.374889ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:17:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:17:33.703712931 +0000 UTC m=+2418.663725377" watchObservedRunningTime="2026-07-21 20:17:33.705374889 +0000 UTC m=+2418.665387323" Jul 21 20:17:43.441969 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:43.441940 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn" Jul 21 20:17:43.442364 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:43.442204 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn" Jul 21 20:17:43.454395 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:43.454362 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn" Jul 21 20:17:43.730626 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:17:43.730602 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn" Jul 21 20:19:50.318958 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:19:50.318920 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn"] Jul 21 20:20:05.338699 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:05.338657 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn" podUID="bbcc5a7a-a31a-458c-8191-bc73e73518ad" containerName="main" containerID="cri-o://a790c54bba31169efda5594bb368ad262bb03208b626095f5bca0bb66b75e27a" gracePeriod=45 Jul 21 20:20:05.590163 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:05.590111 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn" Jul 21 20:20:05.746037 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:05.746006 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbcc5a7a-a31a-458c-8191-bc73e73518ad-dshm\") pod \"bbcc5a7a-a31a-458c-8191-bc73e73518ad\" (UID: \"bbcc5a7a-a31a-458c-8191-bc73e73518ad\") " Jul 21 20:20:05.746187 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:05.746043 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbcc5a7a-a31a-458c-8191-bc73e73518ad-tmp-dir\") pod \"bbcc5a7a-a31a-458c-8191-bc73e73518ad\" (UID: \"bbcc5a7a-a31a-458c-8191-bc73e73518ad\") " Jul 21 20:20:05.746187 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:05.746118 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kckhz\" (UniqueName: \"kubernetes.io/projected/bbcc5a7a-a31a-458c-8191-bc73e73518ad-kube-api-access-kckhz\") pod \"bbcc5a7a-a31a-458c-8191-bc73e73518ad\" (UID: \"bbcc5a7a-a31a-458c-8191-bc73e73518ad\") " Jul 21 20:20:05.746187 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:05.746159 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbcc5a7a-a31a-458c-8191-bc73e73518ad-home\") pod \"bbcc5a7a-a31a-458c-8191-bc73e73518ad\" (UID: \"bbcc5a7a-a31a-458c-8191-bc73e73518ad\") " Jul 21 20:20:05.746187 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:05.746183 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbcc5a7a-a31a-458c-8191-bc73e73518ad-tls-certs\") pod \"bbcc5a7a-a31a-458c-8191-bc73e73518ad\" (UID: \"bbcc5a7a-a31a-458c-8191-bc73e73518ad\") " Jul 21 20:20:05.746365 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:05.746207 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbcc5a7a-a31a-458c-8191-bc73e73518ad-model-cache\") pod \"bbcc5a7a-a31a-458c-8191-bc73e73518ad\" (UID: \"bbcc5a7a-a31a-458c-8191-bc73e73518ad\") " Jul 21 20:20:05.746422 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:05.746394 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbcc5a7a-a31a-458c-8191-bc73e73518ad-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bbcc5a7a-a31a-458c-8191-bc73e73518ad" (UID: "bbcc5a7a-a31a-458c-8191-bc73e73518ad"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 20:20:05.746479 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:05.746432 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbcc5a7a-a31a-458c-8191-bc73e73518ad-home" (OuterVolumeSpecName: "home") pod "bbcc5a7a-a31a-458c-8191-bc73e73518ad" (UID: "bbcc5a7a-a31a-458c-8191-bc73e73518ad"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 20:20:05.746565 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:05.746539 2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbcc5a7a-a31a-458c-8191-bc73e73518ad-tmp-dir\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 20:20:05.746565 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:05.746566 2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbcc5a7a-a31a-458c-8191-bc73e73518ad-home\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 20:20:05.746811 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:05.746571 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbcc5a7a-a31a-458c-8191-bc73e73518ad-model-cache" (OuterVolumeSpecName: "model-cache") pod "bbcc5a7a-a31a-458c-8191-bc73e73518ad" (UID: "bbcc5a7a-a31a-458c-8191-bc73e73518ad"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 20:20:05.748357 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:05.748333 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbcc5a7a-a31a-458c-8191-bc73e73518ad-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bbcc5a7a-a31a-458c-8191-bc73e73518ad" (UID: "bbcc5a7a-a31a-458c-8191-bc73e73518ad"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 20:20:05.748438 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:05.748337 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbcc5a7a-a31a-458c-8191-bc73e73518ad-dshm" (OuterVolumeSpecName: "dshm") pod "bbcc5a7a-a31a-458c-8191-bc73e73518ad" (UID: "bbcc5a7a-a31a-458c-8191-bc73e73518ad"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 20:20:05.748438 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:05.748359 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbcc5a7a-a31a-458c-8191-bc73e73518ad-kube-api-access-kckhz" (OuterVolumeSpecName: "kube-api-access-kckhz") pod "bbcc5a7a-a31a-458c-8191-bc73e73518ad" (UID: "bbcc5a7a-a31a-458c-8191-bc73e73518ad"). InnerVolumeSpecName "kube-api-access-kckhz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 20:20:05.847526 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:05.847471 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kckhz\" (UniqueName: \"kubernetes.io/projected/bbcc5a7a-a31a-458c-8191-bc73e73518ad-kube-api-access-kckhz\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 20:20:05.847526 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:05.847495 2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbcc5a7a-a31a-458c-8191-bc73e73518ad-tls-certs\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 20:20:05.847526 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:05.847506 2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbcc5a7a-a31a-458c-8191-bc73e73518ad-model-cache\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 20:20:05.847526 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:05.847514 2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbcc5a7a-a31a-458c-8191-bc73e73518ad-dshm\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 20:20:06.395136 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:06.395098 2581 generic.go:356] "Generic (PLEG): container finished" podID="bbcc5a7a-a31a-458c-8191-bc73e73518ad" containerID="a790c54bba31169efda5594bb368ad262bb03208b626095f5bca0bb66b75e27a" exitCode=0 Jul 21 20:20:06.395599 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:06.395162 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn" Jul 21 20:20:06.395599 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:06.395178 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn" event={"ID":"bbcc5a7a-a31a-458c-8191-bc73e73518ad","Type":"ContainerDied","Data":"a790c54bba31169efda5594bb368ad262bb03208b626095f5bca0bb66b75e27a"} Jul 21 20:20:06.395599 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:06.395225 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn" event={"ID":"bbcc5a7a-a31a-458c-8191-bc73e73518ad","Type":"ContainerDied","Data":"59cbaff1e2fd9372edece04536dccd0e34e086865b876ccbfba0b2e289a31a47"} Jul 21 20:20:06.395599 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:06.395243 2581 scope.go:117] "RemoveContainer" containerID="a790c54bba31169efda5594bb368ad262bb03208b626095f5bca0bb66b75e27a" Jul 21 20:20:06.404704 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:06.404686 2581 scope.go:117] "RemoveContainer" containerID="a790c54bba31169efda5594bb368ad262bb03208b626095f5bca0bb66b75e27a" Jul 21 20:20:06.404983 ip-10-0-137-5 kubenswrapper[2581]: E0721 20:20:06.404954 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a790c54bba31169efda5594bb368ad262bb03208b626095f5bca0bb66b75e27a\": container with ID starting with a790c54bba31169efda5594bb368ad262bb03208b626095f5bca0bb66b75e27a not found: ID does not exist" containerID="a790c54bba31169efda5594bb368ad262bb03208b626095f5bca0bb66b75e27a" Jul 21 20:20:06.405045 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:06.404991 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a790c54bba31169efda5594bb368ad262bb03208b626095f5bca0bb66b75e27a"} err="failed to get container status \"a790c54bba31169efda5594bb368ad262bb03208b626095f5bca0bb66b75e27a\": rpc error: code = NotFound desc = could not find container \"a790c54bba31169efda5594bb368ad262bb03208b626095f5bca0bb66b75e27a\": container with ID starting with a790c54bba31169efda5594bb368ad262bb03208b626095f5bca0bb66b75e27a not found: ID does not exist" Jul 21 20:20:06.419469 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:06.419447 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn"] Jul 21 20:20:06.425688 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:06.425669 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-464ec4/auth-test-model-464ec4-kserve-8647bb544c-slctn"] Jul 21 20:20:07.534241 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:07.534211 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbcc5a7a-a31a-458c-8191-bc73e73518ad" path="/var/lib/kubelet/pods/bbcc5a7a-a31a-458c-8191-bc73e73518ad/volumes" Jul 21 20:20:23.405115 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:23.405080 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd"] Jul 21 20:20:23.405573 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:23.405472 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbcc5a7a-a31a-458c-8191-bc73e73518ad" containerName="main" Jul 21 20:20:23.405573 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:23.405485 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbcc5a7a-a31a-458c-8191-bc73e73518ad" containerName="main" Jul 21 20:20:23.405573 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:23.405552 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbcc5a7a-a31a-458c-8191-bc73e73518ad" containerName="main" Jul 21 20:20:23.408580 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:23.408559 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd" Jul 21 20:20:23.412762 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:23.412737 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-464ec4\"/\"openshift-service-ca.crt\"" Jul 21 20:20:23.412862 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:23.412786 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-464ec4\"/\"kube-root-ca.crt\"" Jul 21 20:20:23.412862 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:23.412737 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-464ec4\"/\"default-dockercfg-jjzk4\"" Jul 21 20:20:23.412862 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:23.412774 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-464ec4\"/\"sub-test-model-464ec4-kserve-self-signed-certs\"" Jul 21 20:20:23.421008 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:23.420989 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd"] Jul 21 20:20:23.495950 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:23.495917 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0a290ee-523e-4b63-a2e2-ac725a72a19c-home\") pod \"sub-test-model-464ec4-kserve-647f69699f-8dcfd\" (UID: \"d0a290ee-523e-4b63-a2e2-ac725a72a19c\") " pod="ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd" Jul 21 20:20:23.495950 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:23.495950 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0a290ee-523e-4b63-a2e2-ac725a72a19c-dshm\") pod \"sub-test-model-464ec4-kserve-647f69699f-8dcfd\" (UID: \"d0a290ee-523e-4b63-a2e2-ac725a72a19c\") " pod="ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd" Jul 21 20:20:23.496173 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:23.495975 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0a290ee-523e-4b63-a2e2-ac725a72a19c-tmp-dir\") pod \"sub-test-model-464ec4-kserve-647f69699f-8dcfd\" (UID: \"d0a290ee-523e-4b63-a2e2-ac725a72a19c\") " pod="ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd" Jul 21 20:20:23.496173 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:23.495990 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0a290ee-523e-4b63-a2e2-ac725a72a19c-tls-certs\") pod \"sub-test-model-464ec4-kserve-647f69699f-8dcfd\" (UID: \"d0a290ee-523e-4b63-a2e2-ac725a72a19c\") " pod="ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd" Jul 21 20:20:23.496173 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:23.496125 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0a290ee-523e-4b63-a2e2-ac725a72a19c-model-cache\") pod \"sub-test-model-464ec4-kserve-647f69699f-8dcfd\" (UID: \"d0a290ee-523e-4b63-a2e2-ac725a72a19c\") " pod="ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd" Jul 21 20:20:23.496308 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:23.496173 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28pqw\" (UniqueName: \"kubernetes.io/projected/d0a290ee-523e-4b63-a2e2-ac725a72a19c-kube-api-access-28pqw\") pod \"sub-test-model-464ec4-kserve-647f69699f-8dcfd\" (UID: \"d0a290ee-523e-4b63-a2e2-ac725a72a19c\") " pod="ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd" Jul 21 20:20:23.596585 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:23.596549 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28pqw\" (UniqueName: \"kubernetes.io/projected/d0a290ee-523e-4b63-a2e2-ac725a72a19c-kube-api-access-28pqw\") pod \"sub-test-model-464ec4-kserve-647f69699f-8dcfd\" (UID: \"d0a290ee-523e-4b63-a2e2-ac725a72a19c\") " pod="ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd" Jul 21 20:20:23.596747 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:23.596621 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0a290ee-523e-4b63-a2e2-ac725a72a19c-home\") pod \"sub-test-model-464ec4-kserve-647f69699f-8dcfd\" (UID: \"d0a290ee-523e-4b63-a2e2-ac725a72a19c\") " pod="ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd" Jul 21 20:20:23.596747 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:23.596648 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0a290ee-523e-4b63-a2e2-ac725a72a19c-dshm\") pod \"sub-test-model-464ec4-kserve-647f69699f-8dcfd\" (UID: \"d0a290ee-523e-4b63-a2e2-ac725a72a19c\") " pod="ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd" Jul 21 20:20:23.596747 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:23.596671 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0a290ee-523e-4b63-a2e2-ac725a72a19c-tmp-dir\") pod \"sub-test-model-464ec4-kserve-647f69699f-8dcfd\" (UID: \"d0a290ee-523e-4b63-a2e2-ac725a72a19c\") " pod="ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd" Jul 21 20:20:23.596747 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:23.596686 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0a290ee-523e-4b63-a2e2-ac725a72a19c-tls-certs\") pod \"sub-test-model-464ec4-kserve-647f69699f-8dcfd\" (UID: \"d0a290ee-523e-4b63-a2e2-ac725a72a19c\") " pod="ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd" Jul 21 20:20:23.596996 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:23.596768 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0a290ee-523e-4b63-a2e2-ac725a72a19c-model-cache\") pod \"sub-test-model-464ec4-kserve-647f69699f-8dcfd\" (UID: \"d0a290ee-523e-4b63-a2e2-ac725a72a19c\") " pod="ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd" Jul 21 20:20:23.597142 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:23.597118 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0a290ee-523e-4b63-a2e2-ac725a72a19c-home\") pod \"sub-test-model-464ec4-kserve-647f69699f-8dcfd\" (UID: \"d0a290ee-523e-4b63-a2e2-ac725a72a19c\") " pod="ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd" Jul 21 20:20:23.597246 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:23.597167 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0a290ee-523e-4b63-a2e2-ac725a72a19c-model-cache\") pod \"sub-test-model-464ec4-kserve-647f69699f-8dcfd\" (UID: \"d0a290ee-523e-4b63-a2e2-ac725a72a19c\") " pod="ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd" Jul 21 20:20:23.597246 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:23.597183 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0a290ee-523e-4b63-a2e2-ac725a72a19c-tmp-dir\") pod \"sub-test-model-464ec4-kserve-647f69699f-8dcfd\" (UID: \"d0a290ee-523e-4b63-a2e2-ac725a72a19c\") " pod="ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd" Jul 21 20:20:23.599075 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:23.599047 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0a290ee-523e-4b63-a2e2-ac725a72a19c-dshm\") pod \"sub-test-model-464ec4-kserve-647f69699f-8dcfd\" (UID: \"d0a290ee-523e-4b63-a2e2-ac725a72a19c\") " pod="ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd" Jul 21 20:20:23.599274 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:23.599260 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0a290ee-523e-4b63-a2e2-ac725a72a19c-tls-certs\") pod \"sub-test-model-464ec4-kserve-647f69699f-8dcfd\" (UID: \"d0a290ee-523e-4b63-a2e2-ac725a72a19c\") " pod="ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd" Jul 21 20:20:23.605059 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:23.605042 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28pqw\" (UniqueName: \"kubernetes.io/projected/d0a290ee-523e-4b63-a2e2-ac725a72a19c-kube-api-access-28pqw\") pod \"sub-test-model-464ec4-kserve-647f69699f-8dcfd\" (UID: \"d0a290ee-523e-4b63-a2e2-ac725a72a19c\") " pod="ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd" Jul 21 20:20:23.718715 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:23.718628 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd" Jul 21 20:20:23.850712 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:23.850682 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd"] Jul 21 20:20:23.852509 ip-10-0-137-5 kubenswrapper[2581]: W0721 20:20:23.852481 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0a290ee_523e_4b63_a2e2_ac725a72a19c.slice/crio-205ca5832ff8225b547f59b21163cfef6f5c6824aa02396a735186e784a44a16 WatchSource:0}: Error finding container 205ca5832ff8225b547f59b21163cfef6f5c6824aa02396a735186e784a44a16: Status 404 returned error can't find the container with id 205ca5832ff8225b547f59b21163cfef6f5c6824aa02396a735186e784a44a16 Jul 21 20:20:24.486514 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:24.486477 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd" event={"ID":"d0a290ee-523e-4b63-a2e2-ac725a72a19c","Type":"ContainerStarted","Data":"06b9bdba396f3cb4ba0f78ccbdf7f015f0458ae13854a1266bcc97ff338aa159"} Jul 21 20:20:24.486514 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:24.486519 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd" event={"ID":"d0a290ee-523e-4b63-a2e2-ac725a72a19c","Type":"ContainerStarted","Data":"205ca5832ff8225b547f59b21163cfef6f5c6824aa02396a735186e784a44a16"} Jul 21 20:20:24.506157 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:24.506093 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd" podStartSLOduration=1.506052035 podStartE2EDuration="1.506052035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:20:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:20:24.504949777 +0000 UTC m=+2589.464962241" watchObservedRunningTime="2026-07-21 20:20:24.506052035 +0000 UTC m=+2589.466064469" Jul 21 20:20:33.719752 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:33.719720 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd" Jul 21 20:20:33.720268 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:33.719765 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd" Jul 21 20:20:33.733225 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:33.733197 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd" Jul 21 20:20:34.546502 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:20:34.546473 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd" Jul 21 20:21:15.686845 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:21:15.686814 2581 scope.go:117] "RemoveContainer" containerID="57de2dfb5004ba491547d47a09c742fa1d1a065d5c6f30db099cda472598c26c" Jul 21 20:21:15.695121 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:21:15.695105 2581 scope.go:117] "RemoveContainer" containerID="66e0a587c891eee8301d18c9a97a6a7091fda6afd18420ad698841ebedec5074" Jul 21 20:21:16.216927 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:21:16.216882 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd"] Jul 21 20:21:31.236223 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:21:31.236164 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd" podUID="d0a290ee-523e-4b63-a2e2-ac725a72a19c" containerName="main" containerID="cri-o://06b9bdba396f3cb4ba0f78ccbdf7f015f0458ae13854a1266bcc97ff338aa159" gracePeriod=45 Jul 21 20:21:31.486415 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:21:31.486363 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd" Jul 21 20:21:31.604193 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:21:31.604169 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28pqw\" (UniqueName: \"kubernetes.io/projected/d0a290ee-523e-4b63-a2e2-ac725a72a19c-kube-api-access-28pqw\") pod \"d0a290ee-523e-4b63-a2e2-ac725a72a19c\" (UID: \"d0a290ee-523e-4b63-a2e2-ac725a72a19c\") " Jul 21 20:21:31.604331 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:21:31.604212 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0a290ee-523e-4b63-a2e2-ac725a72a19c-home\") pod \"d0a290ee-523e-4b63-a2e2-ac725a72a19c\" (UID: \"d0a290ee-523e-4b63-a2e2-ac725a72a19c\") " Jul 21 20:21:31.604331 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:21:31.604237 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0a290ee-523e-4b63-a2e2-ac725a72a19c-dshm\") pod \"d0a290ee-523e-4b63-a2e2-ac725a72a19c\" (UID: \"d0a290ee-523e-4b63-a2e2-ac725a72a19c\") " Jul 21 20:21:31.604331 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:21:31.604260 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0a290ee-523e-4b63-a2e2-ac725a72a19c-tls-certs\") pod \"d0a290ee-523e-4b63-a2e2-ac725a72a19c\" (UID: \"d0a290ee-523e-4b63-a2e2-ac725a72a19c\") " Jul 21 20:21:31.604331 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:21:31.604287 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0a290ee-523e-4b63-a2e2-ac725a72a19c-tmp-dir\") pod \"d0a290ee-523e-4b63-a2e2-ac725a72a19c\" (UID: \"d0a290ee-523e-4b63-a2e2-ac725a72a19c\") " Jul 21 20:21:31.604331 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:21:31.604329 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0a290ee-523e-4b63-a2e2-ac725a72a19c-model-cache\") pod \"d0a290ee-523e-4b63-a2e2-ac725a72a19c\" (UID: \"d0a290ee-523e-4b63-a2e2-ac725a72a19c\") " Jul 21 20:21:31.604600 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:21:31.604455 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0a290ee-523e-4b63-a2e2-ac725a72a19c-home" (OuterVolumeSpecName: "home") pod "d0a290ee-523e-4b63-a2e2-ac725a72a19c" (UID: "d0a290ee-523e-4b63-a2e2-ac725a72a19c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 20:21:31.604600 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:21:31.604547 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0a290ee-523e-4b63-a2e2-ac725a72a19c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d0a290ee-523e-4b63-a2e2-ac725a72a19c" (UID: "d0a290ee-523e-4b63-a2e2-ac725a72a19c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 20:21:31.604699 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:21:31.604655 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0a290ee-523e-4b63-a2e2-ac725a72a19c-model-cache" (OuterVolumeSpecName: "model-cache") pod "d0a290ee-523e-4b63-a2e2-ac725a72a19c" (UID: "d0a290ee-523e-4b63-a2e2-ac725a72a19c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 20:21:31.604797 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:21:31.604780 2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0a290ee-523e-4b63-a2e2-ac725a72a19c-home\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 20:21:31.604851 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:21:31.604800 2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0a290ee-523e-4b63-a2e2-ac725a72a19c-tmp-dir\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 20:21:31.604851 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:21:31.604810 2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0a290ee-523e-4b63-a2e2-ac725a72a19c-model-cache\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 20:21:31.606288 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:21:31.606267 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0a290ee-523e-4b63-a2e2-ac725a72a19c-dshm" (OuterVolumeSpecName: "dshm") pod "d0a290ee-523e-4b63-a2e2-ac725a72a19c" (UID: "d0a290ee-523e-4b63-a2e2-ac725a72a19c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 20:21:31.606400 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:21:31.606364 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0a290ee-523e-4b63-a2e2-ac725a72a19c-kube-api-access-28pqw" (OuterVolumeSpecName: "kube-api-access-28pqw") pod "d0a290ee-523e-4b63-a2e2-ac725a72a19c" (UID: "d0a290ee-523e-4b63-a2e2-ac725a72a19c"). InnerVolumeSpecName "kube-api-access-28pqw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 20:21:31.606459 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:21:31.606417 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0a290ee-523e-4b63-a2e2-ac725a72a19c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d0a290ee-523e-4b63-a2e2-ac725a72a19c" (UID: "d0a290ee-523e-4b63-a2e2-ac725a72a19c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 20:21:31.706034 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:21:31.706000 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28pqw\" (UniqueName: \"kubernetes.io/projected/d0a290ee-523e-4b63-a2e2-ac725a72a19c-kube-api-access-28pqw\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 20:21:31.706034 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:21:31.706029 2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0a290ee-523e-4b63-a2e2-ac725a72a19c-dshm\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 20:21:31.706206 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:21:31.706045 2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0a290ee-523e-4b63-a2e2-ac725a72a19c-tls-certs\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 20:21:31.810743 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:21:31.810667 2581 generic.go:356] "Generic (PLEG): container finished" podID="d0a290ee-523e-4b63-a2e2-ac725a72a19c" containerID="06b9bdba396f3cb4ba0f78ccbdf7f015f0458ae13854a1266bcc97ff338aa159" exitCode=0 Jul 21 20:21:31.810743 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:21:31.810709 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd" Jul 21 20:21:31.810957 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:21:31.810757 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd" event={"ID":"d0a290ee-523e-4b63-a2e2-ac725a72a19c","Type":"ContainerDied","Data":"06b9bdba396f3cb4ba0f78ccbdf7f015f0458ae13854a1266bcc97ff338aa159"} Jul 21 20:21:31.810957 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:21:31.810811 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd" event={"ID":"d0a290ee-523e-4b63-a2e2-ac725a72a19c","Type":"ContainerDied","Data":"205ca5832ff8225b547f59b21163cfef6f5c6824aa02396a735186e784a44a16"} Jul 21 20:21:31.810957 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:21:31.810837 2581 scope.go:117] "RemoveContainer" containerID="06b9bdba396f3cb4ba0f78ccbdf7f015f0458ae13854a1266bcc97ff338aa159" Jul 21 20:21:31.819465 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:21:31.819445 2581 scope.go:117] "RemoveContainer" containerID="06b9bdba396f3cb4ba0f78ccbdf7f015f0458ae13854a1266bcc97ff338aa159" Jul 21 20:21:31.819704 ip-10-0-137-5 kubenswrapper[2581]: E0721 20:21:31.819683 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06b9bdba396f3cb4ba0f78ccbdf7f015f0458ae13854a1266bcc97ff338aa159\": container with ID starting with 06b9bdba396f3cb4ba0f78ccbdf7f015f0458ae13854a1266bcc97ff338aa159 not found: ID does not exist" containerID="06b9bdba396f3cb4ba0f78ccbdf7f015f0458ae13854a1266bcc97ff338aa159" Jul 21 20:21:31.819751 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:21:31.819713 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06b9bdba396f3cb4ba0f78ccbdf7f015f0458ae13854a1266bcc97ff338aa159"} err="failed to get container status \"06b9bdba396f3cb4ba0f78ccbdf7f015f0458ae13854a1266bcc97ff338aa159\": rpc error: code = NotFound desc = could not find container \"06b9bdba396f3cb4ba0f78ccbdf7f015f0458ae13854a1266bcc97ff338aa159\": container with ID starting with 06b9bdba396f3cb4ba0f78ccbdf7f015f0458ae13854a1266bcc97ff338aa159 not found: ID does not exist" Jul 21 20:21:31.832244 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:21:31.832224 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd"] Jul 21 20:21:31.835914 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:21:31.835878 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-464ec4/sub-test-model-464ec4-kserve-647f69699f-8dcfd"] Jul 21 20:21:33.534349 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:21:33.534314 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0a290ee-523e-4b63-a2e2-ac725a72a19c" path="/var/lib/kubelet/pods/d0a290ee-523e-4b63-a2e2-ac725a72a19c/volumes" Jul 21 20:22:15.719238 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:15.719166 2581 scope.go:117] "RemoveContainer" containerID="dc86bffed890b90692cb05607fc2e3579c3fd84f1e518cdd3e91ce2b0fb591b0" Jul 21 20:22:21.503914 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:21.503858 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw"] Jul 21 20:22:21.504459 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:21.504429 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0a290ee-523e-4b63-a2e2-ac725a72a19c" containerName="main" Jul 21 20:22:21.504459 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:21.504454 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0a290ee-523e-4b63-a2e2-ac725a72a19c" containerName="main" Jul 21 20:22:21.504631 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:21.504524 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0a290ee-523e-4b63-a2e2-ac725a72a19c" containerName="main" Jul 21 20:22:21.508962 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:21.508944 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw" Jul 21 20:22:21.511884 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:21.511863 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-464ec4\"/\"openshift-service-ca.crt\"" Jul 21 20:22:21.513098 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:21.513074 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-464ec4\"/\"default-dockercfg-jjzk4\"" Jul 21 20:22:21.513098 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:21.513093 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-464ec4\"/\"kube-root-ca.crt\"" Jul 21 20:22:21.513251 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:21.513145 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-464ec4\"/\"rate-test-model-464ec4-kserve-self-signed-certs\"" Jul 21 20:22:21.517918 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:21.517871 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw"] Jul 21 20:22:21.642658 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:21.642611 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e2a4ba6-52e2-4809-a783-d881994f531b-tmp-dir\") pod \"rate-test-model-464ec4-kserve-6568fb79bc-pjnlw\" (UID: \"8e2a4ba6-52e2-4809-a783-d881994f531b\") " pod="ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw" Jul 21 20:22:21.642840 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:21.642668 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e2a4ba6-52e2-4809-a783-d881994f531b-model-cache\") pod \"rate-test-model-464ec4-kserve-6568fb79bc-pjnlw\" (UID: \"8e2a4ba6-52e2-4809-a783-d881994f531b\") " pod="ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw" Jul 21 20:22:21.642840 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:21.642721 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvdc2\" (UniqueName: \"kubernetes.io/projected/8e2a4ba6-52e2-4809-a783-d881994f531b-kube-api-access-wvdc2\") pod \"rate-test-model-464ec4-kserve-6568fb79bc-pjnlw\" (UID: \"8e2a4ba6-52e2-4809-a783-d881994f531b\") " pod="ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw" Jul 21 20:22:21.642840 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:21.642756 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e2a4ba6-52e2-4809-a783-d881994f531b-dshm\") pod \"rate-test-model-464ec4-kserve-6568fb79bc-pjnlw\" (UID: \"8e2a4ba6-52e2-4809-a783-d881994f531b\") " pod="ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw" Jul 21 20:22:21.643044 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:21.642846 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e2a4ba6-52e2-4809-a783-d881994f531b-tls-certs\") pod \"rate-test-model-464ec4-kserve-6568fb79bc-pjnlw\" (UID: \"8e2a4ba6-52e2-4809-a783-d881994f531b\") " pod="ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw" Jul 21 20:22:21.643044 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:21.642951 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e2a4ba6-52e2-4809-a783-d881994f531b-home\") pod \"rate-test-model-464ec4-kserve-6568fb79bc-pjnlw\" (UID: \"8e2a4ba6-52e2-4809-a783-d881994f531b\") " pod="ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw" Jul 21 20:22:21.743916 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:21.743858 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e2a4ba6-52e2-4809-a783-d881994f531b-home\") pod \"rate-test-model-464ec4-kserve-6568fb79bc-pjnlw\" (UID: \"8e2a4ba6-52e2-4809-a783-d881994f531b\") " pod="ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw" Jul 21 20:22:21.744095 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:21.743933 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e2a4ba6-52e2-4809-a783-d881994f531b-tmp-dir\") pod \"rate-test-model-464ec4-kserve-6568fb79bc-pjnlw\" (UID: \"8e2a4ba6-52e2-4809-a783-d881994f531b\") " pod="ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw" Jul 21 20:22:21.744095 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:21.743963 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e2a4ba6-52e2-4809-a783-d881994f531b-model-cache\") pod \"rate-test-model-464ec4-kserve-6568fb79bc-pjnlw\" (UID: \"8e2a4ba6-52e2-4809-a783-d881994f531b\") " pod="ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw" Jul 21 20:22:21.744095 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:21.743986 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvdc2\" (UniqueName: \"kubernetes.io/projected/8e2a4ba6-52e2-4809-a783-d881994f531b-kube-api-access-wvdc2\") pod \"rate-test-model-464ec4-kserve-6568fb79bc-pjnlw\" (UID: \"8e2a4ba6-52e2-4809-a783-d881994f531b\") " pod="ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw" Jul 21 20:22:21.744095 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:21.744013 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e2a4ba6-52e2-4809-a783-d881994f531b-dshm\") pod \"rate-test-model-464ec4-kserve-6568fb79bc-pjnlw\" (UID: \"8e2a4ba6-52e2-4809-a783-d881994f531b\") " pod="ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw" Jul 21 20:22:21.744095 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:21.744046 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e2a4ba6-52e2-4809-a783-d881994f531b-tls-certs\") pod \"rate-test-model-464ec4-kserve-6568fb79bc-pjnlw\" (UID: \"8e2a4ba6-52e2-4809-a783-d881994f531b\") " pod="ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw" Jul 21 20:22:21.744357 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:21.744320 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e2a4ba6-52e2-4809-a783-d881994f531b-home\") pod \"rate-test-model-464ec4-kserve-6568fb79bc-pjnlw\" (UID: \"8e2a4ba6-52e2-4809-a783-d881994f531b\") " pod="ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw" Jul 21 20:22:21.744414 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:21.744362 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e2a4ba6-52e2-4809-a783-d881994f531b-tmp-dir\") pod \"rate-test-model-464ec4-kserve-6568fb79bc-pjnlw\" (UID: \"8e2a4ba6-52e2-4809-a783-d881994f531b\") " pod="ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw" Jul 21 20:22:21.744414 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:21.744389 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e2a4ba6-52e2-4809-a783-d881994f531b-model-cache\") pod \"rate-test-model-464ec4-kserve-6568fb79bc-pjnlw\" (UID: \"8e2a4ba6-52e2-4809-a783-d881994f531b\") " pod="ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw" Jul 21 20:22:21.746275 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:21.746244 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e2a4ba6-52e2-4809-a783-d881994f531b-dshm\") pod \"rate-test-model-464ec4-kserve-6568fb79bc-pjnlw\" (UID: \"8e2a4ba6-52e2-4809-a783-d881994f531b\") " pod="ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw" Jul 21 20:22:21.746513 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:21.746495 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e2a4ba6-52e2-4809-a783-d881994f531b-tls-certs\") pod \"rate-test-model-464ec4-kserve-6568fb79bc-pjnlw\" (UID: \"8e2a4ba6-52e2-4809-a783-d881994f531b\") " pod="ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw" Jul 21 20:22:21.752582 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:21.752561 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvdc2\" (UniqueName: \"kubernetes.io/projected/8e2a4ba6-52e2-4809-a783-d881994f531b-kube-api-access-wvdc2\") pod \"rate-test-model-464ec4-kserve-6568fb79bc-pjnlw\" (UID: \"8e2a4ba6-52e2-4809-a783-d881994f531b\") " pod="ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw" Jul 21 20:22:21.818695 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:21.818622 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw" Jul 21 20:22:21.948990 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:21.948964 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw"] Jul 21 20:22:21.950434 ip-10-0-137-5 kubenswrapper[2581]: W0721 20:22:21.950412 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e2a4ba6_52e2_4809_a783_d881994f531b.slice/crio-9b212dc2154cbe9178177ce04452fb43929cfc55bcd043ceb0a846c368dde54e WatchSource:0}: Error finding container 9b212dc2154cbe9178177ce04452fb43929cfc55bcd043ceb0a846c368dde54e: Status 404 returned error can't find the container with id 9b212dc2154cbe9178177ce04452fb43929cfc55bcd043ceb0a846c368dde54e Jul 21 20:22:22.043939 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:22.043907 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw" event={"ID":"8e2a4ba6-52e2-4809-a783-d881994f531b","Type":"ContainerStarted","Data":"4a98b130dbd4177b31313e9e078a6ae65280aac492b35b40dac5100ed50424f2"} Jul 21 20:22:22.044075 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:22.043950 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw" event={"ID":"8e2a4ba6-52e2-4809-a783-d881994f531b","Type":"ContainerStarted","Data":"9b212dc2154cbe9178177ce04452fb43929cfc55bcd043ceb0a846c368dde54e"} Jul 21 20:22:22.062240 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:22.062191 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw" podStartSLOduration=1.062175713 podStartE2EDuration="1.062175713s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:22:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:22:22.061076817 +0000 UTC m=+2707.021089243" watchObservedRunningTime="2026-07-21 20:22:22.062175713 +0000 UTC m=+2707.022188174" Jul 21 20:22:31.819520 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:31.819488 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw" Jul 21 20:22:31.820034 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:31.819571 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw" Jul 21 20:22:31.832280 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:31.832256 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw" Jul 21 20:22:32.102233 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:22:32.102149 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw" Jul 21 20:23:06.732867 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:06.732830 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw"] Jul 21 20:23:21.753849 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:21.753785 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw" podUID="8e2a4ba6-52e2-4809-a783-d881994f531b" containerName="main" containerID="cri-o://4a98b130dbd4177b31313e9e078a6ae65280aac492b35b40dac5100ed50424f2" gracePeriod=45 Jul 21 20:23:22.002662 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:22.002639 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw" Jul 21 20:23:22.062590 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:22.062525 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e2a4ba6-52e2-4809-a783-d881994f531b-tmp-dir\") pod \"8e2a4ba6-52e2-4809-a783-d881994f531b\" (UID: \"8e2a4ba6-52e2-4809-a783-d881994f531b\") " Jul 21 20:23:22.062590 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:22.062571 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e2a4ba6-52e2-4809-a783-d881994f531b-dshm\") pod \"8e2a4ba6-52e2-4809-a783-d881994f531b\" (UID: \"8e2a4ba6-52e2-4809-a783-d881994f531b\") " Jul 21 20:23:22.062768 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:22.062631 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e2a4ba6-52e2-4809-a783-d881994f531b-home\") pod \"8e2a4ba6-52e2-4809-a783-d881994f531b\" (UID: \"8e2a4ba6-52e2-4809-a783-d881994f531b\") " Jul 21 20:23:22.062768 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:22.062658 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e2a4ba6-52e2-4809-a783-d881994f531b-model-cache\") pod \"8e2a4ba6-52e2-4809-a783-d881994f531b\" (UID: \"8e2a4ba6-52e2-4809-a783-d881994f531b\") " Jul 21 20:23:22.062768 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:22.062675 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvdc2\" (UniqueName: \"kubernetes.io/projected/8e2a4ba6-52e2-4809-a783-d881994f531b-kube-api-access-wvdc2\") pod \"8e2a4ba6-52e2-4809-a783-d881994f531b\" (UID: \"8e2a4ba6-52e2-4809-a783-d881994f531b\") " Jul 21 20:23:22.062768 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:22.062695 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e2a4ba6-52e2-4809-a783-d881994f531b-tls-certs\") pod \"8e2a4ba6-52e2-4809-a783-d881994f531b\" (UID: \"8e2a4ba6-52e2-4809-a783-d881994f531b\") " Jul 21 20:23:22.063012 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:22.062813 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e2a4ba6-52e2-4809-a783-d881994f531b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8e2a4ba6-52e2-4809-a783-d881994f531b" (UID: "8e2a4ba6-52e2-4809-a783-d881994f531b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 20:23:22.063012 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:22.062854 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e2a4ba6-52e2-4809-a783-d881994f531b-home" (OuterVolumeSpecName: "home") pod "8e2a4ba6-52e2-4809-a783-d881994f531b" (UID: "8e2a4ba6-52e2-4809-a783-d881994f531b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 20:23:22.063012 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:22.062962 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e2a4ba6-52e2-4809-a783-d881994f531b-model-cache" (OuterVolumeSpecName: "model-cache") pod "8e2a4ba6-52e2-4809-a783-d881994f531b" (UID: "8e2a4ba6-52e2-4809-a783-d881994f531b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 20:23:22.063153 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:22.063061 2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e2a4ba6-52e2-4809-a783-d881994f531b-tmp-dir\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 20:23:22.063153 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:22.063078 2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e2a4ba6-52e2-4809-a783-d881994f531b-home\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 20:23:22.063153 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:22.063093 2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e2a4ba6-52e2-4809-a783-d881994f531b-model-cache\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 20:23:22.064720 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:22.064694 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e2a4ba6-52e2-4809-a783-d881994f531b-kube-api-access-wvdc2" (OuterVolumeSpecName: "kube-api-access-wvdc2") pod "8e2a4ba6-52e2-4809-a783-d881994f531b" (UID: "8e2a4ba6-52e2-4809-a783-d881994f531b"). InnerVolumeSpecName "kube-api-access-wvdc2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 20:23:22.064720 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:22.064709 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e2a4ba6-52e2-4809-a783-d881994f531b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8e2a4ba6-52e2-4809-a783-d881994f531b" (UID: "8e2a4ba6-52e2-4809-a783-d881994f531b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 20:23:22.064856 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:22.064702 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e2a4ba6-52e2-4809-a783-d881994f531b-dshm" (OuterVolumeSpecName: "dshm") pod "8e2a4ba6-52e2-4809-a783-d881994f531b" (UID: "8e2a4ba6-52e2-4809-a783-d881994f531b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 20:23:22.163831 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:22.163802 2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e2a4ba6-52e2-4809-a783-d881994f531b-dshm\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 20:23:22.163831 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:22.163826 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvdc2\" (UniqueName: \"kubernetes.io/projected/8e2a4ba6-52e2-4809-a783-d881994f531b-kube-api-access-wvdc2\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 20:23:22.164018 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:22.163842 2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e2a4ba6-52e2-4809-a783-d881994f531b-tls-certs\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 20:23:22.329270 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:22.329193 2581 generic.go:356] "Generic (PLEG): container finished" podID="8e2a4ba6-52e2-4809-a783-d881994f531b" containerID="4a98b130dbd4177b31313e9e078a6ae65280aac492b35b40dac5100ed50424f2" exitCode=0 Jul 21 20:23:22.329270 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:22.329232 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw" Jul 21 20:23:22.329270 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:22.329249 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw" event={"ID":"8e2a4ba6-52e2-4809-a783-d881994f531b","Type":"ContainerDied","Data":"4a98b130dbd4177b31313e9e078a6ae65280aac492b35b40dac5100ed50424f2"} Jul 21 20:23:22.329556 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:22.329279 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw" event={"ID":"8e2a4ba6-52e2-4809-a783-d881994f531b","Type":"ContainerDied","Data":"9b212dc2154cbe9178177ce04452fb43929cfc55bcd043ceb0a846c368dde54e"} Jul 21 20:23:22.329556 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:22.329296 2581 scope.go:117] "RemoveContainer" containerID="4a98b130dbd4177b31313e9e078a6ae65280aac492b35b40dac5100ed50424f2" Jul 21 20:23:22.337949 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:22.337934 2581 scope.go:117] "RemoveContainer" containerID="4a98b130dbd4177b31313e9e078a6ae65280aac492b35b40dac5100ed50424f2" Jul 21 20:23:22.338193 ip-10-0-137-5 kubenswrapper[2581]: E0721 20:23:22.338175 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a98b130dbd4177b31313e9e078a6ae65280aac492b35b40dac5100ed50424f2\": container with ID starting with 4a98b130dbd4177b31313e9e078a6ae65280aac492b35b40dac5100ed50424f2 not found: ID does not exist" containerID="4a98b130dbd4177b31313e9e078a6ae65280aac492b35b40dac5100ed50424f2" Jul 21 20:23:22.338242 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:22.338200 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a98b130dbd4177b31313e9e078a6ae65280aac492b35b40dac5100ed50424f2"} err="failed to get container status \"4a98b130dbd4177b31313e9e078a6ae65280aac492b35b40dac5100ed50424f2\": rpc error: code = NotFound desc = could not find container \"4a98b130dbd4177b31313e9e078a6ae65280aac492b35b40dac5100ed50424f2\": container with ID starting with 4a98b130dbd4177b31313e9e078a6ae65280aac492b35b40dac5100ed50424f2 not found: ID does not exist" Jul 21 20:23:22.351118 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:22.351091 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw"] Jul 21 20:23:22.356711 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:22.356693 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-464ec4/rate-test-model-464ec4-kserve-6568fb79bc-pjnlw"] Jul 21 20:23:23.535370 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:23.535336 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e2a4ba6-52e2-4809-a783-d881994f531b" path="/var/lib/kubelet/pods/8e2a4ba6-52e2-4809-a783-d881994f531b/volumes" Jul 21 20:23:26.628520 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:26.628490 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-065403-24hzs"] Jul 21 20:23:26.628879 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:26.628858 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e2a4ba6-52e2-4809-a783-d881994f531b" containerName="main" Jul 21 20:23:26.628879 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:26.628869 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e2a4ba6-52e2-4809-a783-d881994f531b" containerName="main" Jul 21 20:23:26.628995 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:26.628952 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e2a4ba6-52e2-4809-a783-d881994f531b" containerName="main" Jul 21 20:23:26.632147 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:26.632126 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-065403-24hzs" Jul 21 20:23:26.634681 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:26.634666 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gbjhg\"" Jul 21 20:23:26.638415 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:26.638390 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-065403-24hzs"] Jul 21 20:23:26.700544 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:26.700513 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aebda854-3a5f-48a7-8461-497f1dbb8c2d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-065403-24hzs\" (UID: \"aebda854-3a5f-48a7-8461-497f1dbb8c2d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-065403-24hzs" Jul 21 20:23:26.801176 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:26.801149 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aebda854-3a5f-48a7-8461-497f1dbb8c2d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-065403-24hzs\" (UID: \"aebda854-3a5f-48a7-8461-497f1dbb8c2d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-065403-24hzs" Jul 21 20:23:26.801733 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:26.801712 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aebda854-3a5f-48a7-8461-497f1dbb8c2d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-065403-24hzs\" (UID: \"aebda854-3a5f-48a7-8461-497f1dbb8c2d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-065403-24hzs" Jul 21 20:23:26.945328 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:26.945255 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-065403-24hzs" Jul 21 20:23:27.283864 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:27.283841 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-065403-24hzs"] Jul 21 20:23:27.286239 ip-10-0-137-5 kubenswrapper[2581]: W0721 20:23:27.286203 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaebda854_3a5f_48a7_8461_497f1dbb8c2d.slice/crio-a5025785d98a493f94d49c70a441f1218e70a33e76dda8b5624efba76500d7a8 WatchSource:0}: Error finding container a5025785d98a493f94d49c70a441f1218e70a33e76dda8b5624efba76500d7a8: Status 404 returned error can't find the container with id a5025785d98a493f94d49c70a441f1218e70a33e76dda8b5624efba76500d7a8 Jul 21 20:23:27.354985 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:27.354955 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-065403-24hzs" event={"ID":"aebda854-3a5f-48a7-8461-497f1dbb8c2d","Type":"ContainerStarted","Data":"a5025785d98a493f94d49c70a441f1218e70a33e76dda8b5624efba76500d7a8"} Jul 21 20:23:28.360978 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:28.360940 2581 generic.go:356] "Generic (PLEG): container finished" podID="aebda854-3a5f-48a7-8461-497f1dbb8c2d" containerID="9e061dee62230bf62571769395869633b009f6b6606b160190a1d80c4738a2da" exitCode=0 Jul 21 20:23:28.361361 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:28.361029 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-065403-24hzs" event={"ID":"aebda854-3a5f-48a7-8461-497f1dbb8c2d","Type":"ContainerDied","Data":"9e061dee62230bf62571769395869633b009f6b6606b160190a1d80c4738a2da"} Jul 21 20:23:29.494402 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:29.494381 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-065403-24hzs" Jul 21 20:23:29.525735 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:29.525709 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aebda854-3a5f-48a7-8461-497f1dbb8c2d-maas-api-service-ca\") pod \"aebda854-3a5f-48a7-8461-497f1dbb8c2d\" (UID: \"aebda854-3a5f-48a7-8461-497f1dbb8c2d\") " Jul 21 20:23:29.526169 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:29.526146 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aebda854-3a5f-48a7-8461-497f1dbb8c2d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "aebda854-3a5f-48a7-8461-497f1dbb8c2d" (UID: "aebda854-3a5f-48a7-8461-497f1dbb8c2d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 20:23:29.626858 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:29.626796 2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aebda854-3a5f-48a7-8461-497f1dbb8c2d-maas-api-service-ca\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 20:23:30.372133 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:30.372108 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-065403-24hzs" Jul 21 20:23:30.372366 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:30.372106 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-065403-24hzs" event={"ID":"aebda854-3a5f-48a7-8461-497f1dbb8c2d","Type":"ContainerDied","Data":"a5025785d98a493f94d49c70a441f1218e70a33e76dda8b5624efba76500d7a8"} Jul 21 20:23:30.372493 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:30.372395 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a5025785d98a493f94d49c70a441f1218e70a33e76dda8b5624efba76500d7a8" Jul 21 20:23:41.726350 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:41.726264 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-065403-24hzs"] Jul 21 20:23:41.728321 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:41.728296 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-065403-24hzs"] Jul 21 20:23:43.533604 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:43.533574 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aebda854-3a5f-48a7-8461-497f1dbb8c2d" path="/var/lib/kubelet/pods/aebda854-3a5f-48a7-8461-497f1dbb8c2d/volumes" Jul 21 20:23:49.120711 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:49.120676 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-464ec4-l85g4"] Jul 21 20:23:49.121158 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:49.121114 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aebda854-3a5f-48a7-8461-497f1dbb8c2d" containerName="revoke-keys" Jul 21 20:23:49.121158 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:49.121128 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="aebda854-3a5f-48a7-8461-497f1dbb8c2d" containerName="revoke-keys" Jul 21 20:23:49.121277 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:49.121197 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="aebda854-3a5f-48a7-8461-497f1dbb8c2d" containerName="revoke-keys" Jul 21 20:23:49.124528 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:49.124510 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-464ec4-l85g4" Jul 21 20:23:49.127134 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:49.127116 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gbjhg\"" Jul 21 20:23:49.132258 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:49.132233 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-464ec4-l85g4"] Jul 21 20:23:49.199730 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:49.199690 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/024d49c2-c955-4456-a600-2620b1111053-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-464ec4-l85g4\" (UID: \"024d49c2-c955-4456-a600-2620b1111053\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-464ec4-l85g4" Jul 21 20:23:49.300474 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:49.300442 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/024d49c2-c955-4456-a600-2620b1111053-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-464ec4-l85g4\" (UID: \"024d49c2-c955-4456-a600-2620b1111053\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-464ec4-l85g4" Jul 21 20:23:49.301160 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:49.301140 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/024d49c2-c955-4456-a600-2620b1111053-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-464ec4-l85g4\" (UID: \"024d49c2-c955-4456-a600-2620b1111053\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-464ec4-l85g4" Jul 21 20:23:49.435271 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:49.435197 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-464ec4-l85g4" Jul 21 20:23:49.575013 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:49.574834 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-464ec4-l85g4"] Jul 21 20:23:49.577743 ip-10-0-137-5 kubenswrapper[2581]: W0721 20:23:49.577712 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod024d49c2_c955_4456_a600_2620b1111053.slice/crio-5e1565e9e168e8f70d5e4d55194d7b45ee1e854df0eed2e4f864d8394819fccc WatchSource:0}: Error finding container 5e1565e9e168e8f70d5e4d55194d7b45ee1e854df0eed2e4f864d8394819fccc: Status 404 returned error can't find the container with id 5e1565e9e168e8f70d5e4d55194d7b45ee1e854df0eed2e4f864d8394819fccc Jul 21 20:23:50.467165 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:50.467131 2581 generic.go:356] "Generic (PLEG): container finished" podID="024d49c2-c955-4456-a600-2620b1111053" containerID="5c14b57582ff672211473433e551c2ea69e9d632d407e3ca08864e39cfebc3d0" exitCode=0 Jul 21 20:23:50.467520 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:50.467211 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-464ec4-l85g4" event={"ID":"024d49c2-c955-4456-a600-2620b1111053","Type":"ContainerDied","Data":"5c14b57582ff672211473433e551c2ea69e9d632d407e3ca08864e39cfebc3d0"} Jul 21 20:23:50.467520 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:50.467288 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-464ec4-l85g4" event={"ID":"024d49c2-c955-4456-a600-2620b1111053","Type":"ContainerStarted","Data":"5e1565e9e168e8f70d5e4d55194d7b45ee1e854df0eed2e4f864d8394819fccc"} Jul 21 20:23:51.602344 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:51.602320 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-464ec4-l85g4" Jul 21 20:23:51.718992 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:51.718957 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/024d49c2-c955-4456-a600-2620b1111053-maas-api-service-ca\") pod \"024d49c2-c955-4456-a600-2620b1111053\" (UID: \"024d49c2-c955-4456-a600-2620b1111053\") " Jul 21 20:23:51.719290 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:51.719268 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/024d49c2-c955-4456-a600-2620b1111053-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "024d49c2-c955-4456-a600-2620b1111053" (UID: "024d49c2-c955-4456-a600-2620b1111053"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 20:23:51.820054 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:51.820017 2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/024d49c2-c955-4456-a600-2620b1111053-maas-api-service-ca\") on node \"ip-10-0-137-5.ec2.internal\" DevicePath \"\"" Jul 21 20:23:52.476911 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:52.476865 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-464ec4-l85g4" Jul 21 20:23:52.477079 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:52.476928 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-464ec4-l85g4" event={"ID":"024d49c2-c955-4456-a600-2620b1111053","Type":"ContainerDied","Data":"5e1565e9e168e8f70d5e4d55194d7b45ee1e854df0eed2e4f864d8394819fccc"} Jul 21 20:23:52.477079 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:23:52.476972 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e1565e9e168e8f70d5e4d55194d7b45ee1e854df0eed2e4f864d8394819fccc" Jul 21 20:24:04.197508 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:04.197472 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-464ec4-l85g4"] Jul 21 20:24:04.200035 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:04.200011 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-464ec4-l85g4"] Jul 21 20:24:05.534478 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:05.534445 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="024d49c2-c955-4456-a600-2620b1111053" path="/var/lib/kubelet/pods/024d49c2-c955-4456-a600-2620b1111053/volumes" Jul 21 20:24:11.407052 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:11.407019 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-795ff4495d-nxbnf_e03aa232-029a-4c6f-8410-d2b857463190/authorino/0.log" Jul 21 20:24:17.991452 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:17.991415 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f74b88589-mqh4z_0c59ba46-4c1a-456e-8652-fa0755666e19/manager/0.log" Jul 21 20:24:17.999978 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:17.999960 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f74b88589-mqh4z_0c59ba46-4c1a-456e-8652-fa0755666e19/copy-manifests/0.log" Jul 21 20:24:18.893762 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:18.893732 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-9pwp8_32625a43-85a6-4632-a6ee-7e8a8174007c/postgres/0.log" Jul 21 20:24:20.257234 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:20.257198 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-795ff4495d-nxbnf_e03aa232-029a-4c6f-8410-d2b857463190/authorino/0.log" Jul 21 20:24:20.616669 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:20.616600 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-x8qrl_a1c983f4-752e-4516-bea3-32208ba90872/kuadrant-console-plugin/0.log" Jul 21 20:24:21.918847 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:21.918815 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7db7f7c8d6-m29dt_7c3c1e0f-96a1-4f73-b4b6-2a7c01044873/kube-auth-proxy/0.log" Jul 21 20:24:22.173019 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:22.172942 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-sw49t_4667253c-46b9-4dc7-a4e0-3ce04a17910e/payload-pre-processing/0.log" Jul 21 20:24:22.296398 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:22.296373 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-84sqw_d1d874d7-1da8-432c-9b9b-c1e32e35509e/payload-processing/0.log" Jul 21 20:24:22.792390 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:22.792360 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-qj2q4_4b2154fa-d62a-4972-9fbd-666d149a5cab/main/0.log" Jul 21 20:24:23.048706 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:23.048632 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-vvwhv_5c7c1507-9864-4026-bab9-e22ca5c2ee95/main/0.log" Jul 21 20:24:32.271243 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:32.271205 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-q9g56_dfb82dd4-3122-4ebb-aabc-84682403809d/global-pull-secret-syncer/0.log" Jul 21 20:24:32.432907 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:32.432865 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kxpcf_acc2e902-5de8-4233-8a76-1b41791e088f/konnectivity-agent/0.log" Jul 21 20:24:32.520349 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:32.520320 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-5.ec2.internal_bde857cbb1c0b9ad930985637a279229/haproxy/0.log" Jul 21 20:24:37.263550 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:37.263517 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-795ff4495d-nxbnf_e03aa232-029a-4c6f-8410-d2b857463190/authorino/0.log" Jul 21 20:24:37.366745 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:37.366716 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-x8qrl_a1c983f4-752e-4516-bea3-32208ba90872/kuadrant-console-plugin/0.log" Jul 21 20:24:39.292711 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:39.292681 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9c60c579-8121-4947-9ccd-1dc39341ec56/alertmanager/0.log" Jul 21 20:24:39.316990 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:39.316966 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9c60c579-8121-4947-9ccd-1dc39341ec56/config-reloader/0.log" Jul 21 20:24:39.366425 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:39.366353 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9c60c579-8121-4947-9ccd-1dc39341ec56/kube-rbac-proxy-web/0.log" Jul 21 20:24:39.390983 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:39.390960 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9c60c579-8121-4947-9ccd-1dc39341ec56/kube-rbac-proxy/0.log" Jul 21 20:24:39.413466 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:39.413448 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9c60c579-8121-4947-9ccd-1dc39341ec56/kube-rbac-proxy-metric/0.log" Jul 21 20:24:39.436090 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:39.436071 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9c60c579-8121-4947-9ccd-1dc39341ec56/prom-label-proxy/0.log" Jul 21 20:24:39.468717 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:39.468694 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9c60c579-8121-4947-9ccd-1dc39341ec56/init-config-reloader/0.log" Jul 21 20:24:39.509714 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:39.509689 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-khzjj_6d039d3e-3f40-42d1-ba6e-8d2689b93aee/cluster-monitoring-operator/0.log" Jul 21 20:24:39.558429 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:39.558404 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-rzrhp_539150a9-fc2d-4bd2-ad45-0f485ede80ef/kube-state-metrics/0.log" Jul 21 20:24:39.578282 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:39.578244 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-rzrhp_539150a9-fc2d-4bd2-ad45-0f485ede80ef/kube-rbac-proxy-main/0.log" Jul 21 20:24:39.604114 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:39.604061 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-rzrhp_539150a9-fc2d-4bd2-ad45-0f485ede80ef/kube-rbac-proxy-self/0.log" Jul 21 20:24:39.849278 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:39.849249 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rks8q_980db5a5-ca83-4603-8408-40169686abc2/node-exporter/0.log" Jul 21 20:24:39.871313 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:39.871292 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rks8q_980db5a5-ca83-4603-8408-40169686abc2/kube-rbac-proxy/0.log" Jul 21 20:24:39.890599 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:39.890584 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rks8q_980db5a5-ca83-4603-8408-40169686abc2/init-textfile/0.log" Jul 21 20:24:39.918738 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:39.918716 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-5wzgw_53364f5c-6e45-469d-9869-b8455fa40af5/kube-rbac-proxy-main/0.log" Jul 21 20:24:39.938675 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:39.938639 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-5wzgw_53364f5c-6e45-469d-9869-b8455fa40af5/kube-rbac-proxy-self/0.log" Jul 21 20:24:39.958109 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:39.958089 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-5wzgw_53364f5c-6e45-469d-9869-b8455fa40af5/openshift-state-metrics/0.log" Jul 21 20:24:40.005445 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:40.005424 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_210b4174-7e76-4e8d-90c6-537f472d5a4b/prometheus/0.log" Jul 21 20:24:40.026317 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:40.026299 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_210b4174-7e76-4e8d-90c6-537f472d5a4b/config-reloader/0.log" Jul 21 20:24:40.044784 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:40.044761 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_210b4174-7e76-4e8d-90c6-537f472d5a4b/thanos-sidecar/0.log" Jul 21 20:24:40.064845 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:40.064815 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_210b4174-7e76-4e8d-90c6-537f472d5a4b/kube-rbac-proxy-web/0.log" Jul 21 20:24:40.083176 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:40.083102 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_210b4174-7e76-4e8d-90c6-537f472d5a4b/kube-rbac-proxy/0.log" Jul 21 20:24:40.101822 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:40.101804 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_210b4174-7e76-4e8d-90c6-537f472d5a4b/kube-rbac-proxy-thanos/0.log" Jul 21 20:24:40.123237 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:40.123220 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_210b4174-7e76-4e8d-90c6-537f472d5a4b/init-config-reloader/0.log" Jul 21 20:24:40.218228 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:40.218200 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8f5d459fb-6tl5k_7f54a745-6b4d-4961-afbe-a8578b9cddab/telemeter-client/0.log" Jul 21 20:24:40.239683 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:40.239657 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8f5d459fb-6tl5k_7f54a745-6b4d-4961-afbe-a8578b9cddab/reload/0.log" Jul 21 20:24:40.259177 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:40.259135 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8f5d459fb-6tl5k_7f54a745-6b4d-4961-afbe-a8578b9cddab/kube-rbac-proxy/0.log" Jul 21 20:24:42.549440 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:42.549409 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cvhf7/perf-node-gather-daemonset-kpvx7"] Jul 21 20:24:42.549803 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:42.549757 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="024d49c2-c955-4456-a600-2620b1111053" containerName="revoke-keys" Jul 21 20:24:42.549803 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:42.549768 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="024d49c2-c955-4456-a600-2620b1111053" containerName="revoke-keys" Jul 21 20:24:42.549872 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:42.549843 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="024d49c2-c955-4456-a600-2620b1111053" containerName="revoke-keys" Jul 21 20:24:42.554021 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:42.554006 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-kpvx7" Jul 21 20:24:42.557649 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:42.557623 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cvhf7\"/\"openshift-service-ca.crt\"" Jul 21 20:24:42.557761 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:42.557715 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-cvhf7\"/\"default-dockercfg-mzxhw\"" Jul 21 20:24:42.558708 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:42.558690 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cvhf7\"/\"kube-root-ca.crt\"" Jul 21 20:24:42.563677 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:42.563652 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cvhf7/perf-node-gather-daemonset-kpvx7"] Jul 21 20:24:42.656069 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:42.656038 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc763e0d-1e9c-4343-add3-64a13b02af58-sys\") pod \"perf-node-gather-daemonset-kpvx7\" (UID: \"cc763e0d-1e9c-4343-add3-64a13b02af58\") " pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-kpvx7" Jul 21 20:24:42.656248 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:42.656077 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc763e0d-1e9c-4343-add3-64a13b02af58-proc\") pod \"perf-node-gather-daemonset-kpvx7\" (UID: \"cc763e0d-1e9c-4343-add3-64a13b02af58\") " pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-kpvx7" Jul 21 20:24:42.656248 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:42.656103 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc763e0d-1e9c-4343-add3-64a13b02af58-lib-modules\") pod \"perf-node-gather-daemonset-kpvx7\" (UID: \"cc763e0d-1e9c-4343-add3-64a13b02af58\") " pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-kpvx7" Jul 21 20:24:42.656248 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:42.656190 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc763e0d-1e9c-4343-add3-64a13b02af58-podres\") pod \"perf-node-gather-daemonset-kpvx7\" (UID: \"cc763e0d-1e9c-4343-add3-64a13b02af58\") " pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-kpvx7" Jul 21 20:24:42.656419 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:42.656300 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-455tb\" (UniqueName: \"kubernetes.io/projected/cc763e0d-1e9c-4343-add3-64a13b02af58-kube-api-access-455tb\") pod \"perf-node-gather-daemonset-kpvx7\" (UID: \"cc763e0d-1e9c-4343-add3-64a13b02af58\") " pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-kpvx7" Jul 21 20:24:42.757427 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:42.757395 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc763e0d-1e9c-4343-add3-64a13b02af58-podres\") pod \"perf-node-gather-daemonset-kpvx7\" (UID: \"cc763e0d-1e9c-4343-add3-64a13b02af58\") " pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-kpvx7" Jul 21 20:24:42.757613 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:42.757445 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-455tb\" (UniqueName: \"kubernetes.io/projected/cc763e0d-1e9c-4343-add3-64a13b02af58-kube-api-access-455tb\") pod \"perf-node-gather-daemonset-kpvx7\" (UID: \"cc763e0d-1e9c-4343-add3-64a13b02af58\") " pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-kpvx7" Jul 21 20:24:42.757613 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:42.757488 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc763e0d-1e9c-4343-add3-64a13b02af58-sys\") pod \"perf-node-gather-daemonset-kpvx7\" (UID: \"cc763e0d-1e9c-4343-add3-64a13b02af58\") " pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-kpvx7" Jul 21 20:24:42.757613 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:42.757506 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc763e0d-1e9c-4343-add3-64a13b02af58-proc\") pod \"perf-node-gather-daemonset-kpvx7\" (UID: \"cc763e0d-1e9c-4343-add3-64a13b02af58\") " pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-kpvx7" Jul 21 20:24:42.757613 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:42.757523 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc763e0d-1e9c-4343-add3-64a13b02af58-lib-modules\") pod \"perf-node-gather-daemonset-kpvx7\" (UID: \"cc763e0d-1e9c-4343-add3-64a13b02af58\") " pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-kpvx7" Jul 21 20:24:42.757613 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:42.757593 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc763e0d-1e9c-4343-add3-64a13b02af58-podres\") pod \"perf-node-gather-daemonset-kpvx7\" (UID: \"cc763e0d-1e9c-4343-add3-64a13b02af58\") " pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-kpvx7" Jul 21 20:24:42.757613 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:42.757609 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc763e0d-1e9c-4343-add3-64a13b02af58-proc\") pod \"perf-node-gather-daemonset-kpvx7\" (UID: \"cc763e0d-1e9c-4343-add3-64a13b02af58\") " pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-kpvx7" Jul 21 20:24:42.757828 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:42.757593 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc763e0d-1e9c-4343-add3-64a13b02af58-sys\") pod \"perf-node-gather-daemonset-kpvx7\" (UID: \"cc763e0d-1e9c-4343-add3-64a13b02af58\") " pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-kpvx7" Jul 21 20:24:42.757828 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:42.757636 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc763e0d-1e9c-4343-add3-64a13b02af58-lib-modules\") pod \"perf-node-gather-daemonset-kpvx7\" (UID: \"cc763e0d-1e9c-4343-add3-64a13b02af58\") " pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-kpvx7" Jul 21 20:24:42.766577 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:42.766554 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-455tb\" (UniqueName: \"kubernetes.io/projected/cc763e0d-1e9c-4343-add3-64a13b02af58-kube-api-access-455tb\") pod \"perf-node-gather-daemonset-kpvx7\" (UID: \"cc763e0d-1e9c-4343-add3-64a13b02af58\") " pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-kpvx7" Jul 21 20:24:42.783990 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:42.783966 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-4fk66_82871ec4-5735-4674-8938-338a3bdc268e/download-server/0.log" Jul 21 20:24:42.864382 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:42.864318 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-kpvx7" Jul 21 20:24:42.996461 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:42.996430 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cvhf7/perf-node-gather-daemonset-kpvx7"] Jul 21 20:24:42.999596 ip-10-0-137-5 kubenswrapper[2581]: W0721 20:24:42.999567 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcc763e0d_1e9c_4343_add3_64a13b02af58.slice/crio-40a635fdf2cac38c7f9195ce310620e36fa2116add1a1530a2ab99bca7fff8f8 WatchSource:0}: Error finding container 40a635fdf2cac38c7f9195ce310620e36fa2116add1a1530a2ab99bca7fff8f8: Status 404 returned error can't find the container with id 40a635fdf2cac38c7f9195ce310620e36fa2116add1a1530a2ab99bca7fff8f8 Jul 21 20:24:43.492905 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:43.492867 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-pzvw2_d9dc2253-8393-4e58-b8a7-9eec02a3ff95/volume-data-source-validator/0.log" Jul 21 20:24:43.725622 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:43.725577 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-kpvx7" event={"ID":"cc763e0d-1e9c-4343-add3-64a13b02af58","Type":"ContainerStarted","Data":"8a55fc1357292377f40d5a9c76e2a4231dced7f4a133dd770826deeb72512e28"} Jul 21 20:24:43.726074 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:43.725635 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-kpvx7" Jul 21 20:24:43.726074 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:43.725652 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-kpvx7" event={"ID":"cc763e0d-1e9c-4343-add3-64a13b02af58","Type":"ContainerStarted","Data":"40a635fdf2cac38c7f9195ce310620e36fa2116add1a1530a2ab99bca7fff8f8"} Jul 21 20:24:43.746252 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:43.746166 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-kpvx7" podStartSLOduration=1.746150361 podStartE2EDuration="1.746150361s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:24:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:24:43.744103616 +0000 UTC m=+2848.704116050" watchObservedRunningTime="2026-07-21 20:24:43.746150361 +0000 UTC m=+2848.706162795" Jul 21 20:24:44.535001 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:44.534971 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pgd57_a044c778-bc03-453d-829e-dfb6cca7e844/dns/0.log" Jul 21 20:24:44.554979 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:44.554957 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pgd57_a044c778-bc03-453d-829e-dfb6cca7e844/kube-rbac-proxy/0.log" Jul 21 20:24:44.619136 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:44.619112 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6w4zf_926ad8ee-c7f6-43c8-bf81-908b8e6824a8/dns-node-resolver/0.log" Jul 21 20:24:45.233014 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:45.232987 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g8vsp_8ac4304f-d17a-4a74-aacb-1f47fd557e74/node-ca/0.log" Jul 21 20:24:46.438453 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:46.438421 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7db7f7c8d6-m29dt_7c3c1e0f-96a1-4f73-b4b6-2a7c01044873/kube-auth-proxy/0.log" Jul 21 20:24:46.530632 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:46.530606 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-sw49t_4667253c-46b9-4dc7-a4e0-3ce04a17910e/payload-pre-processing/0.log" Jul 21 20:24:46.558661 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:46.558642 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-84sqw_d1d874d7-1da8-432c-9b9b-c1e32e35509e/payload-processing/0.log" Jul 21 20:24:47.342848 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:47.342818 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wsmxp_8e6be3ee-b04a-4428-82b5-a37cbd6d0e84/serve-healthcheck-canary/0.log" Jul 21 20:24:48.024462 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:48.024434 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z4wl4_21fbc355-5f0b-495a-bb69-38730c31a5b2/kube-rbac-proxy/0.log" Jul 21 20:24:48.051367 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:48.051341 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z4wl4_21fbc355-5f0b-495a-bb69-38730c31a5b2/exporter/0.log" Jul 21 20:24:48.085687 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:48.085663 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z4wl4_21fbc355-5f0b-495a-bb69-38730c31a5b2/extractor/0.log" Jul 21 20:24:49.740575 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:49.740548 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-kpvx7" Jul 21 20:24:50.930862 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:50.930830 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f74b88589-mqh4z_0c59ba46-4c1a-456e-8652-fa0755666e19/manager/0.log" Jul 21 20:24:50.961444 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:50.961425 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f74b88589-mqh4z_0c59ba46-4c1a-456e-8652-fa0755666e19/copy-manifests/0.log" Jul 21 20:24:52.356411 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:52.356383 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-bc6b5d4fd-hf27m_8f09c827-c7c6-4323-af77-2cac4da9ef3a/manager/0.log" Jul 21 20:24:52.407439 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:52.407412 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-tgf55_d30a5a0f-85e0-46e0-9e31-2dbf5d1c4636/openshift-lws-operator/0.log" Jul 21 20:24:52.964745 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:52.964672 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7db7f7c8d6-m29dt_7c3c1e0f-96a1-4f73-b4b6-2a7c01044873/kube-auth-proxy/0.log" Jul 21 20:24:53.052031 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:53.052004 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-sw49t_4667253c-46b9-4dc7-a4e0-3ce04a17910e/payload-pre-processing/0.log" Jul 21 20:24:53.071682 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:53.071658 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-84sqw_d1d874d7-1da8-432c-9b9b-c1e32e35509e/payload-processing/0.log" Jul 21 20:24:54.650235 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:54.650204 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7db7f7c8d6-m29dt_7c3c1e0f-96a1-4f73-b4b6-2a7c01044873/kube-auth-proxy/0.log" Jul 21 20:24:54.730400 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:54.730372 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-sw49t_4667253c-46b9-4dc7-a4e0-3ce04a17910e/payload-pre-processing/0.log" Jul 21 20:24:54.757186 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:54.757164 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-84sqw_d1d874d7-1da8-432c-9b9b-c1e32e35509e/payload-processing/0.log" Jul 21 20:24:57.715225 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:57.715194 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-9n6fd_6a13e076-b654-40d1-a489-605fc65d73c7/migrator/0.log" Jul 21 20:24:57.737852 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:57.737825 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-9n6fd_6a13e076-b654-40d1-a489-605fc65d73c7/graceful-termination/0.log" Jul 21 20:24:59.132110 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:59.132082 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5m4hj_def7fd0e-546e-453b-ab49-665ae20835fe/kube-multus/0.log" Jul 21 20:24:59.159648 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:59.159629 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2nv6g_f45d30e4-e0ba-4f2c-a765-d2f56fad780f/kube-multus-additional-cni-plugins/0.log" Jul 21 20:24:59.183247 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:59.183227 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2nv6g_f45d30e4-e0ba-4f2c-a765-d2f56fad780f/egress-router-binary-copy/0.log" Jul 21 20:24:59.204218 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:59.204195 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2nv6g_f45d30e4-e0ba-4f2c-a765-d2f56fad780f/cni-plugins/0.log" Jul 21 20:24:59.227622 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:59.227604 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2nv6g_f45d30e4-e0ba-4f2c-a765-d2f56fad780f/bond-cni-plugin/0.log" Jul 21 20:24:59.250562 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:59.250544 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2nv6g_f45d30e4-e0ba-4f2c-a765-d2f56fad780f/routeoverride-cni/0.log" Jul 21 20:24:59.275753 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:59.275729 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2nv6g_f45d30e4-e0ba-4f2c-a765-d2f56fad780f/whereabouts-cni-bincopy/0.log" Jul 21 20:24:59.298177 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:59.298163 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2nv6g_f45d30e4-e0ba-4f2c-a765-d2f56fad780f/whereabouts-cni/0.log" Jul 21 20:24:59.823473 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:59.823402 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wzkph_f593837e-f6e2-4b42-aa46-5dbee27cf83a/network-metrics-daemon/0.log" Jul 21 20:24:59.858101 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:24:59.858080 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wzkph_f593837e-f6e2-4b42-aa46-5dbee27cf83a/kube-rbac-proxy/0.log" Jul 21 20:25:01.187159 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:25:01.187129 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gnxn2_12196bd5-b229-4551-9e02-9c040af87b59/ovn-controller/0.log" Jul 21 20:25:01.213070 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:25:01.213041 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gnxn2_12196bd5-b229-4551-9e02-9c040af87b59/ovn-acl-logging/0.log" Jul 21 20:25:01.244987 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:25:01.244959 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gnxn2_12196bd5-b229-4551-9e02-9c040af87b59/kube-rbac-proxy-node/0.log" Jul 21 20:25:01.272276 ip-10-0-137-5 kubenswrapper[2581]: I0721 20:25:01.272241 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gnxn2_12196bd5-b229-4551-9e02-9c040af87b59/kube-rbac-proxy-ovn-metrics/0.log"