Jul 24 12:15:06.314585 ip-10-0-139-109 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 24 12:15:06.314597 ip-10-0-139-109 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 24 12:15:06.314607 ip-10-0-139-109 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 24 12:15:06.314917 ip-10-0-139-109 systemd[1]: Failed to start Kubernetes Kubelet. Jul 24 12:15:15.865066 ip-10-0-139-109 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jul 24 12:15:15.865084 ip-10-0-139-109 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 5f4b64fb533c42e5b14d0a47ee0f0ed1 -- Jul 24 12:16:45.636616 ip-10-0-139-109 systemd[1]: Starting Kubernetes Kubelet... Jul 24 12:16:46.028899 ip-10-0-139-109 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 12:16:46.028899 ip-10-0-139-109 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 24 12:16:46.028899 ip-10-0-139-109 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 12:16:46.028899 ip-10-0-139-109 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 24 12:16:46.028899 ip-10-0-139-109 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 12:16:46.030455 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.030370 2555 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 24 12:16:46.036065 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036045 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 12:16:46.036065 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036065 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 12:16:46.036143 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036068 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 12:16:46.036143 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036071 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 12:16:46.036143 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036077 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 12:16:46.036143 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036081 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 12:16:46.036143 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036084 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 12:16:46.036143 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036087 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 12:16:46.036143 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036090 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 12:16:46.036143 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036093 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 12:16:46.036143 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036096 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 12:16:46.036143 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036104 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 12:16:46.036143 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036107 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 12:16:46.036143 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036111 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 12:16:46.036143 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036115 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 12:16:46.036143 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036118 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 12:16:46.036143 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036121 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 12:16:46.036143 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036124 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 12:16:46.036143 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036126 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 12:16:46.036143 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036129 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 12:16:46.036143 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036132 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 12:16:46.036647 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036134 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 12:16:46.036647 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036137 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 12:16:46.036647 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036139 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 12:16:46.036647 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036142 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 12:16:46.036647 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036145 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 12:16:46.036647 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036148 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 12:16:46.036647 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036151 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 12:16:46.036647 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036154 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 12:16:46.036647 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036156 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 12:16:46.036647 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036159 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 12:16:46.036647 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036162 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 12:16:46.036647 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036164 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 12:16:46.036647 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036167 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 12:16:46.036647 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036170 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 12:16:46.036647 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036172 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 12:16:46.036647 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036175 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 12:16:46.036647 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036177 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 12:16:46.036647 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036181 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 12:16:46.036647 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036183 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 12:16:46.036647 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036186 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 12:16:46.037128 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036188 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 12:16:46.037128 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036191 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 12:16:46.037128 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036193 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 12:16:46.037128 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036195 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 12:16:46.037128 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036198 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 12:16:46.037128 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036200 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 12:16:46.037128 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036203 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 12:16:46.037128 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036205 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 12:16:46.037128 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036208 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 12:16:46.037128 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036210 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 12:16:46.037128 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036213 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 12:16:46.037128 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036215 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 12:16:46.037128 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036217 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 12:16:46.037128 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036220 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 12:16:46.037128 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036223 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 12:16:46.037128 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036226 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 12:16:46.037128 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036228 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 12:16:46.037128 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036231 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 12:16:46.037128 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036234 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 12:16:46.037128 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036236 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 12:16:46.037650 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036239 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 24 12:16:46.037650 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036241 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 12:16:46.037650 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036246 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 12:16:46.037650 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036249 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 12:16:46.037650 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036252 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 12:16:46.037650 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036255 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 12:16:46.037650 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036257 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 12:16:46.037650 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036260 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 12:16:46.037650 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036263 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 12:16:46.037650 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036266 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 12:16:46.037650 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036270 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 12:16:46.037650 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036273 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 12:16:46.037650 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036276 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 12:16:46.037650 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036280 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 12:16:46.037650 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036283 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 12:16:46.037650 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036286 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 12:16:46.037650 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036289 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 12:16:46.037650 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036291 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 12:16:46.037650 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036294 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 12:16:46.037650 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036296 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 12:16:46.038130 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036299 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 12:16:46.038130 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036301 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 12:16:46.038130 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036304 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 12:16:46.038130 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036307 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 12:16:46.038130 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036319 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 12:16:46.038130 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036322 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 12:16:46.038130 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036325 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 12:16:46.038130 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036327 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 12:16:46.038130 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036330 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 12:16:46.038130 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036332 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 12:16:46.038130 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036335 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 12:16:46.038130 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036337 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 12:16:46.038130 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036340 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 12:16:46.038130 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036343 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 12:16:46.038130 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036346 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 12:16:46.038130 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036348 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 12:16:46.038130 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036351 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 12:16:46.038130 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.036353 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 12:16:46.038130 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037070 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 12:16:46.038130 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037076 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 12:16:46.038628 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037079 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 12:16:46.038628 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037082 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 12:16:46.038628 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037085 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 12:16:46.038628 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037089 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 12:16:46.038628 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037091 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 12:16:46.038628 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037094 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 12:16:46.038628 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037097 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 12:16:46.038628 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037100 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 12:16:46.038628 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037102 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 12:16:46.038628 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037105 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 12:16:46.038628 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037109 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 12:16:46.038628 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037113 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 12:16:46.038628 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037116 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 12:16:46.038628 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037119 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 12:16:46.038628 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037122 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 12:16:46.038628 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037125 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 12:16:46.038628 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037128 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 12:16:46.038628 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037131 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 12:16:46.038628 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037134 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 12:16:46.038628 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037137 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 12:16:46.039114 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037140 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 12:16:46.039114 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037142 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 12:16:46.039114 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037145 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 12:16:46.039114 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037148 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 12:16:46.039114 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037151 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 12:16:46.039114 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037153 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 12:16:46.039114 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037156 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 12:16:46.039114 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037158 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 12:16:46.039114 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037161 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 12:16:46.039114 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037163 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 12:16:46.039114 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037166 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 12:16:46.039114 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037168 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 12:16:46.039114 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037171 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 12:16:46.039114 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037173 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 12:16:46.039114 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037176 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 12:16:46.039114 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037179 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 12:16:46.039114 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037185 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 12:16:46.039114 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037188 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 12:16:46.039114 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037190 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 12:16:46.039114 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037193 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 12:16:46.039624 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037195 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 12:16:46.039624 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037198 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 12:16:46.039624 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037200 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 12:16:46.039624 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037203 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 12:16:46.039624 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037205 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 12:16:46.039624 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037208 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 12:16:46.039624 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037211 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 12:16:46.039624 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037213 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 12:16:46.039624 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037216 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 12:16:46.039624 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037219 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 12:16:46.039624 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037222 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 12:16:46.039624 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037225 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 12:16:46.039624 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037227 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 12:16:46.039624 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037230 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 12:16:46.039624 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037232 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 12:16:46.039624 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037237 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 12:16:46.039624 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037240 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 12:16:46.039624 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037243 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 12:16:46.039624 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037245 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 12:16:46.040093 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037248 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 12:16:46.040093 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037251 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 12:16:46.040093 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037253 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 12:16:46.040093 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037256 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 12:16:46.040093 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037258 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 12:16:46.040093 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037260 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 12:16:46.040093 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037263 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 12:16:46.040093 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037266 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 12:16:46.040093 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037269 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 12:16:46.040093 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037272 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 12:16:46.040093 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037281 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 12:16:46.040093 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037285 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 12:16:46.040093 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037288 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 12:16:46.040093 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037291 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 24 12:16:46.040093 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037293 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 12:16:46.040093 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037296 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 12:16:46.040093 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037298 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 12:16:46.040093 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037301 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 12:16:46.040093 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037304 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 12:16:46.040592 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037306 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 12:16:46.040592 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037322 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 12:16:46.040592 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037325 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 12:16:46.040592 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037329 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 12:16:46.040592 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037340 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 12:16:46.040592 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037344 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 12:16:46.040592 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037348 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 12:16:46.040592 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037350 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 12:16:46.040592 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037353 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 12:16:46.040592 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037355 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 12:16:46.040592 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037358 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 12:16:46.040592 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037361 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 12:16:46.040592 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037363 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 12:16:46.040592 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037366 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 12:16:46.040592 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037369 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 12:16:46.040592 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037371 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 12:16:46.040592 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037374 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 12:16:46.040592 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037377 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 12:16:46.040592 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.037379 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 12:16:46.041044 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039303 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 12:16:46.041044 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039325 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 12:16:46.041044 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039329 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 12:16:46.041044 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039333 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 12:16:46.041044 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039339 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 12:16:46.041044 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039342 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 12:16:46.041044 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039346 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 12:16:46.041044 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039349 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 12:16:46.041044 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039351 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 12:16:46.041044 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039354 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 12:16:46.041044 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039357 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 12:16:46.041044 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039360 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 12:16:46.041044 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039362 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 12:16:46.041044 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039365 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 12:16:46.041044 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039368 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 12:16:46.041044 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039371 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 12:16:46.041044 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039373 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 12:16:46.041044 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039376 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 12:16:46.041044 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039379 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 12:16:46.041044 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039381 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 12:16:46.041585 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039384 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 12:16:46.041585 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039387 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 12:16:46.041585 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039389 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 12:16:46.041585 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039392 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 12:16:46.041585 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039394 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 12:16:46.041585 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039397 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 12:16:46.041585 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039399 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 12:16:46.041585 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039402 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 12:16:46.041585 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039404 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 12:16:46.041585 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039407 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 12:16:46.041585 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039410 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 12:16:46.041585 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039412 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 12:16:46.041585 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039416 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 12:16:46.041585 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039419 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 12:16:46.041585 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039422 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 12:16:46.041585 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039425 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 24 12:16:46.041585 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039428 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 12:16:46.041585 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039431 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 12:16:46.041585 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039433 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 12:16:46.041585 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039436 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 12:16:46.042122 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039438 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 12:16:46.042122 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039440 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 12:16:46.042122 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039443 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 12:16:46.042122 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039446 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 12:16:46.042122 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039449 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 12:16:46.042122 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039451 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 12:16:46.042122 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039454 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 12:16:46.042122 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039458 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 12:16:46.042122 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039462 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 12:16:46.042122 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039465 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 12:16:46.042122 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039468 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 12:16:46.042122 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039470 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 12:16:46.042122 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039473 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 12:16:46.042122 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039476 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 12:16:46.042122 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039478 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 12:16:46.042122 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039481 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 12:16:46.042122 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039483 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 12:16:46.042122 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039486 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 12:16:46.042122 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039489 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 12:16:46.042598 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039492 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 12:16:46.042598 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039494 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 12:16:46.042598 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039497 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 12:16:46.042598 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039499 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 12:16:46.042598 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039502 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 12:16:46.042598 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039505 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 12:16:46.042598 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039507 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 12:16:46.042598 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039510 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 12:16:46.042598 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039512 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 12:16:46.042598 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039515 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 12:16:46.042598 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039517 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 12:16:46.042598 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039520 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 12:16:46.042598 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039524 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 12:16:46.042598 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039527 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 12:16:46.042598 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039529 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 12:16:46.042598 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039532 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 12:16:46.042598 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039534 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 12:16:46.042598 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039537 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 12:16:46.042598 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039541 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 12:16:46.043095 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039544 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 12:16:46.043095 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039550 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 12:16:46.043095 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039553 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 12:16:46.043095 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039556 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 12:16:46.043095 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039559 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 12:16:46.043095 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039562 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 12:16:46.043095 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039565 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 12:16:46.043095 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039568 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 12:16:46.043095 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039570 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 12:16:46.043095 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039573 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 12:16:46.043095 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039575 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 12:16:46.043095 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039578 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 12:16:46.043095 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039580 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 12:16:46.043095 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039583 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 12:16:46.043095 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039586 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 12:16:46.043095 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039588 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 12:16:46.043095 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039590 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 12:16:46.043095 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039593 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 12:16:46.043095 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039595 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 12:16:46.043095 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039598 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 12:16:46.043590 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.039601 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 12:16:46.043590 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039674 2555 flags.go:64] FLAG: --address="0.0.0.0" Jul 24 12:16:46.043590 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039692 2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 24 12:16:46.043590 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039701 2555 flags.go:64] FLAG: --anonymous-auth="true" Jul 24 12:16:46.043590 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039707 2555 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 24 12:16:46.043590 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039714 2555 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 24 12:16:46.043590 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039719 2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 24 12:16:46.043590 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039724 2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 24 12:16:46.043590 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039728 2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 24 12:16:46.043590 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039732 2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 24 12:16:46.043590 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039734 2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 24 12:16:46.043590 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039738 2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 24 12:16:46.043590 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039741 2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 24 12:16:46.043590 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039745 2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 24 12:16:46.043590 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039748 2555 flags.go:64] FLAG: --cgroup-root="" Jul 24 12:16:46.043590 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039752 2555 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 24 12:16:46.043590 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039754 2555 flags.go:64] FLAG: --client-ca-file="" Jul 24 12:16:46.043590 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039757 2555 flags.go:64] FLAG: --cloud-provider="external" Jul 24 12:16:46.043590 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039760 2555 flags.go:64] FLAG: --cluster-dns="[]" Jul 24 12:16:46.043590 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039765 2555 flags.go:64] FLAG: --cluster-domain="" Jul 24 12:16:46.043590 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039768 2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 24 12:16:46.043590 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039771 2555 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 24 12:16:46.043590 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039774 2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 24 12:16:46.043590 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039778 2555 flags.go:64] FLAG: --container-log-max-files="5" Jul 24 12:16:46.044167 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039781 2555 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 24 12:16:46.044167 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039784 2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 24 12:16:46.044167 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039787 2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 24 12:16:46.044167 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039790 2555 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 24 12:16:46.044167 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039793 2555 flags.go:64] FLAG: --contention-profiling="false" Jul 24 12:16:46.044167 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039796 2555 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 24 12:16:46.044167 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039800 2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 24 12:16:46.044167 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039803 2555 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 24 12:16:46.044167 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039806 2555 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 24 12:16:46.044167 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039810 2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 24 12:16:46.044167 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039813 2555 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 24 12:16:46.044167 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039816 2555 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 24 12:16:46.044167 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039819 2555 flags.go:64] FLAG: --enable-load-reader="false" Jul 24 12:16:46.044167 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039822 2555 flags.go:64] FLAG: --enable-server="true" Jul 24 12:16:46.044167 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039826 2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 24 12:16:46.044167 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039830 2555 flags.go:64] FLAG: --event-burst="100" Jul 24 12:16:46.044167 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039833 2555 flags.go:64] FLAG: --event-qps="50" Jul 24 12:16:46.044167 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039836 2555 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 24 12:16:46.044167 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039839 2555 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 24 12:16:46.044167 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039842 2555 flags.go:64] FLAG: --eviction-hard="" Jul 24 12:16:46.044167 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039846 2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 24 12:16:46.044167 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039849 2555 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 24 12:16:46.044167 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039852 2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 24 12:16:46.044167 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039855 2555 flags.go:64] FLAG: --eviction-soft="" Jul 24 12:16:46.044167 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039858 2555 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 24 12:16:46.044775 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039861 2555 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 24 12:16:46.044775 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039864 2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 24 12:16:46.044775 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039867 2555 flags.go:64] FLAG: --experimental-mounter-path="" Jul 24 12:16:46.044775 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039870 2555 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 24 12:16:46.044775 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039873 2555 flags.go:64] FLAG: --fail-swap-on="true" Jul 24 12:16:46.044775 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039876 2555 flags.go:64] FLAG: --feature-gates="" Jul 24 12:16:46.044775 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039880 2555 flags.go:64] FLAG: --file-check-frequency="20s" Jul 24 12:16:46.044775 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039883 2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 24 12:16:46.044775 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039886 2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 24 12:16:46.044775 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039889 2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 24 12:16:46.044775 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039892 2555 flags.go:64] FLAG: --healthz-port="10248" Jul 24 12:16:46.044775 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039895 2555 flags.go:64] FLAG: --help="false" Jul 24 12:16:46.044775 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039898 2555 flags.go:64] FLAG: --hostname-override="ip-10-0-139-109.ec2.internal" Jul 24 12:16:46.044775 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039901 2555 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 24 12:16:46.044775 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039904 2555 flags.go:64] FLAG: --http-check-frequency="20s" Jul 24 12:16:46.044775 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039907 2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 24 12:16:46.044775 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039910 2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 24 12:16:46.044775 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039913 2555 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 24 12:16:46.044775 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039916 2555 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 24 12:16:46.044775 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039919 2555 flags.go:64] FLAG: --image-service-endpoint="" Jul 24 12:16:46.044775 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039921 2555 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 24 12:16:46.044775 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039924 2555 flags.go:64] FLAG: --kube-api-burst="100" Jul 24 12:16:46.044775 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039928 2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 24 12:16:46.045450 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039931 2555 flags.go:64] FLAG: --kube-api-qps="50" Jul 24 12:16:46.045450 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039933 2555 flags.go:64] FLAG: --kube-reserved="" Jul 24 12:16:46.045450 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039936 2555 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 24 12:16:46.045450 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039939 2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 24 12:16:46.045450 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039942 2555 flags.go:64] FLAG: --kubelet-cgroups="" Jul 24 12:16:46.045450 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039945 2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 24 12:16:46.045450 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039950 2555 flags.go:64] FLAG: --lock-file="" Jul 24 12:16:46.045450 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039953 2555 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 24 12:16:46.045450 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039956 2555 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 24 12:16:46.045450 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039959 2555 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 24 12:16:46.045450 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039965 2555 flags.go:64] FLAG: --log-json-split-stream="false" Jul 24 12:16:46.045450 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039968 2555 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 24 12:16:46.045450 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039971 2555 flags.go:64] FLAG: --log-text-split-stream="false" Jul 24 12:16:46.045450 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039974 2555 flags.go:64] FLAG: --logging-format="text" Jul 24 12:16:46.045450 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039977 2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 24 12:16:46.045450 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039980 2555 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 24 12:16:46.045450 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039983 2555 flags.go:64] FLAG: --manifest-url="" Jul 24 12:16:46.045450 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039986 2555 flags.go:64] FLAG: --manifest-url-header="" Jul 24 12:16:46.045450 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039995 2555 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 24 12:16:46.045450 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.039999 2555 flags.go:64] FLAG: --max-open-files="1000000" Jul 24 12:16:46.045450 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040003 2555 flags.go:64] FLAG: --max-pods="110" Jul 24 12:16:46.045450 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040005 2555 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 24 12:16:46.045450 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040008 2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 24 12:16:46.045450 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040011 2555 flags.go:64] FLAG: --memory-manager-policy="None" Jul 24 12:16:46.045450 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040014 2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 24 12:16:46.046056 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040017 2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 24 12:16:46.046056 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040020 2555 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 24 12:16:46.046056 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040023 2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 24 12:16:46.046056 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040030 2555 flags.go:64] FLAG: --node-status-max-images="50" Jul 24 12:16:46.046056 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040033 2555 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 24 12:16:46.046056 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040036 2555 flags.go:64] FLAG: --oom-score-adj="-999" Jul 24 12:16:46.046056 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040038 2555 flags.go:64] FLAG: --pod-cidr="" Jul 24 12:16:46.046056 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040042 2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 24 12:16:46.046056 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040047 2555 flags.go:64] FLAG: --pod-manifest-path="" Jul 24 12:16:46.046056 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040050 2555 flags.go:64] FLAG: --pod-max-pids="-1" Jul 24 12:16:46.046056 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040053 2555 flags.go:64] FLAG: --pods-per-core="0" Jul 24 12:16:46.046056 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040056 2555 flags.go:64] FLAG: --port="10250" Jul 24 12:16:46.046056 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040059 2555 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 24 12:16:46.046056 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040063 2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0577000d60a9136f9" Jul 24 12:16:46.046056 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040066 2555 flags.go:64] FLAG: --qos-reserved="" Jul 24 12:16:46.046056 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040069 2555 flags.go:64] FLAG: --read-only-port="10255" Jul 24 12:16:46.046056 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040072 2555 flags.go:64] FLAG: --register-node="true" Jul 24 12:16:46.046056 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040075 2555 flags.go:64] FLAG: --register-with-taints="" Jul 24 12:16:46.046056 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040078 2555 flags.go:64] FLAG: --registry-burst="10" Jul 24 12:16:46.046056 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040081 2555 flags.go:64] FLAG: --registry-qps="5" Jul 24 12:16:46.046056 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040083 2555 flags.go:64] FLAG: --reserved-cpus="" Jul 24 12:16:46.046056 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040086 2555 flags.go:64] FLAG: --reserved-memory="" Jul 24 12:16:46.046056 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040090 2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 24 12:16:46.046056 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040093 2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 24 12:16:46.046056 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040096 2555 flags.go:64] FLAG: --rotate-certificates="false" Jul 24 12:16:46.046737 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040099 2555 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 24 12:16:46.046737 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040102 2555 flags.go:64] FLAG: --runonce="false" Jul 24 12:16:46.046737 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040105 2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 24 12:16:46.046737 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040108 2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 24 12:16:46.046737 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040111 2555 flags.go:64] FLAG: --seccomp-default="false" Jul 24 12:16:46.046737 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040114 2555 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 24 12:16:46.046737 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040116 2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 24 12:16:46.046737 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040119 2555 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 24 12:16:46.046737 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040122 2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 24 12:16:46.046737 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040125 2555 flags.go:64] FLAG: --storage-driver-password="root" Jul 24 12:16:46.046737 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040128 2555 flags.go:64] FLAG: --storage-driver-secure="false" Jul 24 12:16:46.046737 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040130 2555 flags.go:64] FLAG: --storage-driver-table="stats" Jul 24 12:16:46.046737 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040133 2555 flags.go:64] FLAG: --storage-driver-user="root" Jul 24 12:16:46.046737 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040136 2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 24 12:16:46.046737 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040139 2555 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 24 12:16:46.046737 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040142 2555 flags.go:64] FLAG: --system-cgroups="" Jul 24 12:16:46.046737 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040145 2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 24 12:16:46.046737 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040150 2555 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 24 12:16:46.046737 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040153 2555 flags.go:64] FLAG: --tls-cert-file="" Jul 24 12:16:46.046737 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040156 2555 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 24 12:16:46.046737 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040163 2555 flags.go:64] FLAG: --tls-min-version="" Jul 24 12:16:46.046737 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040166 2555 flags.go:64] FLAG: --tls-private-key-file="" Jul 24 12:16:46.046737 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040169 2555 flags.go:64] FLAG: --topology-manager-policy="none" Jul 24 12:16:46.046737 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040172 2555 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 24 12:16:46.046737 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040175 2555 flags.go:64] FLAG: --topology-manager-scope="container" Jul 24 12:16:46.047383 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040178 2555 flags.go:64] FLAG: --v="2" Jul 24 12:16:46.047383 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040182 2555 flags.go:64] FLAG: --version="false" Jul 24 12:16:46.047383 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040186 2555 flags.go:64] FLAG: --vmodule="" Jul 24 12:16:46.047383 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040190 2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 24 12:16:46.047383 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.040194 2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 24 12:16:46.047383 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040321 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 12:16:46.047383 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040326 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 12:16:46.047383 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040329 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 12:16:46.047383 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040332 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 12:16:46.047383 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040335 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 12:16:46.047383 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040337 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 12:16:46.047383 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040340 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 12:16:46.047383 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040343 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 12:16:46.047383 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040345 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 12:16:46.047383 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040348 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 12:16:46.047383 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040350 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 12:16:46.047383 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040353 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 12:16:46.047383 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040356 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 12:16:46.047383 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040358 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 12:16:46.047383 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040361 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 12:16:46.047383 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040364 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 12:16:46.047903 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040367 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 12:16:46.047903 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040369 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 12:16:46.047903 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040372 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 12:16:46.047903 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040374 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 12:16:46.047903 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040377 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 12:16:46.047903 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040379 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 12:16:46.047903 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040385 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 12:16:46.047903 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040388 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 12:16:46.047903 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040390 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 12:16:46.047903 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040393 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 12:16:46.047903 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040395 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 12:16:46.047903 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040398 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 12:16:46.047903 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040400 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 12:16:46.047903 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040403 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 12:16:46.047903 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040406 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 12:16:46.047903 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040408 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 12:16:46.047903 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040411 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 12:16:46.047903 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040414 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 12:16:46.047903 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040416 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 12:16:46.048373 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040418 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 12:16:46.048373 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040421 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 12:16:46.048373 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040423 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 12:16:46.048373 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040426 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 12:16:46.048373 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040429 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 12:16:46.048373 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040431 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 12:16:46.048373 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040433 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 12:16:46.048373 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040436 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 12:16:46.048373 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040439 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 12:16:46.048373 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040441 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 12:16:46.048373 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040444 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 12:16:46.048373 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040447 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 12:16:46.048373 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040450 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 12:16:46.048373 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040452 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 12:16:46.048373 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040455 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 12:16:46.048373 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040457 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 12:16:46.048373 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040461 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 12:16:46.048373 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040464 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 12:16:46.048373 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040466 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 12:16:46.048373 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040473 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 12:16:46.048867 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040477 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 12:16:46.048867 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040480 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 12:16:46.048867 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040483 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 12:16:46.048867 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040486 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 12:16:46.048867 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040488 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 12:16:46.048867 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040491 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 12:16:46.048867 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040494 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 12:16:46.048867 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040496 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 12:16:46.048867 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040499 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 12:16:46.048867 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040502 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 12:16:46.048867 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040504 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 12:16:46.048867 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040508 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 12:16:46.048867 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040512 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 12:16:46.048867 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040515 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 12:16:46.048867 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040518 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 12:16:46.048867 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040521 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 12:16:46.048867 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040524 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 12:16:46.048867 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040527 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 12:16:46.048867 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040529 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 12:16:46.049342 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040533 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 12:16:46.049342 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040535 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 12:16:46.049342 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040538 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 12:16:46.049342 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040541 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 12:16:46.049342 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040543 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 12:16:46.049342 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040546 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 12:16:46.049342 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040548 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 12:16:46.049342 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040551 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 12:16:46.049342 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040553 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 12:16:46.049342 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040556 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 12:16:46.049342 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040559 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 12:16:46.049342 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040561 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 12:16:46.049342 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040567 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 12:16:46.049342 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040569 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 12:16:46.049342 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040572 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 12:16:46.049342 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040575 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 12:16:46.049342 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040578 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 12:16:46.049342 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040580 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 24 12:16:46.049342 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040583 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 12:16:46.049342 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040585 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 12:16:46.049832 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040587 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 12:16:46.049832 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040590 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 12:16:46.049832 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040593 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 12:16:46.049832 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040595 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 12:16:46.049832 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.040598 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 12:16:46.049832 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.041216 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 12:16:46.049832 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.048259 2555 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 24 12:16:46.049832 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.048276 2555 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 24 12:16:46.049832 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.048292 2555 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 24 12:16:46.049832 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.048297 2555 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 24 12:16:46.049832 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048380 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 12:16:46.049832 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048386 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 12:16:46.049832 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048391 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 24 12:16:46.049832 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048394 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 12:16:46.049832 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048397 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 12:16:46.050211 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048399 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 12:16:46.050211 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048402 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 12:16:46.050211 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048405 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 12:16:46.050211 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048407 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 12:16:46.050211 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048410 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 12:16:46.050211 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048413 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 12:16:46.050211 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048415 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 12:16:46.050211 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048418 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 12:16:46.050211 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048420 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 12:16:46.050211 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048424 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 12:16:46.050211 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048426 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 12:16:46.050211 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048429 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 12:16:46.050211 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048432 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 12:16:46.050211 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048434 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 12:16:46.050211 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048437 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 12:16:46.050211 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048439 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 12:16:46.050211 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048442 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 12:16:46.050211 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048444 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 12:16:46.050211 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048447 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 12:16:46.050211 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048449 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 12:16:46.050716 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048452 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 12:16:46.050716 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048454 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 12:16:46.050716 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048457 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 12:16:46.050716 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048460 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 12:16:46.050716 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048468 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 12:16:46.050716 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048471 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 12:16:46.050716 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048473 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 12:16:46.050716 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048476 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 12:16:46.050716 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048478 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 12:16:46.050716 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048480 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 12:16:46.050716 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048483 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 12:16:46.050716 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048485 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 12:16:46.050716 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048488 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 12:16:46.050716 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048490 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 12:16:46.050716 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048493 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 12:16:46.050716 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048496 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 12:16:46.050716 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048498 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 12:16:46.050716 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048500 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 12:16:46.050716 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048503 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 12:16:46.050716 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048505 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 12:16:46.051532 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048508 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 12:16:46.051532 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048510 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 12:16:46.051532 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048513 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 12:16:46.051532 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048515 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 12:16:46.051532 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048518 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 12:16:46.051532 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048520 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 12:16:46.051532 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048523 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 12:16:46.051532 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048526 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 12:16:46.051532 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048528 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 12:16:46.051532 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048531 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 12:16:46.051532 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048534 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 12:16:46.051532 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048536 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 12:16:46.051532 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048539 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 12:16:46.051532 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048541 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 12:16:46.051532 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048543 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 12:16:46.051532 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048546 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 12:16:46.051532 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048548 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 12:16:46.051532 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048558 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 12:16:46.051532 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048562 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 12:16:46.052181 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048565 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 12:16:46.052181 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048568 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 12:16:46.052181 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048570 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 12:16:46.052181 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048573 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 12:16:46.052181 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048575 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 12:16:46.052181 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048578 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 12:16:46.052181 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048581 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 12:16:46.052181 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048584 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 12:16:46.052181 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048586 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 12:16:46.052181 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048589 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 12:16:46.052181 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048591 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 12:16:46.052181 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048594 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 12:16:46.052181 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048596 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 12:16:46.052181 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048598 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 12:16:46.052181 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048603 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 12:16:46.052181 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048606 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 12:16:46.052181 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048610 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 12:16:46.052181 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048612 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 12:16:46.052181 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048615 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 12:16:46.052181 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048618 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 12:16:46.052694 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048620 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 12:16:46.052694 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048623 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 12:16:46.052694 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048625 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 12:16:46.052694 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048628 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 12:16:46.052694 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048630 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 12:16:46.052694 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048633 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 12:16:46.052694 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048635 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 12:16:46.052694 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048638 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 12:16:46.052694 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048640 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 12:16:46.052694 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048642 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 12:16:46.052694 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048645 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 12:16:46.052694 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048654 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 12:16:46.052694 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048657 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 12:16:46.052694 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048660 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 12:16:46.052694 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048662 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 12:16:46.053104 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.048667 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 12:16:46.053104 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048838 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 12:16:46.053104 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048843 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 12:16:46.053104 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048846 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 12:16:46.053104 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048849 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 12:16:46.053104 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048852 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 12:16:46.053104 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048854 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 12:16:46.053104 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048857 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 12:16:46.053104 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048860 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 12:16:46.053104 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048863 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 12:16:46.053104 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048865 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 12:16:46.053104 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048869 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 12:16:46.053104 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048872 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 12:16:46.053104 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048875 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 12:16:46.053104 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048878 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 12:16:46.053629 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048880 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 12:16:46.053629 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048883 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 12:16:46.053629 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048886 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 12:16:46.053629 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048888 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 12:16:46.053629 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048891 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 12:16:46.053629 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048893 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 12:16:46.053629 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048895 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 12:16:46.053629 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048898 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 12:16:46.053629 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048901 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 12:16:46.053629 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048903 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 12:16:46.053629 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048906 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 12:16:46.053629 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048908 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 12:16:46.053629 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048911 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 12:16:46.053629 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048914 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 12:16:46.053629 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048922 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 12:16:46.053629 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048925 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 12:16:46.053629 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048927 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 24 12:16:46.053629 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048929 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 12:16:46.053629 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048932 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 12:16:46.053629 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048934 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 12:16:46.054109 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048937 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 12:16:46.054109 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048939 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 12:16:46.054109 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048942 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 12:16:46.054109 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048944 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 12:16:46.054109 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048947 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 12:16:46.054109 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048949 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 12:16:46.054109 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048952 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 12:16:46.054109 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048954 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 12:16:46.054109 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048957 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 12:16:46.054109 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048960 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 12:16:46.054109 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048962 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 12:16:46.054109 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048964 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 12:16:46.054109 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048967 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 12:16:46.054109 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048969 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 12:16:46.054109 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048972 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 12:16:46.054109 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048974 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 12:16:46.054109 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048977 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 12:16:46.054109 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048979 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 12:16:46.054109 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048982 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 12:16:46.054109 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048985 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 12:16:46.054670 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048987 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 12:16:46.054670 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048989 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 12:16:46.054670 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048992 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 12:16:46.054670 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048994 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 12:16:46.054670 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048997 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 12:16:46.054670 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.048999 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 12:16:46.054670 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049002 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 12:16:46.054670 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049010 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 12:16:46.054670 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049012 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 12:16:46.054670 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049015 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 12:16:46.054670 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049017 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 12:16:46.054670 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049019 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 12:16:46.054670 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049022 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 12:16:46.054670 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049024 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 12:16:46.054670 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049027 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 12:16:46.054670 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049029 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 12:16:46.054670 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049031 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 12:16:46.054670 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049034 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 12:16:46.054670 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049036 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 12:16:46.054670 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049039 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 12:16:46.055165 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049041 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 12:16:46.055165 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049047 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 12:16:46.055165 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049049 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 12:16:46.055165 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049052 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 12:16:46.055165 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049055 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 12:16:46.055165 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049059 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 12:16:46.055165 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049061 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 12:16:46.055165 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049064 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 12:16:46.055165 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049066 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 12:16:46.055165 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049069 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 12:16:46.055165 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049072 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 12:16:46.055165 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049074 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 12:16:46.055165 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049077 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 12:16:46.055165 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049079 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 12:16:46.055165 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049082 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 12:16:46.055165 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049085 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 12:16:46.055165 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049089 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 12:16:46.055165 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049092 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 12:16:46.055165 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049095 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 12:16:46.055706 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049098 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 12:16:46.055706 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049106 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 12:16:46.055706 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049109 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 12:16:46.055706 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049113 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 12:16:46.055706 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049116 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 12:16:46.055706 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:46.049119 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 12:16:46.055706 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.049123 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 12:16:46.055706 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.049252 2555 server.go:962] "Client rotation is on, will bootstrap in background" Jul 24 12:16:46.055706 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.052817 2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 24 12:16:46.055706 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.054480 2555 server.go:1019] "Starting client certificate rotation" Jul 24 12:16:46.055706 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.054599 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 12:16:46.055706 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.055254 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 12:16:46.057445 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.057426 2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 12:16:46.061296 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.061277 2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 12:16:46.070858 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.070843 2555 log.go:25] "Validated CRI v1 runtime API" Jul 24 12:16:46.074583 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.074564 2555 log.go:25] "Validated CRI v1 image API" Jul 24 12:16:46.075366 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.075350 2555 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 24 12:16:46.077488 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.077461 2555 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 934189a7-07bc-4132-b42b-9c690f5811c4:/dev/nvme0n1p3 a74540bb-13ca-4fdb-b58c-a3a9614aa562:/dev/nvme0n1p4] Jul 24 12:16:46.077488 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.077481 2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 24 12:16:46.082438 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.082323 2555 manager.go:216] Machine: {Timestamp:2026-07-24 12:16:46.081140755 +0000 UTC m=+0.329133568 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100444 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2773994c80b7553839050e76c965f2 SystemUUID:ec277399-4c80-b755-3839-050e76c965f2 BootID:5f4b64fb-533c-42e5-b14d-0a47ee0f0ed1 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:87:8f:2a:48:4f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:87:8f:2a:48:4f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:e6:91:55:fe:a9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 24 12:16:46.082438 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.082432 2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 24 12:16:46.082560 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.082511 2555 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 24 12:16:46.085799 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.085770 2555 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 24 12:16:46.085973 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.085802 2555 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-109.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 24 12:16:46.086493 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.086481 2555 topology_manager.go:138] "Creating topology manager with none policy" Jul 24 12:16:46.086548 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.086500 2555 container_manager_linux.go:309] "Creating device plugin manager" Jul 24 12:16:46.086548 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.086510 2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 12:16:46.087113 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.087101 2555 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 12:16:46.087230 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.087216 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 12:16:46.087942 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.087930 2555 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 24 12:16:46.090685 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.090671 2555 state_mem.go:36] "Initialized new in-memory state store" Jul 24 12:16:46.090815 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.090804 2555 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 24 12:16:46.090871 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.090851 2555 kubelet.go:486] "Attempting to sync node with API server" Jul 24 12:16:46.090929 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.090877 2555 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 24 12:16:46.090929 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.090893 2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 24 12:16:46.090929 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.090906 2555 kubelet.go:398] "Adding apiserver pod source" Jul 24 12:16:46.090929 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.090918 2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 24 12:16:46.091354 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.091340 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 12:16:46.091421 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.091362 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 12:16:46.093183 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.093158 2555 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 24 12:16:46.098980 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.098962 2555 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 24 12:16:46.099074 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.099002 2555 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 24 12:16:46.100488 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.100474 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 24 12:16:46.100554 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.100496 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 24 12:16:46.100554 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.100505 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 24 12:16:46.100554 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.100514 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 24 12:16:46.100554 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.100527 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 24 12:16:46.100554 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.100535 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 24 12:16:46.100554 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.100547 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 24 12:16:46.100554 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.100555 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 24 12:16:46.100791 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.100566 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 24 12:16:46.100791 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.100575 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 24 12:16:46.100791 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.100592 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 24 12:16:46.100791 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.100601 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 24 12:16:46.102136 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.102124 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 24 12:16:46.102195 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.102138 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 24 12:16:46.104893 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.104874 2555 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-109.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 24 12:16:46.105271 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.105259 2555 server.go:1268] "Started kubelet" Jul 24 12:16:46.105430 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.105361 2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 24 12:16:46.105430 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:46.105393 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 24 12:16:46.105430 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:46.105393 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-109.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 24 12:16:46.105591 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.105539 2555 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 24 12:16:46.105639 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.105601 2555 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 24 12:16:46.106202 ip-10-0-139-109 systemd[1]: Started Kubernetes Kubelet. Jul 24 12:16:46.107128 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.107113 2555 server.go:310] "Adding debug handlers to kubelet server" Jul 24 12:16:46.107485 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.107463 2555 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 24 12:16:46.111627 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:46.111609 2555 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 24 12:16:46.114032 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.114014 2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 24 12:16:46.114032 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.114026 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 24 12:16:46.114378 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:46.114360 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found" Jul 24 12:16:46.115188 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.114933 2555 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 24 12:16:46.115188 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.114963 2555 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 24 12:16:46.115188 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.114974 2555 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 24 12:16:46.115188 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.115094 2555 reconstruct.go:97] "Volume reconstruction finished" Jul 24 12:16:46.115188 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.115105 2555 reconciler.go:29] "Reconciler: start to sync state" Jul 24 12:16:46.115188 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.115116 2555 factory.go:55] Registering systemd factory Jul 24 12:16:46.115188 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.115131 2555 factory.go:223] Registration of the systemd container factory successfully Jul 24 12:16:46.115600 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.115585 2555 factory.go:153] Registering CRI-O factory Jul 24 12:16:46.115664 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.115604 2555 factory.go:223] Registration of the crio container factory successfully Jul 24 12:16:46.115664 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.115653 2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 24 12:16:46.115752 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.115677 2555 factory.go:103] Registering Raw factory Jul 24 12:16:46.115752 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.115719 2555 manager.go:1196] Started watching for new ooms in manager Jul 24 12:16:46.115944 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:46.114345 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-109.ec2.internal.18c538ea4220f6ac default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-109.ec2.internal,UID:ip-10-0-139-109.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-109.ec2.internal,},FirstTimestamp:2026-07-24 12:16:46.105228972 +0000 UTC m=+0.353221774,LastTimestamp:2026-07-24 12:16:46.105228972 +0000 UTC m=+0.353221774,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-109.ec2.internal,}" Jul 24 12:16:46.116115 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.116103 2555 manager.go:349] Starting recovery of all containers Jul 24 12:16:46.119193 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:46.119167 2555 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-109.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 24 12:16:46.119278 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:46.119239 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 24 12:16:46.126669 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.126653 2555 manager.go:354] Recovery completed Jul 24 12:16:46.132681 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.132637 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 12:16:46.134816 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.134799 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientMemory" Jul 24 12:16:46.134894 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.134829 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 12:16:46.134894 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.134843 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientPID" Jul 24 12:16:46.135287 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.135273 2555 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 24 12:16:46.135287 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.135286 2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 24 12:16:46.135393 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.135292 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 12:16:46.135393 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.135303 2555 state_mem.go:36] "Initialized new in-memory state store" Jul 24 12:16:46.136080 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.136061 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientMemory" Jul 24 12:16:46.136161 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.136094 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 12:16:46.136161 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.136109 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientPID" Jul 24 12:16:46.137170 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:46.137098 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-109.ec2.internal.18c538ea43e46987 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-109.ec2.internal,UID:ip-10-0-139-109.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-109.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-109.ec2.internal,},FirstTimestamp:2026-07-24 12:16:46.134815111 +0000 UTC m=+0.382807916,LastTimestamp:2026-07-24 12:16:46.134815111 +0000 UTC m=+0.382807916,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-109.ec2.internal,}" Jul 24 12:16:46.137974 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.137962 2555 policy_none.go:49] "None policy: Start" Jul 24 12:16:46.138023 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.137977 2555 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 24 12:16:46.138023 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.137987 2555 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 24 12:16:46.139980 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.139962 2555 policy_none.go:47] "Start" Jul 24 12:16:46.146298 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.146280 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l6kbj" Jul 24 12:16:46.148284 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:46.148204 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-109.ec2.internal.18c538ea43e4bb7f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-109.ec2.internal,UID:ip-10-0-139-109.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-109.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-109.ec2.internal,},FirstTimestamp:2026-07-24 12:16:46.134836095 +0000 UTC m=+0.382828901,LastTimestamp:2026-07-24 12:16:46.134836095 +0000 UTC m=+0.382828901,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-109.ec2.internal,}" Jul 24 12:16:46.154593 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.154574 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l6kbj" Jul 24 12:16:46.157083 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:46.157004 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-109.ec2.internal.18c538ea43e4e767 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-109.ec2.internal,UID:ip-10-0-139-109.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-109.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-109.ec2.internal,},FirstTimestamp:2026-07-24 12:16:46.134847335 +0000 UTC m=+0.382840138,LastTimestamp:2026-07-24 12:16:46.134847335 +0000 UTC m=+0.382840138,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-109.ec2.internal,}" Jul 24 12:16:46.159046 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:46.158892 2555 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-109.ec2.internal.18c538ea43e46987\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-109.ec2.internal.18c538ea43e46987 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-109.ec2.internal,UID:ip-10-0-139-109.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-109.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-109.ec2.internal,},FirstTimestamp:2026-07-24 12:16:46.134815111 +0000 UTC m=+0.382807916,LastTimestamp:2026-07-24 12:16:46.136078618 +0000 UTC m=+0.384071433,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-109.ec2.internal,}" Jul 24 12:16:46.163017 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.163003 2555 manager.go:337] "Starting Device Plugin manager" Jul 24 12:16:46.163100 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:46.163038 2555 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 24 12:16:46.163100 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.163052 2555 server.go:87] "Starting device plugin registration server" Jul 24 12:16:46.163284 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.163272 2555 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 24 12:16:46.163344 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.163286 2555 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 24 12:16:46.163863 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.163521 2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 24 12:16:46.163863 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.163612 2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 24 12:16:46.163863 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.163621 2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 24 12:16:46.164019 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:46.163939 2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 24 12:16:46.164019 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:46.163989 2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-109.ec2.internal\" not found" Jul 24 12:16:46.218057 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.218018 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 24 12:16:46.220079 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.219254 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 24 12:16:46.220079 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.219293 2555 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 24 12:16:46.220079 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.219329 2555 kubelet.go:2448] "Starting kubelet main sync loop" Jul 24 12:16:46.220079 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:46.219368 2555 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 24 12:16:46.221884 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.221866 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 12:16:46.264127 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.264093 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 12:16:46.264974 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.264957 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientMemory" Jul 24 12:16:46.265053 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.264990 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 12:16:46.265053 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.265000 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientPID" Jul 24 12:16:46.265053 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.265021 2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-109.ec2.internal" Jul 24 12:16:46.272381 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.272367 2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-109.ec2.internal" Jul 24 12:16:46.272443 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:46.272389 2555 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-109.ec2.internal\": node \"ip-10-0-139-109.ec2.internal\" not found" Jul 24 12:16:46.320148 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.320087 2555 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-109.ec2.internal"] Jul 24 12:16:46.320248 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.320159 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 12:16:46.320973 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.320953 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientMemory" Jul 24 12:16:46.321070 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.320982 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 12:16:46.321070 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.320992 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientPID" Jul 24 12:16:46.323172 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.323158 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 12:16:46.323267 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.323255 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal" Jul 24 12:16:46.323325 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.323292 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 12:16:46.323959 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.323942 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientMemory" Jul 24 12:16:46.324026 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.323972 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 12:16:46.324026 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.323976 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientMemory" Jul 24 12:16:46.324026 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.323987 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientPID" Jul 24 12:16:46.324026 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.323992 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 12:16:46.324026 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.324021 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientPID" Jul 24 12:16:46.325901 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:46.325888 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found" Jul 24 12:16:46.326143 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.326131 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-109.ec2.internal" Jul 24 12:16:46.326182 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.326152 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 12:16:46.326831 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.326815 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientMemory" Jul 24 12:16:46.326896 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.326847 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 12:16:46.326896 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.326858 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientPID" Jul 24 12:16:46.353954 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:46.353937 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-109.ec2.internal\" not found" node="ip-10-0-139-109.ec2.internal" Jul 24 12:16:46.358425 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:46.358411 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-109.ec2.internal\" not found" node="ip-10-0-139-109.ec2.internal" Jul 24 12:16:46.417429 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.417402 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ee18992baa5c9766306bd4d83fc1706b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal\" (UID: \"ee18992baa5c9766306bd4d83fc1706b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal" Jul 24 12:16:46.417538 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.417434 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee18992baa5c9766306bd4d83fc1706b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal\" (UID: \"ee18992baa5c9766306bd4d83fc1706b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal" Jul 24 12:16:46.417538 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.417455 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4ae05b6c2b20a8b40089e54c95c6a627-config\") pod \"kube-apiserver-proxy-ip-10-0-139-109.ec2.internal\" (UID: \"4ae05b6c2b20a8b40089e54c95c6a627\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-109.ec2.internal" Jul 24 12:16:46.426502 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:46.426481 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found" Jul 24 12:16:46.518448 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.518422 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee18992baa5c9766306bd4d83fc1706b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal\" (UID: \"ee18992baa5c9766306bd4d83fc1706b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal" Jul 24 12:16:46.518529 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.518452 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4ae05b6c2b20a8b40089e54c95c6a627-config\") pod \"kube-apiserver-proxy-ip-10-0-139-109.ec2.internal\" (UID: \"4ae05b6c2b20a8b40089e54c95c6a627\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-109.ec2.internal" Jul 24 12:16:46.518529 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.518469 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ee18992baa5c9766306bd4d83fc1706b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal\" (UID: \"ee18992baa5c9766306bd4d83fc1706b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal" Jul 24 12:16:46.518597 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.518527 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee18992baa5c9766306bd4d83fc1706b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal\" (UID: \"ee18992baa5c9766306bd4d83fc1706b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal" Jul 24 12:16:46.518597 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.518591 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ee18992baa5c9766306bd4d83fc1706b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal\" (UID: \"ee18992baa5c9766306bd4d83fc1706b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal" Jul 24 12:16:46.518666 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.518622 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4ae05b6c2b20a8b40089e54c95c6a627-config\") pod \"kube-apiserver-proxy-ip-10-0-139-109.ec2.internal\" (UID: \"4ae05b6c2b20a8b40089e54c95c6a627\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-109.ec2.internal" Jul 24 12:16:46.527529 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:46.527507 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found" Jul 24 12:16:46.628353 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:46.628280 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found" Jul 24 12:16:46.657472 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.657450 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal" Jul 24 12:16:46.662629 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:46.662247 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-109.ec2.internal" Jul 24 12:16:46.728598 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:46.728562 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found" Jul 24 12:16:46.829119 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:46.829092 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found" Jul 24 12:16:48.126321 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:48.126303 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found" Jul 24 12:16:48.226845 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:48.226825 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found" Jul 24 12:16:48.232761 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:48.232741 2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 12:16:48.251156 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:48.251134 2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 24 12:16:48.251263 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:48.251246 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 12:16:48.251302 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:48.251286 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 12:16:48.327864 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:48.327837 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found" Jul 24 12:16:48.357077 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:48.356987 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 12:11:47 +0000 UTC" deadline="2027-12-29 11:24:04.141193767 +0000 UTC" Jul 24 12:16:48.357195 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:48.357079 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12551h7m15.784124603s" Jul 24 12:16:48.428939 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:48.428915 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found" Jul 24 12:16:48.489126 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:48.489101 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 12:16:48.490635 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:48.490609 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientMemory" Jul 24 12:16:48.490750 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:48.490656 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 12:16:48.490750 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:48.490666 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientPID" Jul 24 12:16:48.502302 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:48.502255 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee18992baa5c9766306bd4d83fc1706b.slice/crio-234c487ebe2f750bbba266973e26189547db56bd81019f7d8d40467c5d037491 WatchSource:0}: Error finding container 234c487ebe2f750bbba266973e26189547db56bd81019f7d8d40467c5d037491: Status 404 returned error can't find the container with id 234c487ebe2f750bbba266973e26189547db56bd81019f7d8d40467c5d037491 Jul 24 12:16:48.506765 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:48.506753 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 12:16:48.529456 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:48.529432 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found" Jul 24 12:16:48.579950 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:48.579931 2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 12:16:48.630317 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:48.630294 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found" Jul 24 12:16:48.730857 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:48.730826 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found" Jul 24 12:16:48.773676 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:48.773646 2555 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 12:16:48.811926 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:48.811898 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal" Jul 24 12:16:48.825513 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:48.825490 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 12:16:48.826533 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:48.826519 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-109.ec2.internal" Jul 24 12:16:48.833135 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:48.833120 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 12:16:49.133272 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.133193 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 12:16:49.289328 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.289300 2555 apiserver.go:52] "Watching apiserver" Jul 24 12:16:49.297184 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.297159 2555 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 24 12:16:49.297647 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.297616 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-zflxn","openshift-multus/network-metrics-daemon-v5gc6","openshift-network-diagnostics/network-check-target-lcjn9","openshift-network-operator/iptables-alerter-xr5z4","openshift-ovn-kubernetes/ovnkube-node-ssvdc","kube-system/konnectivity-agent-s74ph","kube-system/kube-apiserver-proxy-ip-10-0-139-109.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5lr","openshift-cluster-node-tuning-operator/tuned-2fdtv","openshift-dns/node-resolver-qhshz","openshift-image-registry/node-ca-bwdsq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal","openshift-multus/multus-additional-cni-plugins-7xzrz","kube-system/global-pull-secret-syncer-rrwlt"] Jul 24 12:16:49.300214 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.300166 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qhshz" Jul 24 12:16:49.302400 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.302382 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7xzrz" Jul 24 12:16:49.302580 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.302546 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 24 12:16:49.302580 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.302555 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 24 12:16:49.302735 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.302635 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dswvc\"" Jul 24 12:16:49.304653 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.304624 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 24 12:16:49.304653 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.304633 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcjn9" Jul 24 12:16:49.304800 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.304650 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 24 12:16:49.304800 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:49.304720 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcjn9" podUID="7036166d-005a-4b55-bb2b-9445962a0a63" Jul 24 12:16:49.305430 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.305411 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 24 12:16:49.305610 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.305596 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 24 12:16:49.306029 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.306008 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pwsmg\"" Jul 24 12:16:49.306132 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.306075 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 24 12:16:49.306861 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.306841 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xr5z4" Jul 24 12:16:49.309264 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.309235 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 24 12:16:49.309368 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.309305 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 24 12:16:49.309368 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.309323 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-k9wh9\"" Jul 24 12:16:49.309368 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.309347 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 24 12:16:49.310159 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.310142 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.312035 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.312020 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 24 12:16:49.312284 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.312264 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-s74ph" Jul 24 12:16:49.312650 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.312621 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 24 12:16:49.312745 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.312728 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 24 12:16:49.312871 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.312856 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 24 12:16:49.312934 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.312921 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 24 12:16:49.313412 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.313389 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 24 12:16:49.313508 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.313467 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 24 12:16:49.313508 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.313478 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5zb2n\"" Jul 24 12:16:49.314274 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.314259 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 24 12:16:49.314690 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.314670 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.314690 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.314682 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kmkm2\"" Jul 24 12:16:49.314828 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.314794 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 24 12:16:49.317095 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.317073 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrwlt" Jul 24 12:16:49.317177 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:49.317140 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrwlt" podUID="5eec886f-16aa-409b-97c6-743f0ff1dacf" Jul 24 12:16:49.317230 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.317201 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 24 12:16:49.317413 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.317395 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7hj96\"" Jul 24 12:16:49.317477 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.317412 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 24 12:16:49.319503 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.319482 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5gc6" Jul 24 12:16:49.319591 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:49.319558 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v5gc6" podUID="1d766121-a79e-4f1e-ba3b-ed964d6f05c9" Jul 24 12:16:49.321814 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.321789 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.322893 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.322877 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-host-kubelet\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.322983 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.322904 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-host-cni-bin\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.322983 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.322927 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4ce505f1-38d9-4827-9141-b691d722aa05-env-overrides\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.322983 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.322951 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4ce505f1-38d9-4827-9141-b691d722aa05-ovnkube-script-lib\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.323143 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.322993 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/00b2c77a-a7be-488f-bcfc-0d4e139becf3-agent-certs\") pod \"konnectivity-agent-s74ph\" (UID: \"00b2c77a-a7be-488f-bcfc-0d4e139becf3\") " pod="kube-system/konnectivity-agent-s74ph" Jul 24 12:16:49.323143 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.323034 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/52ae33c6-374a-4670-a197-3368045677ef-os-release\") pod \"multus-additional-cni-plugins-7xzrz\" (UID: \"52ae33c6-374a-4670-a197-3368045677ef\") " pod="openshift-multus/multus-additional-cni-plugins-7xzrz" Jul 24 12:16:49.323143 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.323078 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/52ae33c6-374a-4670-a197-3368045677ef-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7xzrz\" (UID: \"52ae33c6-374a-4670-a197-3368045677ef\") " pod="openshift-multus/multus-additional-cni-plugins-7xzrz" Jul 24 12:16:49.323143 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.323097 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr8t5\" (UniqueName: \"kubernetes.io/projected/700d0ca4-8bdd-4a98-a24b-991f0dbe5f48-kube-api-access-jr8t5\") pod \"iptables-alerter-xr5z4\" (UID: \"700d0ca4-8bdd-4a98-a24b-991f0dbe5f48\") " pod="openshift-network-operator/iptables-alerter-xr5z4" Jul 24 12:16:49.323143 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.323118 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-host-run-ovn-kubernetes\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.323143 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.323137 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-host-cni-netd\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.323404 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.323160 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4ce505f1-38d9-4827-9141-b691d722aa05-ovnkube-config\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.323404 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.323184 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/52ae33c6-374a-4670-a197-3368045677ef-system-cni-dir\") pod \"multus-additional-cni-plugins-7xzrz\" (UID: \"52ae33c6-374a-4670-a197-3368045677ef\") " pod="openshift-multus/multus-additional-cni-plugins-7xzrz" Jul 24 12:16:49.323404 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.323215 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/52ae33c6-374a-4670-a197-3368045677ef-cnibin\") pod \"multus-additional-cni-plugins-7xzrz\" (UID: \"52ae33c6-374a-4670-a197-3368045677ef\") " pod="openshift-multus/multus-additional-cni-plugins-7xzrz" Jul 24 12:16:49.323404 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.323250 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s967q\" (UniqueName: \"kubernetes.io/projected/52ae33c6-374a-4670-a197-3368045677ef-kube-api-access-s967q\") pod \"multus-additional-cni-plugins-7xzrz\" (UID: \"52ae33c6-374a-4670-a197-3368045677ef\") " pod="openshift-multus/multus-additional-cni-plugins-7xzrz" Jul 24 12:16:49.323404 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.323285 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-log-socket\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.323404 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.323308 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-etc-openvswitch\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.323404 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.323331 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-run-ovn\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.323404 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.323356 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-node-log\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.323404 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.323381 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk4r8\" (UniqueName: \"kubernetes.io/projected/4ce505f1-38d9-4827-9141-b691d722aa05-kube-api-access-pk4r8\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.323404 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.323403 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/00b2c77a-a7be-488f-bcfc-0d4e139becf3-konnectivity-ca\") pod \"konnectivity-agent-s74ph\" (UID: \"00b2c77a-a7be-488f-bcfc-0d4e139becf3\") " pod="kube-system/konnectivity-agent-s74ph" Jul 24 12:16:49.323748 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.323439 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-run-systemd\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.323748 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.323472 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-var-lib-openvswitch\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.323748 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.323517 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6dc76beb-b2b1-422c-a272-5623d2fb2f5e-hosts-file\") pod \"node-resolver-qhshz\" (UID: \"6dc76beb-b2b1-422c-a272-5623d2fb2f5e\") " pod="openshift-dns/node-resolver-qhshz" Jul 24 12:16:49.323748 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.323560 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dc76beb-b2b1-422c-a272-5623d2fb2f5e-tmp-dir\") pod \"node-resolver-qhshz\" (UID: \"6dc76beb-b2b1-422c-a272-5623d2fb2f5e\") " pod="openshift-dns/node-resolver-qhshz" Jul 24 12:16:49.323748 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.323596 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2wb8\" (UniqueName: \"kubernetes.io/projected/6dc76beb-b2b1-422c-a272-5623d2fb2f5e-kube-api-access-g2wb8\") pod \"node-resolver-qhshz\" (UID: \"6dc76beb-b2b1-422c-a272-5623d2fb2f5e\") " pod="openshift-dns/node-resolver-qhshz" Jul 24 12:16:49.323748 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.323622 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/700d0ca4-8bdd-4a98-a24b-991f0dbe5f48-host-slash\") pod \"iptables-alerter-xr5z4\" (UID: \"700d0ca4-8bdd-4a98-a24b-991f0dbe5f48\") " pod="openshift-network-operator/iptables-alerter-xr5z4" Jul 24 12:16:49.323748 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.323648 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.323748 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.323673 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4ce505f1-38d9-4827-9141-b691d722aa05-ovn-node-metrics-cert\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.323748 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.323696 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-host-slash\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.323748 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.323719 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-run-openvswitch\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.324192 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.323763 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/52ae33c6-374a-4670-a197-3368045677ef-cni-binary-copy\") pod \"multus-additional-cni-plugins-7xzrz\" (UID: \"52ae33c6-374a-4670-a197-3368045677ef\") " pod="openshift-multus/multus-additional-cni-plugins-7xzrz" Jul 24 12:16:49.324192 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.323808 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/52ae33c6-374a-4670-a197-3368045677ef-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7xzrz\" (UID: \"52ae33c6-374a-4670-a197-3368045677ef\") " pod="openshift-multus/multus-additional-cni-plugins-7xzrz" Jul 24 12:16:49.324192 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.323837 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/52ae33c6-374a-4670-a197-3368045677ef-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7xzrz\" (UID: \"52ae33c6-374a-4670-a197-3368045677ef\") " pod="openshift-multus/multus-additional-cni-plugins-7xzrz" Jul 24 12:16:49.324192 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.323864 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-systemd-units\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.324192 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.323886 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-host-run-netns\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.324192 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.323908 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cbn4\" (UniqueName: \"kubernetes.io/projected/7036166d-005a-4b55-bb2b-9445962a0a63-kube-api-access-4cbn4\") pod \"network-check-target-lcjn9\" (UID: \"7036166d-005a-4b55-bb2b-9445962a0a63\") " pod="openshift-network-diagnostics/network-check-target-lcjn9" Jul 24 12:16:49.324192 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.323930 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/700d0ca4-8bdd-4a98-a24b-991f0dbe5f48-iptables-alerter-script\") pod \"iptables-alerter-xr5z4\" (UID: \"700d0ca4-8bdd-4a98-a24b-991f0dbe5f48\") " pod="openshift-network-operator/iptables-alerter-xr5z4" Jul 24 12:16:49.325136 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.324794 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 24 12:16:49.327367 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.325256 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vvvs4\"" Jul 24 12:16:49.327367 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.326197 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bwdsq" Jul 24 12:16:49.328033 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.328013 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 12:16:49.328317 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.328300 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5lr" Jul 24 12:16:49.328624 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.328593 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 24 12:16:49.328708 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.328661 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 24 12:16:49.328752 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.328729 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xs4lq\"" Jul 24 12:16:49.328752 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.328740 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 24 12:16:49.330509 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.330489 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 24 12:16:49.330598 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.330537 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 24 12:16:49.330658 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.330598 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kn2wd\"" Jul 24 12:16:49.330712 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.330658 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 24 12:16:49.350120 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.350097 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5t6tg" Jul 24 12:16:49.361140 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.361123 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5t6tg" Jul 24 12:16:49.412867 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.412831 2555 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 24 12:16:49.422244 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.422200 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal" event={"ID":"ee18992baa5c9766306bd4d83fc1706b","Type":"ContainerStarted","Data":"234c487ebe2f750bbba266973e26189547db56bd81019f7d8d40467c5d037491"} Jul 24 12:16:49.424462 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.424436 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-hostroot\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.424572 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.424464 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2371a5d9-c275-4649-a47c-2b92ee94dda0-sys-fs\") pod \"aws-ebs-csi-driver-node-7s5lr\" (UID: \"2371a5d9-c275-4649-a47c-2b92ee94dda0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5lr" Jul 24 12:16:49.424572 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.424508 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8df0d235-f7c1-4a75-82ab-48d65409bd41-etc-sysctl-d\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.424572 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.424551 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/52ae33c6-374a-4670-a197-3368045677ef-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7xzrz\" (UID: \"52ae33c6-374a-4670-a197-3368045677ef\") " pod="openshift-multus/multus-additional-cni-plugins-7xzrz" Jul 24 12:16:49.424708 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.424576 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-systemd-units\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.424708 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.424593 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/853c7ef4-69c4-4310-9a1c-271b3d038857-cni-binary-copy\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.424708 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.424611 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5eec886f-16aa-409b-97c6-743f0ff1dacf-original-pull-secret\") pod \"global-pull-secret-syncer-rrwlt\" (UID: \"5eec886f-16aa-409b-97c6-743f0ff1dacf\") " pod="kube-system/global-pull-secret-syncer-rrwlt" Jul 24 12:16:49.424708 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.424633 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cbn4\" (UniqueName: \"kubernetes.io/projected/7036166d-005a-4b55-bb2b-9445962a0a63-kube-api-access-4cbn4\") pod \"network-check-target-lcjn9\" (UID: \"7036166d-005a-4b55-bb2b-9445962a0a63\") " pod="openshift-network-diagnostics/network-check-target-lcjn9" Jul 24 12:16:49.424708 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.424654 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/700d0ca4-8bdd-4a98-a24b-991f0dbe5f48-iptables-alerter-script\") pod \"iptables-alerter-xr5z4\" (UID: \"700d0ca4-8bdd-4a98-a24b-991f0dbe5f48\") " pod="openshift-network-operator/iptables-alerter-xr5z4" Jul 24 12:16:49.424708 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.424678 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-host-kubelet\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.424974 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.424723 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-host-cni-bin\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.424974 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.424734 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-host-kubelet\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.424974 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.424751 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr8t5\" (UniqueName: \"kubernetes.io/projected/700d0ca4-8bdd-4a98-a24b-991f0dbe5f48-kube-api-access-jr8t5\") pod \"iptables-alerter-xr5z4\" (UID: \"700d0ca4-8bdd-4a98-a24b-991f0dbe5f48\") " pod="openshift-network-operator/iptables-alerter-xr5z4" Jul 24 12:16:49.424974 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.424780 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-host-run-ovn-kubernetes\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.424974 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.424804 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-host-cni-netd\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.424974 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.424817 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-host-cni-bin\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.424974 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.424830 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8df0d235-f7c1-4a75-82ab-48d65409bd41-lib-modules\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.424974 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.424865 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-host-run-ovn-kubernetes\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.424974 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.424781 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-systemd-units\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.424974 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.424883 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q4nx\" (UniqueName: \"kubernetes.io/projected/8df0d235-f7c1-4a75-82ab-48d65409bd41-kube-api-access-6q4nx\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.424974 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.424909 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-host-cni-netd\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.424974 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.424911 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l75gh\" (UniqueName: \"kubernetes.io/projected/1d766121-a79e-4f1e-ba3b-ed964d6f05c9-kube-api-access-l75gh\") pod \"network-metrics-daemon-v5gc6\" (UID: \"1d766121-a79e-4f1e-ba3b-ed964d6f05c9\") " pod="openshift-multus/network-metrics-daemon-v5gc6" Jul 24 12:16:49.424974 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.424939 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/52ae33c6-374a-4670-a197-3368045677ef-cnibin\") pod \"multus-additional-cni-plugins-7xzrz\" (UID: \"52ae33c6-374a-4670-a197-3368045677ef\") " pod="openshift-multus/multus-additional-cni-plugins-7xzrz" Jul 24 12:16:49.424974 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.424954 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-log-socket\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.424974 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.424974 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-host-run-multus-certs\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.425683 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.424998 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-etc-kubernetes\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.425683 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425016 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-log-socket\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.425683 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425021 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8df0d235-f7c1-4a75-82ab-48d65409bd41-etc-sysctl-conf\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.425683 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425031 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/52ae33c6-374a-4670-a197-3368045677ef-cnibin\") pod \"multus-additional-cni-plugins-7xzrz\" (UID: \"52ae33c6-374a-4670-a197-3368045677ef\") " pod="openshift-multus/multus-additional-cni-plugins-7xzrz" Jul 24 12:16:49.425683 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425043 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8df0d235-f7c1-4a75-82ab-48d65409bd41-etc-systemd\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.425683 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425108 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-etc-openvswitch\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.425683 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425138 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-run-ovn\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.425683 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425162 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-node-log\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.425683 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425186 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/00b2c77a-a7be-488f-bcfc-0d4e139becf3-konnectivity-ca\") pod \"konnectivity-agent-s74ph\" (UID: \"00b2c77a-a7be-488f-bcfc-0d4e139becf3\") " pod="kube-system/konnectivity-agent-s74ph" Jul 24 12:16:49.425683 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425200 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/52ae33c6-374a-4670-a197-3368045677ef-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7xzrz\" (UID: \"52ae33c6-374a-4670-a197-3368045677ef\") " pod="openshift-multus/multus-additional-cni-plugins-7xzrz" Jul 24 12:16:49.425683 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425205 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-etc-openvswitch\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.425683 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425212 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-run-ovn\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.425683 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425206 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-host-run-netns\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.425683 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425273 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-node-log\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.425683 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425276 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/700d0ca4-8bdd-4a98-a24b-991f0dbe5f48-iptables-alerter-script\") pod \"iptables-alerter-xr5z4\" (UID: \"700d0ca4-8bdd-4a98-a24b-991f0dbe5f48\") " pod="openshift-network-operator/iptables-alerter-xr5z4" Jul 24 12:16:49.425683 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425297 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-host-var-lib-cni-bin\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.425683 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425396 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnqhq\" (UniqueName: \"kubernetes.io/projected/aebc0623-951c-431c-9ac0-f7c139f35c12-kube-api-access-tnqhq\") pod \"node-ca-bwdsq\" (UID: \"aebc0623-951c-431c-9ac0-f7c139f35c12\") " pod="openshift-image-registry/node-ca-bwdsq" Jul 24 12:16:49.426440 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425425 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8df0d235-f7c1-4a75-82ab-48d65409bd41-etc-tuned\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.426440 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425451 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-run-systemd\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.426440 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425467 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dc76beb-b2b1-422c-a272-5623d2fb2f5e-tmp-dir\") pod \"node-resolver-qhshz\" (UID: \"6dc76beb-b2b1-422c-a272-5623d2fb2f5e\") " pod="openshift-dns/node-resolver-qhshz" Jul 24 12:16:49.426440 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425481 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-system-cni-dir\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.426440 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425495 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2371a5d9-c275-4649-a47c-2b92ee94dda0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7s5lr\" (UID: \"2371a5d9-c275-4649-a47c-2b92ee94dda0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5lr" Jul 24 12:16:49.426440 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425538 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.426440 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425574 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-cnibin\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.426440 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425598 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-host-run-k8s-cni-cncf-io\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.426440 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425606 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-run-systemd\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.426440 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425606 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.426440 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425624 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aebc0623-951c-431c-9ac0-f7c139f35c12-serviceca\") pod \"node-ca-bwdsq\" (UID: \"aebc0623-951c-431c-9ac0-f7c139f35c12\") " pod="openshift-image-registry/node-ca-bwdsq" Jul 24 12:16:49.426440 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425648 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r8xj\" (UniqueName: \"kubernetes.io/projected/2371a5d9-c275-4649-a47c-2b92ee94dda0-kube-api-access-8r8xj\") pod \"aws-ebs-csi-driver-node-7s5lr\" (UID: \"2371a5d9-c275-4649-a47c-2b92ee94dda0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5lr" Jul 24 12:16:49.426440 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425671 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8df0d235-f7c1-4a75-82ab-48d65409bd41-etc-kubernetes\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.426440 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425691 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8df0d235-f7c1-4a75-82ab-48d65409bd41-run\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.426440 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425721 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8df0d235-f7c1-4a75-82ab-48d65409bd41-host\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.426440 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425744 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-run-openvswitch\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.426440 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425741 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dc76beb-b2b1-422c-a272-5623d2fb2f5e-tmp-dir\") pod \"node-resolver-qhshz\" (UID: \"6dc76beb-b2b1-422c-a272-5623d2fb2f5e\") " pod="openshift-dns/node-resolver-qhshz" Jul 24 12:16:49.427217 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425759 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-multus-conf-dir\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.427217 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425771 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/00b2c77a-a7be-488f-bcfc-0d4e139becf3-konnectivity-ca\") pod \"konnectivity-agent-s74ph\" (UID: \"00b2c77a-a7be-488f-bcfc-0d4e139becf3\") " pod="kube-system/konnectivity-agent-s74ph" Jul 24 12:16:49.427217 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425775 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8df0d235-f7c1-4a75-82ab-48d65409bd41-etc-sysconfig\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.427217 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425818 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-run-openvswitch\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.427217 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425860 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5eec886f-16aa-409b-97c6-743f0ff1dacf-kubelet-config\") pod \"global-pull-secret-syncer-rrwlt\" (UID: \"5eec886f-16aa-409b-97c6-743f0ff1dacf\") " pod="kube-system/global-pull-secret-syncer-rrwlt" Jul 24 12:16:49.427217 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425889 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5eec886f-16aa-409b-97c6-743f0ff1dacf-dbus\") pod \"global-pull-secret-syncer-rrwlt\" (UID: \"5eec886f-16aa-409b-97c6-743f0ff1dacf\") " pod="kube-system/global-pull-secret-syncer-rrwlt" Jul 24 12:16:49.427217 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425933 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d766121-a79e-4f1e-ba3b-ed964d6f05c9-metrics-certs\") pod \"network-metrics-daemon-v5gc6\" (UID: \"1d766121-a79e-4f1e-ba3b-ed964d6f05c9\") " pod="openshift-multus/network-metrics-daemon-v5gc6" Jul 24 12:16:49.427217 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.425979 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/52ae33c6-374a-4670-a197-3368045677ef-cni-binary-copy\") pod \"multus-additional-cni-plugins-7xzrz\" (UID: \"52ae33c6-374a-4670-a197-3368045677ef\") " pod="openshift-multus/multus-additional-cni-plugins-7xzrz" Jul 24 12:16:49.427217 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426022 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/52ae33c6-374a-4670-a197-3368045677ef-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7xzrz\" (UID: \"52ae33c6-374a-4670-a197-3368045677ef\") " pod="openshift-multus/multus-additional-cni-plugins-7xzrz" Jul 24 12:16:49.427217 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426049 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2371a5d9-c275-4649-a47c-2b92ee94dda0-etc-selinux\") pod \"aws-ebs-csi-driver-node-7s5lr\" (UID: \"2371a5d9-c275-4649-a47c-2b92ee94dda0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5lr" Jul 24 12:16:49.427217 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426099 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-host-run-netns\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.427217 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426141 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4ce505f1-38d9-4827-9141-b691d722aa05-env-overrides\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.427217 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426164 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4ce505f1-38d9-4827-9141-b691d722aa05-ovnkube-script-lib\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.427217 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426186 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/00b2c77a-a7be-488f-bcfc-0d4e139becf3-agent-certs\") pod \"konnectivity-agent-s74ph\" (UID: \"00b2c77a-a7be-488f-bcfc-0d4e139becf3\") " pod="kube-system/konnectivity-agent-s74ph" Jul 24 12:16:49.427217 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426195 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-host-run-netns\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.427217 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426211 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2371a5d9-c275-4649-a47c-2b92ee94dda0-socket-dir\") pod \"aws-ebs-csi-driver-node-7s5lr\" (UID: \"2371a5d9-c275-4649-a47c-2b92ee94dda0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5lr" Jul 24 12:16:49.427217 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426264 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/52ae33c6-374a-4670-a197-3368045677ef-os-release\") pod \"multus-additional-cni-plugins-7xzrz\" (UID: \"52ae33c6-374a-4670-a197-3368045677ef\") " pod="openshift-multus/multus-additional-cni-plugins-7xzrz" Jul 24 12:16:49.427920 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426289 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/52ae33c6-374a-4670-a197-3368045677ef-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7xzrz\" (UID: \"52ae33c6-374a-4670-a197-3368045677ef\") " pod="openshift-multus/multus-additional-cni-plugins-7xzrz" Jul 24 12:16:49.427920 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426318 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4ce505f1-38d9-4827-9141-b691d722aa05-ovnkube-config\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.427920 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426377 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wljdt\" (UniqueName: \"kubernetes.io/projected/853c7ef4-69c4-4310-9a1c-271b3d038857-kube-api-access-wljdt\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.427920 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426403 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/52ae33c6-374a-4670-a197-3368045677ef-system-cni-dir\") pod \"multus-additional-cni-plugins-7xzrz\" (UID: \"52ae33c6-374a-4670-a197-3368045677ef\") " pod="openshift-multus/multus-additional-cni-plugins-7xzrz" Jul 24 12:16:49.427920 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426429 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s967q\" (UniqueName: \"kubernetes.io/projected/52ae33c6-374a-4670-a197-3368045677ef-kube-api-access-s967q\") pod \"multus-additional-cni-plugins-7xzrz\" (UID: \"52ae33c6-374a-4670-a197-3368045677ef\") " pod="openshift-multus/multus-additional-cni-plugins-7xzrz" Jul 24 12:16:49.427920 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426457 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-os-release\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.427920 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426473 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/52ae33c6-374a-4670-a197-3368045677ef-cni-binary-copy\") pod \"multus-additional-cni-plugins-7xzrz\" (UID: \"52ae33c6-374a-4670-a197-3368045677ef\") " pod="openshift-multus/multus-additional-cni-plugins-7xzrz" Jul 24 12:16:49.427920 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426482 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2371a5d9-c275-4649-a47c-2b92ee94dda0-registration-dir\") pod \"aws-ebs-csi-driver-node-7s5lr\" (UID: \"2371a5d9-c275-4649-a47c-2b92ee94dda0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5lr" Jul 24 12:16:49.427920 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426527 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2371a5d9-c275-4649-a47c-2b92ee94dda0-device-dir\") pod \"aws-ebs-csi-driver-node-7s5lr\" (UID: \"2371a5d9-c275-4649-a47c-2b92ee94dda0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5lr" Jul 24 12:16:49.427920 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426554 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk4r8\" (UniqueName: \"kubernetes.io/projected/4ce505f1-38d9-4827-9141-b691d722aa05-kube-api-access-pk4r8\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.427920 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426577 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/52ae33c6-374a-4670-a197-3368045677ef-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7xzrz\" (UID: \"52ae33c6-374a-4670-a197-3368045677ef\") " pod="openshift-multus/multus-additional-cni-plugins-7xzrz" Jul 24 12:16:49.427920 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426583 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-host-var-lib-cni-multus\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.427920 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426606 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8df0d235-f7c1-4a75-82ab-48d65409bd41-sys\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.427920 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426630 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-host-var-lib-kubelet\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.427920 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426655 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/52ae33c6-374a-4670-a197-3368045677ef-system-cni-dir\") pod \"multus-additional-cni-plugins-7xzrz\" (UID: \"52ae33c6-374a-4670-a197-3368045677ef\") " pod="openshift-multus/multus-additional-cni-plugins-7xzrz" Jul 24 12:16:49.427920 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426659 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-var-lib-openvswitch\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.428672 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426685 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6dc76beb-b2b1-422c-a272-5623d2fb2f5e-hosts-file\") pod \"node-resolver-qhshz\" (UID: \"6dc76beb-b2b1-422c-a272-5623d2fb2f5e\") " pod="openshift-dns/node-resolver-qhshz" Jul 24 12:16:49.428672 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426733 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2wb8\" (UniqueName: \"kubernetes.io/projected/6dc76beb-b2b1-422c-a272-5623d2fb2f5e-kube-api-access-g2wb8\") pod \"node-resolver-qhshz\" (UID: \"6dc76beb-b2b1-422c-a272-5623d2fb2f5e\") " pod="openshift-dns/node-resolver-qhshz" Jul 24 12:16:49.428672 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426744 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4ce505f1-38d9-4827-9141-b691d722aa05-ovnkube-script-lib\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.428672 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426758 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/700d0ca4-8bdd-4a98-a24b-991f0dbe5f48-host-slash\") pod \"iptables-alerter-xr5z4\" (UID: \"700d0ca4-8bdd-4a98-a24b-991f0dbe5f48\") " pod="openshift-network-operator/iptables-alerter-xr5z4" Jul 24 12:16:49.428672 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426783 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aebc0623-951c-431c-9ac0-f7c139f35c12-host\") pod \"node-ca-bwdsq\" (UID: \"aebc0623-951c-431c-9ac0-f7c139f35c12\") " pod="openshift-image-registry/node-ca-bwdsq" Jul 24 12:16:49.428672 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426806 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8df0d235-f7c1-4a75-82ab-48d65409bd41-etc-modprobe-d\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.428672 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426833 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4ce505f1-38d9-4827-9141-b691d722aa05-ovn-node-metrics-cert\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.428672 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426878 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/853c7ef4-69c4-4310-9a1c-271b3d038857-multus-daemon-config\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.428672 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426889 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/52ae33c6-374a-4670-a197-3368045677ef-os-release\") pod \"multus-additional-cni-plugins-7xzrz\" (UID: \"52ae33c6-374a-4670-a197-3368045677ef\") " pod="openshift-multus/multus-additional-cni-plugins-7xzrz" Jul 24 12:16:49.428672 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426902 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8df0d235-f7c1-4a75-82ab-48d65409bd41-var-lib-kubelet\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.428672 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426894 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-var-lib-openvswitch\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.428672 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426925 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8df0d235-f7c1-4a75-82ab-48d65409bd41-tmp\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.428672 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426928 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4ce505f1-38d9-4827-9141-b691d722aa05-ovnkube-config\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.428672 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426939 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6dc76beb-b2b1-422c-a272-5623d2fb2f5e-hosts-file\") pod \"node-resolver-qhshz\" (UID: \"6dc76beb-b2b1-422c-a272-5623d2fb2f5e\") " pod="openshift-dns/node-resolver-qhshz" Jul 24 12:16:49.428672 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426950 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-host-slash\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.428672 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.426987 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-multus-cni-dir\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.428672 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.427011 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ce505f1-38d9-4827-9141-b691d722aa05-host-slash\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.429487 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.427017 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-multus-socket-dir-parent\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.429487 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.427012 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/700d0ca4-8bdd-4a98-a24b-991f0dbe5f48-host-slash\") pod \"iptables-alerter-xr5z4\" (UID: \"700d0ca4-8bdd-4a98-a24b-991f0dbe5f48\") " pod="openshift-network-operator/iptables-alerter-xr5z4" Jul 24 12:16:49.429487 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.427103 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/52ae33c6-374a-4670-a197-3368045677ef-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7xzrz\" (UID: \"52ae33c6-374a-4670-a197-3368045677ef\") " pod="openshift-multus/multus-additional-cni-plugins-7xzrz" Jul 24 12:16:49.429487 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.427113 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4ce505f1-38d9-4827-9141-b691d722aa05-env-overrides\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.429487 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.427214 2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 24 12:16:49.430786 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.430762 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4ce505f1-38d9-4827-9141-b691d722aa05-ovn-node-metrics-cert\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.430878 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.430820 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/00b2c77a-a7be-488f-bcfc-0d4e139becf3-agent-certs\") pod \"konnectivity-agent-s74ph\" (UID: \"00b2c77a-a7be-488f-bcfc-0d4e139becf3\") " pod="kube-system/konnectivity-agent-s74ph" Jul 24 12:16:49.431808 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:49.431788 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 12:16:49.431913 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:49.431813 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 12:16:49.431913 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:49.431826 2555 projected.go:196] Error preparing data for projected volume kube-api-access-4cbn4 for pod openshift-network-diagnostics/network-check-target-lcjn9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 12:16:49.431913 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:49.431893 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7036166d-005a-4b55-bb2b-9445962a0a63-kube-api-access-4cbn4 podName:7036166d-005a-4b55-bb2b-9445962a0a63 nodeName:}" failed. No retries permitted until 2026-07-24 12:16:49.931872647 +0000 UTC m=+2.983117636 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4cbn4" (UniqueName: "kubernetes.io/projected/7036166d-005a-4b55-bb2b-9445962a0a63-kube-api-access-4cbn4") pod "network-check-target-lcjn9" (UID: "7036166d-005a-4b55-bb2b-9445962a0a63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 12:16:49.433968 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.433937 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr8t5\" (UniqueName: \"kubernetes.io/projected/700d0ca4-8bdd-4a98-a24b-991f0dbe5f48-kube-api-access-jr8t5\") pod \"iptables-alerter-xr5z4\" (UID: \"700d0ca4-8bdd-4a98-a24b-991f0dbe5f48\") " pod="openshift-network-operator/iptables-alerter-xr5z4" Jul 24 12:16:49.434818 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.434794 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s967q\" (UniqueName: \"kubernetes.io/projected/52ae33c6-374a-4670-a197-3368045677ef-kube-api-access-s967q\") pod \"multus-additional-cni-plugins-7xzrz\" (UID: \"52ae33c6-374a-4670-a197-3368045677ef\") " pod="openshift-multus/multus-additional-cni-plugins-7xzrz" Jul 24 12:16:49.435277 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.435253 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk4r8\" (UniqueName: \"kubernetes.io/projected/4ce505f1-38d9-4827-9141-b691d722aa05-kube-api-access-pk4r8\") pod \"ovnkube-node-ssvdc\" (UID: \"4ce505f1-38d9-4827-9141-b691d722aa05\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.435872 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.435851 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2wb8\" (UniqueName: \"kubernetes.io/projected/6dc76beb-b2b1-422c-a272-5623d2fb2f5e-kube-api-access-g2wb8\") pod \"node-resolver-qhshz\" (UID: \"6dc76beb-b2b1-422c-a272-5623d2fb2f5e\") " pod="openshift-dns/node-resolver-qhshz" Jul 24 12:16:49.527413 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.527376 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-system-cni-dir\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.527413 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.527415 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2371a5d9-c275-4649-a47c-2b92ee94dda0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7s5lr\" (UID: \"2371a5d9-c275-4649-a47c-2b92ee94dda0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5lr" Jul 24 12:16:49.527653 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.527434 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-cnibin\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.527653 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.527449 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-host-run-k8s-cni-cncf-io\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.527653 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.527471 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aebc0623-951c-431c-9ac0-f7c139f35c12-serviceca\") pod \"node-ca-bwdsq\" (UID: \"aebc0623-951c-431c-9ac0-f7c139f35c12\") " pod="openshift-image-registry/node-ca-bwdsq" Jul 24 12:16:49.527653 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.527484 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-system-cni-dir\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.527653 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.527493 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r8xj\" (UniqueName: \"kubernetes.io/projected/2371a5d9-c275-4649-a47c-2b92ee94dda0-kube-api-access-8r8xj\") pod \"aws-ebs-csi-driver-node-7s5lr\" (UID: \"2371a5d9-c275-4649-a47c-2b92ee94dda0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5lr" Jul 24 12:16:49.527653 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.527527 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2371a5d9-c275-4649-a47c-2b92ee94dda0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7s5lr\" (UID: \"2371a5d9-c275-4649-a47c-2b92ee94dda0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5lr" Jul 24 12:16:49.527653 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.527538 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-cnibin\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.527653 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.527581 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8df0d235-f7c1-4a75-82ab-48d65409bd41-etc-kubernetes\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.527653 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.527543 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8df0d235-f7c1-4a75-82ab-48d65409bd41-etc-kubernetes\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.528070 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.527664 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8df0d235-f7c1-4a75-82ab-48d65409bd41-run\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.528070 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.527717 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8df0d235-f7c1-4a75-82ab-48d65409bd41-host\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.528070 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.527740 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-multus-conf-dir\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.528070 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.527760 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8df0d235-f7c1-4a75-82ab-48d65409bd41-etc-sysconfig\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.528070 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.527785 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5eec886f-16aa-409b-97c6-743f0ff1dacf-kubelet-config\") pod \"global-pull-secret-syncer-rrwlt\" (UID: \"5eec886f-16aa-409b-97c6-743f0ff1dacf\") " pod="kube-system/global-pull-secret-syncer-rrwlt" Jul 24 12:16:49.528070 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.527801 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8df0d235-f7c1-4a75-82ab-48d65409bd41-run\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.528070 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.527807 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5eec886f-16aa-409b-97c6-743f0ff1dacf-dbus\") pod \"global-pull-secret-syncer-rrwlt\" (UID: \"5eec886f-16aa-409b-97c6-743f0ff1dacf\") " pod="kube-system/global-pull-secret-syncer-rrwlt" Jul 24 12:16:49.528070 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.527811 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8df0d235-f7c1-4a75-82ab-48d65409bd41-host\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.528070 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.527832 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d766121-a79e-4f1e-ba3b-ed964d6f05c9-metrics-certs\") pod \"network-metrics-daemon-v5gc6\" (UID: \"1d766121-a79e-4f1e-ba3b-ed964d6f05c9\") " pod="openshift-multus/network-metrics-daemon-v5gc6" Jul 24 12:16:49.528070 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.527860 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2371a5d9-c275-4649-a47c-2b92ee94dda0-etc-selinux\") pod \"aws-ebs-csi-driver-node-7s5lr\" (UID: \"2371a5d9-c275-4649-a47c-2b92ee94dda0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5lr" Jul 24 12:16:49.528070 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.527866 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-host-run-k8s-cni-cncf-io\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.528070 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.527892 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2371a5d9-c275-4649-a47c-2b92ee94dda0-socket-dir\") pod \"aws-ebs-csi-driver-node-7s5lr\" (UID: \"2371a5d9-c275-4649-a47c-2b92ee94dda0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5lr" Jul 24 12:16:49.528070 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.527908 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8df0d235-f7c1-4a75-82ab-48d65409bd41-etc-sysconfig\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.528070 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.527925 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wljdt\" (UniqueName: \"kubernetes.io/projected/853c7ef4-69c4-4310-9a1c-271b3d038857-kube-api-access-wljdt\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.528070 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.527942 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-multus-conf-dir\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.528070 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.527949 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5eec886f-16aa-409b-97c6-743f0ff1dacf-dbus\") pod \"global-pull-secret-syncer-rrwlt\" (UID: \"5eec886f-16aa-409b-97c6-743f0ff1dacf\") " pod="kube-system/global-pull-secret-syncer-rrwlt" Jul 24 12:16:49.528070 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.527954 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-os-release\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.528070 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.527980 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5eec886f-16aa-409b-97c6-743f0ff1dacf-kubelet-config\") pod \"global-pull-secret-syncer-rrwlt\" (UID: \"5eec886f-16aa-409b-97c6-743f0ff1dacf\") " pod="kube-system/global-pull-secret-syncer-rrwlt" Jul 24 12:16:49.528893 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528019 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2371a5d9-c275-4649-a47c-2b92ee94dda0-registration-dir\") pod \"aws-ebs-csi-driver-node-7s5lr\" (UID: \"2371a5d9-c275-4649-a47c-2b92ee94dda0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5lr" Jul 24 12:16:49.528893 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528031 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aebc0623-951c-431c-9ac0-f7c139f35c12-serviceca\") pod \"node-ca-bwdsq\" (UID: \"aebc0623-951c-431c-9ac0-f7c139f35c12\") " pod="openshift-image-registry/node-ca-bwdsq" Jul 24 12:16:49.528893 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528043 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2371a5d9-c275-4649-a47c-2b92ee94dda0-device-dir\") pod \"aws-ebs-csi-driver-node-7s5lr\" (UID: \"2371a5d9-c275-4649-a47c-2b92ee94dda0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5lr" Jul 24 12:16:49.528893 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528084 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-host-var-lib-cni-multus\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.528893 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:49.528141 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 12:16:49.528893 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528151 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2371a5d9-c275-4649-a47c-2b92ee94dda0-socket-dir\") pod \"aws-ebs-csi-driver-node-7s5lr\" (UID: \"2371a5d9-c275-4649-a47c-2b92ee94dda0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5lr" Jul 24 12:16:49.528893 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528186 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8df0d235-f7c1-4a75-82ab-48d65409bd41-sys\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.528893 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528203 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-host-var-lib-kubelet\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.528893 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528236 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-host-var-lib-cni-multus\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.528893 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528204 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-os-release\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.528893 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528241 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2371a5d9-c275-4649-a47c-2b92ee94dda0-etc-selinux\") pod \"aws-ebs-csi-driver-node-7s5lr\" (UID: \"2371a5d9-c275-4649-a47c-2b92ee94dda0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5lr" Jul 24 12:16:49.528893 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528269 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aebc0623-951c-431c-9ac0-f7c139f35c12-host\") pod \"node-ca-bwdsq\" (UID: \"aebc0623-951c-431c-9ac0-f7c139f35c12\") " pod="openshift-image-registry/node-ca-bwdsq" Jul 24 12:16:49.528893 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528273 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-host-var-lib-kubelet\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.528893 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:49.528299 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d766121-a79e-4f1e-ba3b-ed964d6f05c9-metrics-certs podName:1d766121-a79e-4f1e-ba3b-ed964d6f05c9 nodeName:}" failed. No retries permitted until 2026-07-24 12:16:50.028282305 +0000 UTC m=+3.079527300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d766121-a79e-4f1e-ba3b-ed964d6f05c9-metrics-certs") pod "network-metrics-daemon-v5gc6" (UID: "1d766121-a79e-4f1e-ba3b-ed964d6f05c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 12:16:49.528893 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528328 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2371a5d9-c275-4649-a47c-2b92ee94dda0-registration-dir\") pod \"aws-ebs-csi-driver-node-7s5lr\" (UID: \"2371a5d9-c275-4649-a47c-2b92ee94dda0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5lr" Jul 24 12:16:49.528893 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528318 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8df0d235-f7c1-4a75-82ab-48d65409bd41-etc-modprobe-d\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.528893 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528298 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aebc0623-951c-431c-9ac0-f7c139f35c12-host\") pod \"node-ca-bwdsq\" (UID: \"aebc0623-951c-431c-9ac0-f7c139f35c12\") " pod="openshift-image-registry/node-ca-bwdsq" Jul 24 12:16:49.529706 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528351 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8df0d235-f7c1-4a75-82ab-48d65409bd41-sys\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.529706 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528406 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/853c7ef4-69c4-4310-9a1c-271b3d038857-multus-daemon-config\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.529706 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528415 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2371a5d9-c275-4649-a47c-2b92ee94dda0-device-dir\") pod \"aws-ebs-csi-driver-node-7s5lr\" (UID: \"2371a5d9-c275-4649-a47c-2b92ee94dda0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5lr" Jul 24 12:16:49.529706 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528444 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8df0d235-f7c1-4a75-82ab-48d65409bd41-var-lib-kubelet\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.529706 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528462 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8df0d235-f7c1-4a75-82ab-48d65409bd41-etc-modprobe-d\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.529706 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528469 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8df0d235-f7c1-4a75-82ab-48d65409bd41-tmp\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.529706 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528474 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8df0d235-f7c1-4a75-82ab-48d65409bd41-var-lib-kubelet\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.529706 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528495 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-multus-cni-dir\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.529706 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528519 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-multus-socket-dir-parent\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.529706 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528545 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-hostroot\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.529706 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528615 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-multus-socket-dir-parent\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.529706 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528626 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-multus-cni-dir\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.529706 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528655 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2371a5d9-c275-4649-a47c-2b92ee94dda0-sys-fs\") pod \"aws-ebs-csi-driver-node-7s5lr\" (UID: \"2371a5d9-c275-4649-a47c-2b92ee94dda0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5lr" Jul 24 12:16:49.529706 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528669 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-hostroot\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.529706 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528682 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8df0d235-f7c1-4a75-82ab-48d65409bd41-etc-sysctl-d\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.529706 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528709 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/853c7ef4-69c4-4310-9a1c-271b3d038857-cni-binary-copy\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.529706 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528717 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2371a5d9-c275-4649-a47c-2b92ee94dda0-sys-fs\") pod \"aws-ebs-csi-driver-node-7s5lr\" (UID: \"2371a5d9-c275-4649-a47c-2b92ee94dda0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5lr" Jul 24 12:16:49.529706 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528733 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5eec886f-16aa-409b-97c6-743f0ff1dacf-original-pull-secret\") pod \"global-pull-secret-syncer-rrwlt\" (UID: \"5eec886f-16aa-409b-97c6-743f0ff1dacf\") " pod="kube-system/global-pull-secret-syncer-rrwlt" Jul 24 12:16:49.530621 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:49.528808 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 12:16:49.530621 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528846 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8df0d235-f7c1-4a75-82ab-48d65409bd41-etc-sysctl-d\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.530621 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:49.528852 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5eec886f-16aa-409b-97c6-743f0ff1dacf-original-pull-secret podName:5eec886f-16aa-409b-97c6-743f0ff1dacf nodeName:}" failed. No retries permitted until 2026-07-24 12:16:50.02883626 +0000 UTC m=+3.080081236 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5eec886f-16aa-409b-97c6-743f0ff1dacf-original-pull-secret") pod "global-pull-secret-syncer-rrwlt" (UID: "5eec886f-16aa-409b-97c6-743f0ff1dacf") : object "kube-system"/"original-pull-secret" not registered Jul 24 12:16:49.530621 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528901 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8df0d235-f7c1-4a75-82ab-48d65409bd41-lib-modules\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.530621 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528912 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/853c7ef4-69c4-4310-9a1c-271b3d038857-multus-daemon-config\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.530621 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528962 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q4nx\" (UniqueName: \"kubernetes.io/projected/8df0d235-f7c1-4a75-82ab-48d65409bd41-kube-api-access-6q4nx\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.530621 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.528992 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l75gh\" (UniqueName: \"kubernetes.io/projected/1d766121-a79e-4f1e-ba3b-ed964d6f05c9-kube-api-access-l75gh\") pod \"network-metrics-daemon-v5gc6\" (UID: \"1d766121-a79e-4f1e-ba3b-ed964d6f05c9\") " pod="openshift-multus/network-metrics-daemon-v5gc6" Jul 24 12:16:49.530621 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.529020 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-host-run-multus-certs\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.530621 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.529027 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8df0d235-f7c1-4a75-82ab-48d65409bd41-lib-modules\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.530621 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.529045 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-etc-kubernetes\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.530621 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.529089 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8df0d235-f7c1-4a75-82ab-48d65409bd41-etc-sysctl-conf\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.530621 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.529113 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8df0d235-f7c1-4a75-82ab-48d65409bd41-etc-systemd\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.530621 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.529123 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-etc-kubernetes\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.530621 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.529153 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-host-run-netns\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.530621 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.529169 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/853c7ef4-69c4-4310-9a1c-271b3d038857-cni-binary-copy\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.530621 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.529177 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-host-var-lib-cni-bin\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.530621 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.529171 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8df0d235-f7c1-4a75-82ab-48d65409bd41-etc-systemd\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.531367 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.529200 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-host-run-netns\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.531367 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.529203 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnqhq\" (UniqueName: \"kubernetes.io/projected/aebc0623-951c-431c-9ac0-f7c139f35c12-kube-api-access-tnqhq\") pod \"node-ca-bwdsq\" (UID: \"aebc0623-951c-431c-9ac0-f7c139f35c12\") " pod="openshift-image-registry/node-ca-bwdsq" Jul 24 12:16:49.531367 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.529226 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-host-var-lib-cni-bin\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.531367 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.529233 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8df0d235-f7c1-4a75-82ab-48d65409bd41-etc-tuned\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.531367 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.529089 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/853c7ef4-69c4-4310-9a1c-271b3d038857-host-run-multus-certs\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.531367 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.529264 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8df0d235-f7c1-4a75-82ab-48d65409bd41-etc-sysctl-conf\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.535866 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.535845 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8df0d235-f7c1-4a75-82ab-48d65409bd41-tmp\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.535979 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.535901 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8df0d235-f7c1-4a75-82ab-48d65409bd41-etc-tuned\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.538298 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.538275 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r8xj\" (UniqueName: \"kubernetes.io/projected/2371a5d9-c275-4649-a47c-2b92ee94dda0-kube-api-access-8r8xj\") pod \"aws-ebs-csi-driver-node-7s5lr\" (UID: \"2371a5d9-c275-4649-a47c-2b92ee94dda0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5lr" Jul 24 12:16:49.539437 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.539419 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wljdt\" (UniqueName: \"kubernetes.io/projected/853c7ef4-69c4-4310-9a1c-271b3d038857-kube-api-access-wljdt\") pod \"multus-zflxn\" (UID: \"853c7ef4-69c4-4310-9a1c-271b3d038857\") " pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.540307 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.540280 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnqhq\" (UniqueName: \"kubernetes.io/projected/aebc0623-951c-431c-9ac0-f7c139f35c12-kube-api-access-tnqhq\") pod \"node-ca-bwdsq\" (UID: \"aebc0623-951c-431c-9ac0-f7c139f35c12\") " pod="openshift-image-registry/node-ca-bwdsq" Jul 24 12:16:49.540776 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.540754 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q4nx\" (UniqueName: \"kubernetes.io/projected/8df0d235-f7c1-4a75-82ab-48d65409bd41-kube-api-access-6q4nx\") pod \"tuned-2fdtv\" (UID: \"8df0d235-f7c1-4a75-82ab-48d65409bd41\") " pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.540872 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.540831 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l75gh\" (UniqueName: \"kubernetes.io/projected/1d766121-a79e-4f1e-ba3b-ed964d6f05c9-kube-api-access-l75gh\") pod \"network-metrics-daemon-v5gc6\" (UID: \"1d766121-a79e-4f1e-ba3b-ed964d6f05c9\") " pod="openshift-multus/network-metrics-daemon-v5gc6" Jul 24 12:16:49.610939 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.610900 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qhshz" Jul 24 12:16:49.617651 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.617626 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7xzrz" Jul 24 12:16:49.626430 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.626405 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xr5z4" Jul 24 12:16:49.633278 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.633258 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:16:49.638880 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.638863 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-s74ph" Jul 24 12:16:49.644507 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.644492 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" Jul 24 12:16:49.650566 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.650546 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zflxn" Jul 24 12:16:49.650896 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:49.650874 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dc76beb_b2b1_422c_a272_5623d2fb2f5e.slice/crio-3f207d6bd5c319ed8e462a90aa9ed3269c98df9a3a231f531f42437616ebd0c7 WatchSource:0}: Error finding container 3f207d6bd5c319ed8e462a90aa9ed3269c98df9a3a231f531f42437616ebd0c7: Status 404 returned error can't find the container with id 3f207d6bd5c319ed8e462a90aa9ed3269c98df9a3a231f531f42437616ebd0c7 Jul 24 12:16:49.651961 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:49.651899 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ce505f1_38d9_4827_9141_b691d722aa05.slice/crio-327e7de4cda784fc612b963694951e79f79bb21ce534af1c62d001570b717043 WatchSource:0}: Error finding container 327e7de4cda784fc612b963694951e79f79bb21ce534af1c62d001570b717043: Status 404 returned error can't find the container with id 327e7de4cda784fc612b963694951e79f79bb21ce534af1c62d001570b717043 Jul 24 12:16:49.655215 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:49.655188 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod700d0ca4_8bdd_4a98_a24b_991f0dbe5f48.slice/crio-c852eb6f4d8472526ba242fe930b7a27603473bdbff4461e0f34e0fd6b1986bf WatchSource:0}: Error finding container c852eb6f4d8472526ba242fe930b7a27603473bdbff4461e0f34e0fd6b1986bf: Status 404 returned error can't find the container with id c852eb6f4d8472526ba242fe930b7a27603473bdbff4461e0f34e0fd6b1986bf Jul 24 12:16:49.656141 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:49.656123 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52ae33c6_374a_4670_a197_3368045677ef.slice/crio-df0dfe4f534849c1887ef731a5598a334f170df67da9d22ccbe1243122e86b66 WatchSource:0}: Error finding container df0dfe4f534849c1887ef731a5598a334f170df67da9d22ccbe1243122e86b66: Status 404 returned error can't find the container with id df0dfe4f534849c1887ef731a5598a334f170df67da9d22ccbe1243122e86b66 Jul 24 12:16:49.656590 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.656571 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bwdsq" Jul 24 12:16:49.656810 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:49.656790 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00b2c77a_a7be_488f_bcfc_0d4e139becf3.slice/crio-af7a5cd7e913dadfef58225864b71c8c3a41aae68781592a0fe41d14148c8e8f WatchSource:0}: Error finding container af7a5cd7e913dadfef58225864b71c8c3a41aae68781592a0fe41d14148c8e8f: Status 404 returned error can't find the container with id af7a5cd7e913dadfef58225864b71c8c3a41aae68781592a0fe41d14148c8e8f Jul 24 12:16:49.662188 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.662167 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5lr" Jul 24 12:16:49.680929 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:49.680902 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8df0d235_f7c1_4a75_82ab_48d65409bd41.slice/crio-ee8c8294de67283bd8cf5be8d433059a56a9f3738006e40257ddec8ef64877e9 WatchSource:0}: Error finding container ee8c8294de67283bd8cf5be8d433059a56a9f3738006e40257ddec8ef64877e9: Status 404 returned error can't find the container with id ee8c8294de67283bd8cf5be8d433059a56a9f3738006e40257ddec8ef64877e9 Jul 24 12:16:49.681174 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:49.681153 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod853c7ef4_69c4_4310_9a1c_271b3d038857.slice/crio-0cc29713beebd4c6732aeb1b3b0a01b89101d2191a7b04b117ef829da207e9d8 WatchSource:0}: Error finding container 0cc29713beebd4c6732aeb1b3b0a01b89101d2191a7b04b117ef829da207e9d8: Status 404 returned error can't find the container with id 0cc29713beebd4c6732aeb1b3b0a01b89101d2191a7b04b117ef829da207e9d8 Jul 24 12:16:49.688763 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:49.688742 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2371a5d9_c275_4649_a47c_2b92ee94dda0.slice/crio-9bf86aa357feef21f0d9af5f31a93319b8dc48fe04ee50ca2d50805316541a0d WatchSource:0}: Error finding container 9bf86aa357feef21f0d9af5f31a93319b8dc48fe04ee50ca2d50805316541a0d: Status 404 returned error can't find the container with id 9bf86aa357feef21f0d9af5f31a93319b8dc48fe04ee50ca2d50805316541a0d Jul 24 12:16:49.689569 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:49.689550 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaebc0623_951c_431c_9ac0_f7c139f35c12.slice/crio-7db599887c6bb46f9283820c42f257996e646c3682a4d14616c3bfb8729d7d02 WatchSource:0}: Error finding container 7db599887c6bb46f9283820c42f257996e646c3682a4d14616c3bfb8729d7d02: Status 404 returned error can't find the container with id 7db599887c6bb46f9283820c42f257996e646c3682a4d14616c3bfb8729d7d02 Jul 24 12:16:49.803434 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:16:49.803400 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ae05b6c2b20a8b40089e54c95c6a627.slice/crio-9dbeb3077a8f8dfa5d2aa653d4a106e4f261a3fe13bf35bc1d431d9f9e88d410 WatchSource:0}: Error finding container 9dbeb3077a8f8dfa5d2aa653d4a106e4f261a3fe13bf35bc1d431d9f9e88d410: Status 404 returned error can't find the container with id 9dbeb3077a8f8dfa5d2aa653d4a106e4f261a3fe13bf35bc1d431d9f9e88d410 Jul 24 12:16:49.932128 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:49.932105 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cbn4\" (UniqueName: \"kubernetes.io/projected/7036166d-005a-4b55-bb2b-9445962a0a63-kube-api-access-4cbn4\") pod \"network-check-target-lcjn9\" (UID: \"7036166d-005a-4b55-bb2b-9445962a0a63\") " pod="openshift-network-diagnostics/network-check-target-lcjn9" Jul 24 12:16:49.932264 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:49.932240 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 12:16:49.932264 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:49.932256 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 12:16:49.932264 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:49.932264 2555 projected.go:196] Error preparing data for projected volume kube-api-access-4cbn4 for pod openshift-network-diagnostics/network-check-target-lcjn9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 12:16:49.932375 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:49.932306 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7036166d-005a-4b55-bb2b-9445962a0a63-kube-api-access-4cbn4 podName:7036166d-005a-4b55-bb2b-9445962a0a63 nodeName:}" failed. No retries permitted until 2026-07-24 12:16:50.932293509 +0000 UTC m=+3.983538484 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cbn4" (UniqueName: "kubernetes.io/projected/7036166d-005a-4b55-bb2b-9445962a0a63-kube-api-access-4cbn4") pod "network-check-target-lcjn9" (UID: "7036166d-005a-4b55-bb2b-9445962a0a63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 12:16:50.032965 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:50.032936 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d766121-a79e-4f1e-ba3b-ed964d6f05c9-metrics-certs\") pod \"network-metrics-daemon-v5gc6\" (UID: \"1d766121-a79e-4f1e-ba3b-ed964d6f05c9\") " pod="openshift-multus/network-metrics-daemon-v5gc6" Jul 24 12:16:50.033114 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:50.032981 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5eec886f-16aa-409b-97c6-743f0ff1dacf-original-pull-secret\") pod \"global-pull-secret-syncer-rrwlt\" (UID: \"5eec886f-16aa-409b-97c6-743f0ff1dacf\") " pod="kube-system/global-pull-secret-syncer-rrwlt" Jul 24 12:16:50.033114 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:50.033100 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 12:16:50.033114 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:50.033102 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 12:16:50.033239 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:50.033151 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5eec886f-16aa-409b-97c6-743f0ff1dacf-original-pull-secret podName:5eec886f-16aa-409b-97c6-743f0ff1dacf nodeName:}" failed. No retries permitted until 2026-07-24 12:16:51.03313815 +0000 UTC m=+4.084383119 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5eec886f-16aa-409b-97c6-743f0ff1dacf-original-pull-secret") pod "global-pull-secret-syncer-rrwlt" (UID: "5eec886f-16aa-409b-97c6-743f0ff1dacf") : object "kube-system"/"original-pull-secret" not registered Jul 24 12:16:50.033239 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:50.033163 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d766121-a79e-4f1e-ba3b-ed964d6f05c9-metrics-certs podName:1d766121-a79e-4f1e-ba3b-ed964d6f05c9 nodeName:}" failed. No retries permitted until 2026-07-24 12:16:51.033157355 +0000 UTC m=+4.084402324 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d766121-a79e-4f1e-ba3b-ed964d6f05c9-metrics-certs") pod "network-metrics-daemon-v5gc6" (UID: "1d766121-a79e-4f1e-ba3b-ed964d6f05c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 12:16:50.105381 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:50.104987 2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 12:16:50.365003 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:50.364858 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 12:11:49 +0000 UTC" deadline="2028-04-05 12:35:20.959302378 +0000 UTC" Jul 24 12:16:50.365003 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:50.364889 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14904h18m30.594417829s" Jul 24 12:16:50.429159 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:50.429010 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5lr" event={"ID":"2371a5d9-c275-4649-a47c-2b92ee94dda0","Type":"ContainerStarted","Data":"9bf86aa357feef21f0d9af5f31a93319b8dc48fe04ee50ca2d50805316541a0d"} Jul 24 12:16:50.437560 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:50.437521 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zflxn" event={"ID":"853c7ef4-69c4-4310-9a1c-271b3d038857","Type":"ContainerStarted","Data":"0cc29713beebd4c6732aeb1b3b0a01b89101d2191a7b04b117ef829da207e9d8"} Jul 24 12:16:50.442232 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:50.442203 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xr5z4" event={"ID":"700d0ca4-8bdd-4a98-a24b-991f0dbe5f48","Type":"ContainerStarted","Data":"c852eb6f4d8472526ba242fe930b7a27603473bdbff4461e0f34e0fd6b1986bf"} Jul 24 12:16:50.449349 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:50.449320 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qhshz" event={"ID":"6dc76beb-b2b1-422c-a272-5623d2fb2f5e","Type":"ContainerStarted","Data":"3f207d6bd5c319ed8e462a90aa9ed3269c98df9a3a231f531f42437616ebd0c7"} Jul 24 12:16:50.455843 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:50.455816 2555 generic.go:356] "Generic (PLEG): container finished" podID="ee18992baa5c9766306bd4d83fc1706b" containerID="c47737454115651411af92134fc83f6dc553e927b1bdf2505a3877f48a1eef04" exitCode=0 Jul 24 12:16:50.455943 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:50.455900 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal" event={"ID":"ee18992baa5c9766306bd4d83fc1706b","Type":"ContainerDied","Data":"c47737454115651411af92134fc83f6dc553e927b1bdf2505a3877f48a1eef04"} Jul 24 12:16:50.461110 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:50.460033 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" event={"ID":"8df0d235-f7c1-4a75-82ab-48d65409bd41","Type":"ContainerStarted","Data":"ee8c8294de67283bd8cf5be8d433059a56a9f3738006e40257ddec8ef64877e9"} Jul 24 12:16:50.464993 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:50.464963 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-s74ph" event={"ID":"00b2c77a-a7be-488f-bcfc-0d4e139becf3","Type":"ContainerStarted","Data":"af7a5cd7e913dadfef58225864b71c8c3a41aae68781592a0fe41d14148c8e8f"} Jul 24 12:16:50.466533 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:50.466509 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7xzrz" event={"ID":"52ae33c6-374a-4670-a197-3368045677ef","Type":"ContainerStarted","Data":"df0dfe4f534849c1887ef731a5598a334f170df67da9d22ccbe1243122e86b66"} Jul 24 12:16:50.468845 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:50.468820 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" event={"ID":"4ce505f1-38d9-4827-9141-b691d722aa05","Type":"ContainerStarted","Data":"327e7de4cda784fc612b963694951e79f79bb21ce534af1c62d001570b717043"} Jul 24 12:16:50.472356 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:50.472329 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-109.ec2.internal" event={"ID":"4ae05b6c2b20a8b40089e54c95c6a627","Type":"ContainerStarted","Data":"9dbeb3077a8f8dfa5d2aa653d4a106e4f261a3fe13bf35bc1d431d9f9e88d410"} Jul 24 12:16:50.477155 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:50.477103 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bwdsq" event={"ID":"aebc0623-951c-431c-9ac0-f7c139f35c12","Type":"ContainerStarted","Data":"7db599887c6bb46f9283820c42f257996e646c3682a4d14616c3bfb8729d7d02"} Jul 24 12:16:50.940608 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:50.940555 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cbn4\" (UniqueName: \"kubernetes.io/projected/7036166d-005a-4b55-bb2b-9445962a0a63-kube-api-access-4cbn4\") pod \"network-check-target-lcjn9\" (UID: \"7036166d-005a-4b55-bb2b-9445962a0a63\") " pod="openshift-network-diagnostics/network-check-target-lcjn9" Jul 24 12:16:50.940775 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:50.940723 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 12:16:50.940775 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:50.940741 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 12:16:50.940775 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:50.940755 2555 projected.go:196] Error preparing data for projected volume kube-api-access-4cbn4 for pod openshift-network-diagnostics/network-check-target-lcjn9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 12:16:50.941052 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:50.940814 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7036166d-005a-4b55-bb2b-9445962a0a63-kube-api-access-4cbn4 podName:7036166d-005a-4b55-bb2b-9445962a0a63 nodeName:}" failed. No retries permitted until 2026-07-24 12:16:52.940795188 +0000 UTC m=+5.992040179 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cbn4" (UniqueName: "kubernetes.io/projected/7036166d-005a-4b55-bb2b-9445962a0a63-kube-api-access-4cbn4") pod "network-check-target-lcjn9" (UID: "7036166d-005a-4b55-bb2b-9445962a0a63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 12:16:51.042587 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:51.041755 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d766121-a79e-4f1e-ba3b-ed964d6f05c9-metrics-certs\") pod \"network-metrics-daemon-v5gc6\" (UID: \"1d766121-a79e-4f1e-ba3b-ed964d6f05c9\") " pod="openshift-multus/network-metrics-daemon-v5gc6" Jul 24 12:16:51.042587 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:51.041823 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5eec886f-16aa-409b-97c6-743f0ff1dacf-original-pull-secret\") pod \"global-pull-secret-syncer-rrwlt\" (UID: \"5eec886f-16aa-409b-97c6-743f0ff1dacf\") " pod="kube-system/global-pull-secret-syncer-rrwlt" Jul 24 12:16:51.042587 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:51.041953 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 12:16:51.042587 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:51.042012 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5eec886f-16aa-409b-97c6-743f0ff1dacf-original-pull-secret podName:5eec886f-16aa-409b-97c6-743f0ff1dacf nodeName:}" failed. No retries permitted until 2026-07-24 12:16:53.041994905 +0000 UTC m=+6.093239879 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5eec886f-16aa-409b-97c6-743f0ff1dacf-original-pull-secret") pod "global-pull-secret-syncer-rrwlt" (UID: "5eec886f-16aa-409b-97c6-743f0ff1dacf") : object "kube-system"/"original-pull-secret" not registered Jul 24 12:16:51.042587 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:51.042411 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 12:16:51.042587 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:51.042462 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d766121-a79e-4f1e-ba3b-ed964d6f05c9-metrics-certs podName:1d766121-a79e-4f1e-ba3b-ed964d6f05c9 nodeName:}" failed. No retries permitted until 2026-07-24 12:16:53.042445598 +0000 UTC m=+6.093690579 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d766121-a79e-4f1e-ba3b-ed964d6f05c9-metrics-certs") pod "network-metrics-daemon-v5gc6" (UID: "1d766121-a79e-4f1e-ba3b-ed964d6f05c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 12:16:51.365344 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:51.365201 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 12:11:49 +0000 UTC" deadline="2028-04-06 21:21:41.252782684 +0000 UTC" Jul 24 12:16:51.365344 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:51.365261 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14937h4m49.887526633s" Jul 24 12:16:51.419255 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:51.419180 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrwlt" Jul 24 12:16:51.419255 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:51.419203 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5gc6" Jul 24 12:16:51.419482 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:51.419306 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrwlt" podUID="5eec886f-16aa-409b-97c6-743f0ff1dacf" Jul 24 12:16:51.419482 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:51.419403 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcjn9" Jul 24 12:16:51.419585 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:51.419527 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcjn9" podUID="7036166d-005a-4b55-bb2b-9445962a0a63" Jul 24 12:16:51.419662 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:51.419627 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v5gc6" podUID="1d766121-a79e-4f1e-ba3b-ed964d6f05c9" Jul 24 12:16:51.532101 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:51.531745 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal" event={"ID":"ee18992baa5c9766306bd4d83fc1706b","Type":"ContainerStarted","Data":"2382c61a93128ea8c83618c4fc596fa6e10de2c753e1e23790adb5943c9ae2e3"} Jul 24 12:16:51.550182 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:51.550118 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal" podStartSLOduration=3.550098455 podStartE2EDuration="3.550098455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:16:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:16:51.549015601 +0000 UTC m=+4.600260593" watchObservedRunningTime="2026-07-24 12:16:51.550098455 +0000 UTC m=+4.601343450" Jul 24 12:16:52.969981 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:52.969945 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cbn4\" (UniqueName: \"kubernetes.io/projected/7036166d-005a-4b55-bb2b-9445962a0a63-kube-api-access-4cbn4\") pod \"network-check-target-lcjn9\" (UID: \"7036166d-005a-4b55-bb2b-9445962a0a63\") " pod="openshift-network-diagnostics/network-check-target-lcjn9" Jul 24 12:16:52.970342 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:52.970153 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 12:16:52.970342 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:52.970177 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 12:16:52.970342 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:52.970192 2555 projected.go:196] Error preparing data for projected volume kube-api-access-4cbn4 for pod openshift-network-diagnostics/network-check-target-lcjn9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 12:16:52.970342 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:52.970252 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7036166d-005a-4b55-bb2b-9445962a0a63-kube-api-access-4cbn4 podName:7036166d-005a-4b55-bb2b-9445962a0a63 nodeName:}" failed. No retries permitted until 2026-07-24 12:16:56.97023483 +0000 UTC m=+10.021479811 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cbn4" (UniqueName: "kubernetes.io/projected/7036166d-005a-4b55-bb2b-9445962a0a63-kube-api-access-4cbn4") pod "network-check-target-lcjn9" (UID: "7036166d-005a-4b55-bb2b-9445962a0a63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 12:16:53.072119 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:53.071134 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d766121-a79e-4f1e-ba3b-ed964d6f05c9-metrics-certs\") pod \"network-metrics-daemon-v5gc6\" (UID: \"1d766121-a79e-4f1e-ba3b-ed964d6f05c9\") " pod="openshift-multus/network-metrics-daemon-v5gc6" Jul 24 12:16:53.072119 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:53.071237 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5eec886f-16aa-409b-97c6-743f0ff1dacf-original-pull-secret\") pod \"global-pull-secret-syncer-rrwlt\" (UID: \"5eec886f-16aa-409b-97c6-743f0ff1dacf\") " pod="kube-system/global-pull-secret-syncer-rrwlt" Jul 24 12:16:53.072119 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:53.071409 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 12:16:53.072119 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:53.071473 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5eec886f-16aa-409b-97c6-743f0ff1dacf-original-pull-secret podName:5eec886f-16aa-409b-97c6-743f0ff1dacf nodeName:}" failed. No retries permitted until 2026-07-24 12:16:57.071453075 +0000 UTC m=+10.122698050 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5eec886f-16aa-409b-97c6-743f0ff1dacf-original-pull-secret") pod "global-pull-secret-syncer-rrwlt" (UID: "5eec886f-16aa-409b-97c6-743f0ff1dacf") : object "kube-system"/"original-pull-secret" not registered Jul 24 12:16:53.072119 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:53.071954 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 12:16:53.072119 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:53.072004 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d766121-a79e-4f1e-ba3b-ed964d6f05c9-metrics-certs podName:1d766121-a79e-4f1e-ba3b-ed964d6f05c9 nodeName:}" failed. No retries permitted until 2026-07-24 12:16:57.0719888 +0000 UTC m=+10.123233772 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d766121-a79e-4f1e-ba3b-ed964d6f05c9-metrics-certs") pod "network-metrics-daemon-v5gc6" (UID: "1d766121-a79e-4f1e-ba3b-ed964d6f05c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 12:16:53.417289 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:53.417258 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5gc6" Jul 24 12:16:53.417470 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:53.417421 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v5gc6" podUID="1d766121-a79e-4f1e-ba3b-ed964d6f05c9" Jul 24 12:16:53.417470 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:53.417438 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcjn9" Jul 24 12:16:53.417470 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:53.417463 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrwlt" Jul 24 12:16:53.417619 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:53.417568 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrwlt" podUID="5eec886f-16aa-409b-97c6-743f0ff1dacf" Jul 24 12:16:53.417692 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:53.417652 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcjn9" podUID="7036166d-005a-4b55-bb2b-9445962a0a63" Jul 24 12:16:55.417255 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:55.417221 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrwlt" Jul 24 12:16:55.417255 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:55.417254 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5gc6" Jul 24 12:16:55.417789 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:55.417221 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcjn9" Jul 24 12:16:55.417789 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:55.417347 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrwlt" podUID="5eec886f-16aa-409b-97c6-743f0ff1dacf" Jul 24 12:16:55.417789 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:55.417467 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v5gc6" podUID="1d766121-a79e-4f1e-ba3b-ed964d6f05c9" Jul 24 12:16:55.417789 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:55.417556 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcjn9" podUID="7036166d-005a-4b55-bb2b-9445962a0a63" Jul 24 12:16:57.003524 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:57.003474 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cbn4\" (UniqueName: \"kubernetes.io/projected/7036166d-005a-4b55-bb2b-9445962a0a63-kube-api-access-4cbn4\") pod \"network-check-target-lcjn9\" (UID: \"7036166d-005a-4b55-bb2b-9445962a0a63\") " pod="openshift-network-diagnostics/network-check-target-lcjn9" Jul 24 12:16:57.003994 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:57.003688 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 12:16:57.003994 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:57.003709 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 12:16:57.003994 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:57.003719 2555 projected.go:196] Error preparing data for projected volume kube-api-access-4cbn4 for pod openshift-network-diagnostics/network-check-target-lcjn9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 12:16:57.003994 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:57.003774 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7036166d-005a-4b55-bb2b-9445962a0a63-kube-api-access-4cbn4 podName:7036166d-005a-4b55-bb2b-9445962a0a63 nodeName:}" failed. No retries permitted until 2026-07-24 12:17:05.003755237 +0000 UTC m=+18.055000216 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cbn4" (UniqueName: "kubernetes.io/projected/7036166d-005a-4b55-bb2b-9445962a0a63-kube-api-access-4cbn4") pod "network-check-target-lcjn9" (UID: "7036166d-005a-4b55-bb2b-9445962a0a63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 12:16:57.104895 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:57.104235 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5eec886f-16aa-409b-97c6-743f0ff1dacf-original-pull-secret\") pod \"global-pull-secret-syncer-rrwlt\" (UID: \"5eec886f-16aa-409b-97c6-743f0ff1dacf\") " pod="kube-system/global-pull-secret-syncer-rrwlt" Jul 24 12:16:57.104895 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:57.104335 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d766121-a79e-4f1e-ba3b-ed964d6f05c9-metrics-certs\") pod \"network-metrics-daemon-v5gc6\" (UID: \"1d766121-a79e-4f1e-ba3b-ed964d6f05c9\") " pod="openshift-multus/network-metrics-daemon-v5gc6" Jul 24 12:16:57.104895 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:57.104472 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 12:16:57.104895 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:57.104538 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d766121-a79e-4f1e-ba3b-ed964d6f05c9-metrics-certs podName:1d766121-a79e-4f1e-ba3b-ed964d6f05c9 nodeName:}" failed. No retries permitted until 2026-07-24 12:17:05.104516664 +0000 UTC m=+18.155761654 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d766121-a79e-4f1e-ba3b-ed964d6f05c9-metrics-certs") pod "network-metrics-daemon-v5gc6" (UID: "1d766121-a79e-4f1e-ba3b-ed964d6f05c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 12:16:57.104895 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:57.104854 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 12:16:57.105332 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:57.104940 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5eec886f-16aa-409b-97c6-743f0ff1dacf-original-pull-secret podName:5eec886f-16aa-409b-97c6-743f0ff1dacf nodeName:}" failed. No retries permitted until 2026-07-24 12:17:05.10492191 +0000 UTC m=+18.156166882 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5eec886f-16aa-409b-97c6-743f0ff1dacf-original-pull-secret") pod "global-pull-secret-syncer-rrwlt" (UID: "5eec886f-16aa-409b-97c6-743f0ff1dacf") : object "kube-system"/"original-pull-secret" not registered Jul 24 12:16:57.417199 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:57.417164 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcjn9" Jul 24 12:16:57.417380 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:57.417254 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcjn9" podUID="7036166d-005a-4b55-bb2b-9445962a0a63" Jul 24 12:16:57.417380 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:57.417309 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5gc6" Jul 24 12:16:57.417508 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:57.417385 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrwlt" Jul 24 12:16:57.417508 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:57.417485 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrwlt" podUID="5eec886f-16aa-409b-97c6-743f0ff1dacf" Jul 24 12:16:57.417613 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:57.417573 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v5gc6" podUID="1d766121-a79e-4f1e-ba3b-ed964d6f05c9" Jul 24 12:16:59.417431 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:59.416920 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrwlt" Jul 24 12:16:59.417431 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:59.416953 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcjn9" Jul 24 12:16:59.417431 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:16:59.416920 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5gc6" Jul 24 12:16:59.417431 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:59.417076 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrwlt" podUID="5eec886f-16aa-409b-97c6-743f0ff1dacf" Jul 24 12:16:59.417431 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:59.417186 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcjn9" podUID="7036166d-005a-4b55-bb2b-9445962a0a63" Jul 24 12:16:59.417431 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:16:59.417297 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v5gc6" podUID="1d766121-a79e-4f1e-ba3b-ed964d6f05c9" Jul 24 12:17:01.417076 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:01.417026 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcjn9" Jul 24 12:17:01.417541 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:01.417026 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrwlt" Jul 24 12:17:01.417541 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:01.417156 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcjn9" podUID="7036166d-005a-4b55-bb2b-9445962a0a63" Jul 24 12:17:01.417541 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:01.417253 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrwlt" podUID="5eec886f-16aa-409b-97c6-743f0ff1dacf" Jul 24 12:17:01.417541 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:01.417026 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5gc6" Jul 24 12:17:01.417541 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:01.417337 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v5gc6" podUID="1d766121-a79e-4f1e-ba3b-ed964d6f05c9" Jul 24 12:17:03.417372 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:03.417339 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcjn9" Jul 24 12:17:03.417372 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:03.417376 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5gc6" Jul 24 12:17:03.417872 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:03.417340 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrwlt" Jul 24 12:17:03.417872 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:03.417455 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcjn9" podUID="7036166d-005a-4b55-bb2b-9445962a0a63" Jul 24 12:17:03.417872 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:03.417514 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrwlt" podUID="5eec886f-16aa-409b-97c6-743f0ff1dacf" Jul 24 12:17:03.417872 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:03.417605 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v5gc6" podUID="1d766121-a79e-4f1e-ba3b-ed964d6f05c9" Jul 24 12:17:05.068765 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:05.068723 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cbn4\" (UniqueName: \"kubernetes.io/projected/7036166d-005a-4b55-bb2b-9445962a0a63-kube-api-access-4cbn4\") pod \"network-check-target-lcjn9\" (UID: \"7036166d-005a-4b55-bb2b-9445962a0a63\") " pod="openshift-network-diagnostics/network-check-target-lcjn9" Jul 24 12:17:05.069388 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:05.068890 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 12:17:05.069388 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:05.068914 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 12:17:05.069388 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:05.068925 2555 projected.go:196] Error preparing data for projected volume kube-api-access-4cbn4 for pod openshift-network-diagnostics/network-check-target-lcjn9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 12:17:05.069388 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:05.068975 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7036166d-005a-4b55-bb2b-9445962a0a63-kube-api-access-4cbn4 podName:7036166d-005a-4b55-bb2b-9445962a0a63 nodeName:}" failed. No retries permitted until 2026-07-24 12:17:21.068961422 +0000 UTC m=+34.120206398 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cbn4" (UniqueName: "kubernetes.io/projected/7036166d-005a-4b55-bb2b-9445962a0a63-kube-api-access-4cbn4") pod "network-check-target-lcjn9" (UID: "7036166d-005a-4b55-bb2b-9445962a0a63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 12:17:05.169835 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:05.169795 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d766121-a79e-4f1e-ba3b-ed964d6f05c9-metrics-certs\") pod \"network-metrics-daemon-v5gc6\" (UID: \"1d766121-a79e-4f1e-ba3b-ed964d6f05c9\") " pod="openshift-multus/network-metrics-daemon-v5gc6" Jul 24 12:17:05.170022 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:05.169874 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5eec886f-16aa-409b-97c6-743f0ff1dacf-original-pull-secret\") pod \"global-pull-secret-syncer-rrwlt\" (UID: \"5eec886f-16aa-409b-97c6-743f0ff1dacf\") " pod="kube-system/global-pull-secret-syncer-rrwlt" Jul 24 12:17:05.170022 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:05.169919 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 12:17:05.170022 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:05.169992 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 12:17:05.170022 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:05.170005 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d766121-a79e-4f1e-ba3b-ed964d6f05c9-metrics-certs podName:1d766121-a79e-4f1e-ba3b-ed964d6f05c9 nodeName:}" failed. No retries permitted until 2026-07-24 12:17:21.169984044 +0000 UTC m=+34.221229027 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d766121-a79e-4f1e-ba3b-ed964d6f05c9-metrics-certs") pod "network-metrics-daemon-v5gc6" (UID: "1d766121-a79e-4f1e-ba3b-ed964d6f05c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 12:17:05.170238 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:05.170055 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5eec886f-16aa-409b-97c6-743f0ff1dacf-original-pull-secret podName:5eec886f-16aa-409b-97c6-743f0ff1dacf nodeName:}" failed. No retries permitted until 2026-07-24 12:17:21.170039344 +0000 UTC m=+34.221284315 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5eec886f-16aa-409b-97c6-743f0ff1dacf-original-pull-secret") pod "global-pull-secret-syncer-rrwlt" (UID: "5eec886f-16aa-409b-97c6-743f0ff1dacf") : object "kube-system"/"original-pull-secret" not registered Jul 24 12:17:05.417456 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:05.417425 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcjn9" Jul 24 12:17:05.417456 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:05.417443 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5gc6" Jul 24 12:17:05.417690 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:05.417515 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrwlt" Jul 24 12:17:05.417690 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:05.417620 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcjn9" podUID="7036166d-005a-4b55-bb2b-9445962a0a63" Jul 24 12:17:05.417801 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:05.417717 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrwlt" podUID="5eec886f-16aa-409b-97c6-743f0ff1dacf" Jul 24 12:17:05.417847 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:05.417800 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v5gc6" podUID="1d766121-a79e-4f1e-ba3b-ed964d6f05c9" Jul 24 12:17:07.419290 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:07.419259 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcjn9" Jul 24 12:17:07.419715 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:07.419370 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcjn9" podUID="7036166d-005a-4b55-bb2b-9445962a0a63" Jul 24 12:17:07.419715 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:07.419439 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrwlt" Jul 24 12:17:07.419715 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:07.419586 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrwlt" podUID="5eec886f-16aa-409b-97c6-743f0ff1dacf" Jul 24 12:17:07.419715 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:07.419632 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5gc6" Jul 24 12:17:07.419715 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:07.419691 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v5gc6" podUID="1d766121-a79e-4f1e-ba3b-ed964d6f05c9" Jul 24 12:17:09.420231 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:09.419960 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcjn9" Jul 24 12:17:09.420752 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:09.419983 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrwlt" Jul 24 12:17:09.420752 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:09.420343 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcjn9" podUID="7036166d-005a-4b55-bb2b-9445962a0a63" Jul 24 12:17:09.420752 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:09.419985 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5gc6" Jul 24 12:17:09.420752 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:09.420376 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrwlt" podUID="5eec886f-16aa-409b-97c6-743f0ff1dacf" Jul 24 12:17:09.420752 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:09.420453 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v5gc6" podUID="1d766121-a79e-4f1e-ba3b-ed964d6f05c9" Jul 24 12:17:09.569773 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:09.569737 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-109.ec2.internal" event={"ID":"4ae05b6c2b20a8b40089e54c95c6a627","Type":"ContainerStarted","Data":"e6846c53f60fcb11207ffbf6e4fe3e8694796184a74bd07a2dbddfe6a04b75c7"} Jul 24 12:17:09.571401 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:09.571370 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bwdsq" event={"ID":"aebc0623-951c-431c-9ac0-f7c139f35c12","Type":"ContainerStarted","Data":"1cfcb98d1166c0902006b54eb747a3777b899b44b662fa4771b3c8f7a3c53315"} Jul 24 12:17:09.572889 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:09.572865 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5lr" event={"ID":"2371a5d9-c275-4649-a47c-2b92ee94dda0","Type":"ContainerStarted","Data":"b2e34fbf9221d4f853b79765e697364c9ca5bb5f3b799c07f9bb0d3bd45e441c"} Jul 24 12:17:09.574171 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:09.574151 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zflxn" event={"ID":"853c7ef4-69c4-4310-9a1c-271b3d038857","Type":"ContainerStarted","Data":"84f77bcc61e86ee0763c38023d81128c1e1144c36ef5fe56b5609cb66e1f6ab6"} Jul 24 12:17:09.575358 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:09.575341 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qhshz" event={"ID":"6dc76beb-b2b1-422c-a272-5623d2fb2f5e","Type":"ContainerStarted","Data":"8fe25273b6e51a7aa41a908aa6102e00ae017097584f6aeeeb33302806e3e56b"} Jul 24 12:17:09.576568 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:09.576547 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" event={"ID":"8df0d235-f7c1-4a75-82ab-48d65409bd41","Type":"ContainerStarted","Data":"dba7601144ef1bbb6683261b00754236a03c4a4feee0d0125b8d25182505a083"} Jul 24 12:17:09.577722 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:09.577704 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-s74ph" event={"ID":"00b2c77a-a7be-488f-bcfc-0d4e139becf3","Type":"ContainerStarted","Data":"bd97296296fc088a5fae26626988f0df7a1cf12d077847fee0e2d0f7caa9823a"} Jul 24 12:17:09.578933 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:09.578910 2555 generic.go:356] "Generic (PLEG): container finished" podID="52ae33c6-374a-4670-a197-3368045677ef" containerID="101f13208e229b4b0d43a03d9ecab6116af26f21df8d658593f0c7290ed1a268" exitCode=0 Jul 24 12:17:09.578997 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:09.578944 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7xzrz" event={"ID":"52ae33c6-374a-4670-a197-3368045677ef","Type":"ContainerDied","Data":"101f13208e229b4b0d43a03d9ecab6116af26f21df8d658593f0c7290ed1a268"} Jul 24 12:17:09.598364 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:09.598326 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-109.ec2.internal" podStartSLOduration=21.598311842 podStartE2EDuration="21.598311842s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:16:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:17:09.584603874 +0000 UTC m=+22.635848867" watchObservedRunningTime="2026-07-24 12:17:09.598311842 +0000 UTC m=+22.649556833" Jul 24 12:17:09.598501 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:09.598484 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qhshz" podStartSLOduration=3.288491213 podStartE2EDuration="22.598478856s" totalImagesPullingTime="19.309987643s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:16:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:17:09.59783747 +0000 UTC m=+22.649082462" watchObservedRunningTime="2026-07-24 12:17:09.598478856 +0000 UTC m=+22.649723847" Jul 24 12:17:09.653688 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:09.653645 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-s74ph" podStartSLOduration=3.386697424 podStartE2EDuration="22.653630973s" totalImagesPullingTime="19.266933549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:16:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:17:09.636798728 +0000 UTC m=+22.688043748" watchObservedRunningTime="2026-07-24 12:17:09.653630973 +0000 UTC m=+22.704875965" Jul 24 12:17:09.653795 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:09.653780 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2fdtv" podStartSLOduration=3.372321691 podStartE2EDuration="22.653775701s" totalImagesPullingTime="19.28145401s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:16:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:17:09.653509399 +0000 UTC m=+22.704754390" watchObservedRunningTime="2026-07-24 12:17:09.653775701 +0000 UTC m=+22.705020693" Jul 24 12:17:09.673259 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:09.673140 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zflxn" podStartSLOduration=3.391728057 podStartE2EDuration="22.673124959s" totalImagesPullingTime="19.281396902s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:16:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:17:09.672702125 +0000 UTC m=+22.723947115" watchObservedRunningTime="2026-07-24 12:17:09.673124959 +0000 UTC m=+22.724369964" Jul 24 12:17:10.565990 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:10.565728 2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 24 12:17:10.583250 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:10.583222 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5lr" event={"ID":"2371a5d9-c275-4649-a47c-2b92ee94dda0","Type":"ContainerStarted","Data":"f6fe99eb8adb77fa6038324cc11e0c7aa3138e094065a75180e9c929194fbc32"} Jul 24 12:17:10.584802 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:10.584778 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xr5z4" event={"ID":"700d0ca4-8bdd-4a98-a24b-991f0dbe5f48","Type":"ContainerStarted","Data":"8e5b8f20dc07595b5bbb62ccc5c197ed2f6533894a1e13339dd167cca04351de"} Jul 24 12:17:10.587833 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:10.587814 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ssvdc_4ce505f1-38d9-4827-9141-b691d722aa05/ovn-acl-logging/0.log" Jul 24 12:17:10.588295 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:10.588271 2555 generic.go:356] "Generic (PLEG): container finished" podID="4ce505f1-38d9-4827-9141-b691d722aa05" containerID="9b90dfec82d6be1a29e8809353a4ee3dcbf0a4da960d497ba8ed2cd647706664" exitCode=1 Jul 24 12:17:10.588387 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:10.588364 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" event={"ID":"4ce505f1-38d9-4827-9141-b691d722aa05","Type":"ContainerStarted","Data":"4776ab926b7c70fa0e504e75a8dd8fe3e8c851b90103a161249c97874dccba19"} Jul 24 12:17:10.588528 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:10.588439 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" event={"ID":"4ce505f1-38d9-4827-9141-b691d722aa05","Type":"ContainerStarted","Data":"8d8c3c0a5c9a46d42110f0f0b8cd515b922238b4f64f80aa573fc1616d03dead"} Jul 24 12:17:10.588528 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:10.588501 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" event={"ID":"4ce505f1-38d9-4827-9141-b691d722aa05","Type":"ContainerStarted","Data":"be7a51171a860eb0478600cbde0714da5adca9a76b5de5bed4a6f553819ce309"} Jul 24 12:17:10.588621 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:10.588540 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" event={"ID":"4ce505f1-38d9-4827-9141-b691d722aa05","Type":"ContainerStarted","Data":"240113612f54a88b638e44cb4594111ba40525dccc4b84e8cb726abfae6a6f99"} Jul 24 12:17:10.588621 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:10.588595 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" event={"ID":"4ce505f1-38d9-4827-9141-b691d722aa05","Type":"ContainerDied","Data":"9b90dfec82d6be1a29e8809353a4ee3dcbf0a4da960d497ba8ed2cd647706664"} Jul 24 12:17:10.588721 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:10.588665 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" event={"ID":"4ce505f1-38d9-4827-9141-b691d722aa05","Type":"ContainerStarted","Data":"855ac13ef2d672476af0425ef631b758eef484035f2008e46eb0ef2cbb547fa8"} Jul 24 12:17:10.599688 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:10.599607 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bwdsq" podStartSLOduration=4.364576334 podStartE2EDuration="23.599588733s" totalImagesPullingTime="19.235012399s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:16:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:17:09.693643596 +0000 UTC m=+22.744888588" watchObservedRunningTime="2026-07-24 12:17:10.599588733 +0000 UTC m=+23.650833725" Jul 24 12:17:10.600073 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:10.600023 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xr5z4" podStartSLOduration=4.332184855 podStartE2EDuration="23.600014262s" totalImagesPullingTime="19.267829407s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:16:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:17:10.599535474 +0000 UTC m=+23.650780466" watchObservedRunningTime="2026-07-24 12:17:10.600014262 +0000 UTC m=+23.651259287" Jul 24 12:17:11.372832 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:11.372722 2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T12:17:10.565963421Z","UUID":"50e51df7-85d7-46c4-be1e-45c46d0f41e0","Handler":null,"Name":"","Endpoint":""} Jul 24 12:17:11.374125 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:11.374097 2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 24 12:17:11.374246 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:11.374137 2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 24 12:17:11.421939 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:11.421722 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5gc6" Jul 24 12:17:11.422114 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:11.421769 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcjn9" Jul 24 12:17:11.422114 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:11.422052 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v5gc6" podUID="1d766121-a79e-4f1e-ba3b-ed964d6f05c9" Jul 24 12:17:11.422114 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:11.421813 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrwlt" Jul 24 12:17:11.422290 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:11.422141 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcjn9" podUID="7036166d-005a-4b55-bb2b-9445962a0a63" Jul 24 12:17:11.422290 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:11.422238 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrwlt" podUID="5eec886f-16aa-409b-97c6-743f0ff1dacf" Jul 24 12:17:11.660919 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:11.660893 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-s74ph" Jul 24 12:17:11.662203 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:11.662182 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-s74ph" Jul 24 12:17:12.592563 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:12.592528 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-s74ph" Jul 24 12:17:12.593244 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:12.593225 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-s74ph" Jul 24 12:17:13.417174 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:13.417097 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5gc6" Jul 24 12:17:13.417786 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:13.417101 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrwlt" Jul 24 12:17:13.417786 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:13.417246 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v5gc6" podUID="1d766121-a79e-4f1e-ba3b-ed964d6f05c9" Jul 24 12:17:13.417786 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:13.417101 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcjn9" Jul 24 12:17:13.417786 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:13.417305 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrwlt" podUID="5eec886f-16aa-409b-97c6-743f0ff1dacf" Jul 24 12:17:13.417786 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:13.417366 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcjn9" podUID="7036166d-005a-4b55-bb2b-9445962a0a63" Jul 24 12:17:14.599007 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:14.598971 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5lr" event={"ID":"2371a5d9-c275-4649-a47c-2b92ee94dda0","Type":"ContainerStarted","Data":"caa40a112d4339554c01d7de93b470e49cd70dcd91a6620b2651ce34bd8590f6"} Jul 24 12:17:14.600608 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:14.600581 2555 generic.go:356] "Generic (PLEG): container finished" podID="52ae33c6-374a-4670-a197-3368045677ef" containerID="1a86d7391916963e389a32d0c48b0b9c37126f7449fcdbd9ad49a18ac0e2b432" exitCode=0 Jul 24 12:17:14.600731 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:14.600659 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7xzrz" event={"ID":"52ae33c6-374a-4670-a197-3368045677ef","Type":"ContainerDied","Data":"1a86d7391916963e389a32d0c48b0b9c37126f7449fcdbd9ad49a18ac0e2b432"} Jul 24 12:17:14.603670 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:14.603648 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ssvdc_4ce505f1-38d9-4827-9141-b691d722aa05/ovn-acl-logging/0.log" Jul 24 12:17:14.604235 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:14.604218 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" event={"ID":"4ce505f1-38d9-4827-9141-b691d722aa05","Type":"ContainerStarted","Data":"68c382aaee571f7745860830d248c9f54556a694d55e0c854547d20405878179"} Jul 24 12:17:14.619261 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:14.619224 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5lr" podStartSLOduration=3.830213724 podStartE2EDuration="27.619213263s" totalImagesPullingTime="23.788999539s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:16:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:17:14.618025245 +0000 UTC m=+27.669270230" watchObservedRunningTime="2026-07-24 12:17:14.619213263 +0000 UTC m=+27.670458254" Jul 24 12:17:15.417340 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:15.417311 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcjn9" Jul 24 12:17:15.417340 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:15.417311 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrwlt" Jul 24 12:17:15.417551 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:15.417369 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5gc6" Jul 24 12:17:15.417551 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:15.417451 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrwlt" podUID="5eec886f-16aa-409b-97c6-743f0ff1dacf" Jul 24 12:17:15.417551 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:15.417496 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v5gc6" podUID="1d766121-a79e-4f1e-ba3b-ed964d6f05c9" Jul 24 12:17:15.417681 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:15.417583 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcjn9" podUID="7036166d-005a-4b55-bb2b-9445962a0a63" Jul 24 12:17:16.610597 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:16.610416 2555 generic.go:356] "Generic (PLEG): container finished" podID="52ae33c6-374a-4670-a197-3368045677ef" containerID="310563f6756d532645db1ebd0dcd09858177dd196973ad05f8b1061caaa57470" exitCode=0 Jul 24 12:17:16.611051 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:16.610505 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7xzrz" event={"ID":"52ae33c6-374a-4670-a197-3368045677ef","Type":"ContainerDied","Data":"310563f6756d532645db1ebd0dcd09858177dd196973ad05f8b1061caaa57470"} Jul 24 12:17:16.614084 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:16.614055 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ssvdc_4ce505f1-38d9-4827-9141-b691d722aa05/ovn-acl-logging/0.log" Jul 24 12:17:16.614403 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:16.614386 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" event={"ID":"4ce505f1-38d9-4827-9141-b691d722aa05","Type":"ContainerStarted","Data":"0f31c900ced83626cf1df124a317cb9d184ae4c839be02d5353be1e3aca00c00"} Jul 24 12:17:16.614648 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:16.614632 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:17:16.614717 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:16.614694 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:17:16.614768 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:16.614742 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:17:16.614768 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:16.614761 2555 scope.go:117] "RemoveContainer" containerID="9b90dfec82d6be1a29e8809353a4ee3dcbf0a4da960d497ba8ed2cd647706664" Jul 24 12:17:16.631642 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:16.631621 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:17:16.632019 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:16.632005 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:17:17.418080 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:17.417576 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5gc6" Jul 24 12:17:17.418080 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:17.417614 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcjn9" Jul 24 12:17:17.418080 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:17.417638 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrwlt" Jul 24 12:17:17.418080 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:17.417925 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v5gc6" podUID="1d766121-a79e-4f1e-ba3b-ed964d6f05c9" Jul 24 12:17:17.418080 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:17.418035 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrwlt" podUID="5eec886f-16aa-409b-97c6-743f0ff1dacf" Jul 24 12:17:17.418429 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:17.418116 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcjn9" podUID="7036166d-005a-4b55-bb2b-9445962a0a63" Jul 24 12:17:17.619898 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:17.619859 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ssvdc_4ce505f1-38d9-4827-9141-b691d722aa05/ovn-acl-logging/0.log" Jul 24 12:17:17.620320 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:17.620164 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" event={"ID":"4ce505f1-38d9-4827-9141-b691d722aa05","Type":"ContainerStarted","Data":"447f8f27ef2196c545f3ffaab4e6e43fb52e3a9a8db6e797e91b875fd704c31d"} Jul 24 12:17:17.649077 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:17.649019 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" podStartSLOduration=10.733964183 podStartE2EDuration="30.649002875s" totalImagesPullingTime="19.915038692s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:16:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:17:17.648451275 +0000 UTC m=+30.699696287" watchObservedRunningTime="2026-07-24 12:17:17.649002875 +0000 UTC m=+30.700247866" Jul 24 12:17:18.327128 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:18.327092 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rrwlt"] Jul 24 12:17:18.327274 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:18.327262 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrwlt" Jul 24 12:17:18.327409 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:18.327383 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrwlt" podUID="5eec886f-16aa-409b-97c6-743f0ff1dacf" Jul 24 12:17:18.330369 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:18.330340 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lcjn9"] Jul 24 12:17:18.330479 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:18.330462 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcjn9" Jul 24 12:17:18.330610 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:18.330562 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcjn9" podUID="7036166d-005a-4b55-bb2b-9445962a0a63" Jul 24 12:17:18.331003 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:18.330981 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v5gc6"] Jul 24 12:17:18.331180 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:18.331161 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5gc6" Jul 24 12:17:18.331375 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:18.331290 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v5gc6" podUID="1d766121-a79e-4f1e-ba3b-ed964d6f05c9" Jul 24 12:17:18.624419 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:18.624386 2555 generic.go:356] "Generic (PLEG): container finished" podID="52ae33c6-374a-4670-a197-3368045677ef" containerID="95f005f733f232b759dc31cf703c9f46c42b1e897ac9f52db7deefb91fbbf74a" exitCode=0 Jul 24 12:17:18.624972 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:18.624476 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7xzrz" event={"ID":"52ae33c6-374a-4670-a197-3368045677ef","Type":"ContainerDied","Data":"95f005f733f232b759dc31cf703c9f46c42b1e897ac9f52db7deefb91fbbf74a"} Jul 24 12:17:20.417267 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:20.417183 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcjn9" Jul 24 12:17:20.417267 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:20.417228 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrwlt" Jul 24 12:17:20.417267 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:20.417231 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5gc6" Jul 24 12:17:20.417982 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:20.417320 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcjn9" podUID="7036166d-005a-4b55-bb2b-9445962a0a63" Jul 24 12:17:20.417982 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:20.417409 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrwlt" podUID="5eec886f-16aa-409b-97c6-743f0ff1dacf" Jul 24 12:17:20.417982 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:20.417496 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v5gc6" podUID="1d766121-a79e-4f1e-ba3b-ed964d6f05c9" Jul 24 12:17:21.091720 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.091680 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cbn4\" (UniqueName: \"kubernetes.io/projected/7036166d-005a-4b55-bb2b-9445962a0a63-kube-api-access-4cbn4\") pod \"network-check-target-lcjn9\" (UID: \"7036166d-005a-4b55-bb2b-9445962a0a63\") " pod="openshift-network-diagnostics/network-check-target-lcjn9" Jul 24 12:17:21.091910 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:21.091882 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 12:17:21.091910 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:21.091905 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 12:17:21.091910 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:21.091919 2555 projected.go:196] Error preparing data for projected volume kube-api-access-4cbn4 for pod openshift-network-diagnostics/network-check-target-lcjn9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 12:17:21.092117 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:21.091983 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7036166d-005a-4b55-bb2b-9445962a0a63-kube-api-access-4cbn4 podName:7036166d-005a-4b55-bb2b-9445962a0a63 nodeName:}" failed. No retries permitted until 2026-07-24 12:17:53.09196302 +0000 UTC m=+66.143208002 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cbn4" (UniqueName: "kubernetes.io/projected/7036166d-005a-4b55-bb2b-9445962a0a63-kube-api-access-4cbn4") pod "network-check-target-lcjn9" (UID: "7036166d-005a-4b55-bb2b-9445962a0a63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 12:17:21.193075 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.193021 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5eec886f-16aa-409b-97c6-743f0ff1dacf-original-pull-secret\") pod \"global-pull-secret-syncer-rrwlt\" (UID: \"5eec886f-16aa-409b-97c6-743f0ff1dacf\") " pod="kube-system/global-pull-secret-syncer-rrwlt" Jul 24 12:17:21.193252 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.193134 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d766121-a79e-4f1e-ba3b-ed964d6f05c9-metrics-certs\") pod \"network-metrics-daemon-v5gc6\" (UID: \"1d766121-a79e-4f1e-ba3b-ed964d6f05c9\") " pod="openshift-multus/network-metrics-daemon-v5gc6" Jul 24 12:17:21.193252 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:21.193171 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 12:17:21.193252 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:21.193236 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5eec886f-16aa-409b-97c6-743f0ff1dacf-original-pull-secret podName:5eec886f-16aa-409b-97c6-743f0ff1dacf nodeName:}" failed. No retries permitted until 2026-07-24 12:17:53.193222475 +0000 UTC m=+66.244467446 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5eec886f-16aa-409b-97c6-743f0ff1dacf-original-pull-secret") pod "global-pull-secret-syncer-rrwlt" (UID: "5eec886f-16aa-409b-97c6-743f0ff1dacf") : object "kube-system"/"original-pull-secret" not registered Jul 24 12:17:21.193434 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:21.193260 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 12:17:21.193434 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:21.193316 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d766121-a79e-4f1e-ba3b-ed964d6f05c9-metrics-certs podName:1d766121-a79e-4f1e-ba3b-ed964d6f05c9 nodeName:}" failed. No retries permitted until 2026-07-24 12:17:53.193299767 +0000 UTC m=+66.244544743 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d766121-a79e-4f1e-ba3b-ed964d6f05c9-metrics-certs") pod "network-metrics-daemon-v5gc6" (UID: "1d766121-a79e-4f1e-ba3b-ed964d6f05c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 12:17:21.774584 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.774554 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeReady" Jul 24 12:17:21.775023 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.774698 2555 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 24 12:17:21.809675 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.809643 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59c89c9f84-ldxwc"] Jul 24 12:17:21.814794 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.814766 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" Jul 24 12:17:21.817452 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.817421 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 24 12:17:21.817661 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.817643 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 24 12:17:21.817805 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.817785 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 24 12:17:21.817888 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.817785 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wjjb4\"" Jul 24 12:17:21.822051 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.822029 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mzw5p"] Jul 24 12:17:21.825272 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.825254 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 24 12:17:21.825817 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.825803 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mzw5p" Jul 24 12:17:21.829025 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.828668 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 24 12:17:21.829025 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.828727 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-b8xd9\"" Jul 24 12:17:21.829025 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.828668 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 24 12:17:21.829236 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.829093 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 24 12:17:21.830136 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.830095 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59c89c9f84-ldxwc"] Jul 24 12:17:21.831186 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.830970 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8q6d8"] Jul 24 12:17:21.835373 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.835353 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mzw5p"] Jul 24 12:17:21.835469 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.835462 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8q6d8" Jul 24 12:17:21.838012 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.837983 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-54nwn\"" Jul 24 12:17:21.838177 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.837985 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 24 12:17:21.838177 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.838041 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 24 12:17:21.844971 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.844951 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8q6d8"] Jul 24 12:17:21.999620 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.999584 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f6e6a89-d316-425a-9138-c0318824371d-ca-trust-extracted\") pod \"image-registry-59c89c9f84-ldxwc\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" Jul 24 12:17:21.999808 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.999631 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f6e6a89-d316-425a-9138-c0318824371d-trusted-ca\") pod \"image-registry-59c89c9f84-ldxwc\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" Jul 24 12:17:21.999808 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.999663 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wk8x\" (UniqueName: \"kubernetes.io/projected/8f6e6a89-d316-425a-9138-c0318824371d-kube-api-access-5wk8x\") pod \"image-registry-59c89c9f84-ldxwc\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" Jul 24 12:17:21.999808 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.999694 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnnrk\" (UniqueName: \"kubernetes.io/projected/b8daa84c-73b5-4346-8f92-81dd451dfaa5-kube-api-access-lnnrk\") pod \"dns-default-8q6d8\" (UID: \"b8daa84c-73b5-4346-8f92-81dd451dfaa5\") " pod="openshift-dns/dns-default-8q6d8" Jul 24 12:17:21.999808 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.999726 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f6e6a89-d316-425a-9138-c0318824371d-registry-tls\") pod \"image-registry-59c89c9f84-ldxwc\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" Jul 24 12:17:21.999808 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.999752 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f6e6a89-d316-425a-9138-c0318824371d-registry-certificates\") pod \"image-registry-59c89c9f84-ldxwc\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" Jul 24 12:17:21.999808 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.999787 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lsx2\" (UniqueName: \"kubernetes.io/projected/22ea11f4-48aa-48a3-9310-eb5ad5ceef5c-kube-api-access-6lsx2\") pod \"ingress-canary-mzw5p\" (UID: \"22ea11f4-48aa-48a3-9310-eb5ad5ceef5c\") " pod="openshift-ingress-canary/ingress-canary-mzw5p" Jul 24 12:17:22.000102 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.999890 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f6e6a89-d316-425a-9138-c0318824371d-bound-sa-token\") pod \"image-registry-59c89c9f84-ldxwc\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" Jul 24 12:17:22.000102 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.999925 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22ea11f4-48aa-48a3-9310-eb5ad5ceef5c-cert\") pod \"ingress-canary-mzw5p\" (UID: \"22ea11f4-48aa-48a3-9310-eb5ad5ceef5c\") " pod="openshift-ingress-canary/ingress-canary-mzw5p" Jul 24 12:17:22.000102 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.999943 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8daa84c-73b5-4346-8f92-81dd451dfaa5-tmp-dir\") pod \"dns-default-8q6d8\" (UID: \"b8daa84c-73b5-4346-8f92-81dd451dfaa5\") " pod="openshift-dns/dns-default-8q6d8" Jul 24 12:17:22.000102 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.999963 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8f6e6a89-d316-425a-9138-c0318824371d-image-registry-private-configuration\") pod \"image-registry-59c89c9f84-ldxwc\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" Jul 24 12:17:22.000102 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:21.999985 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f6e6a89-d316-425a-9138-c0318824371d-installation-pull-secrets\") pod \"image-registry-59c89c9f84-ldxwc\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" Jul 24 12:17:22.000102 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.000001 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b8daa84c-73b5-4346-8f92-81dd451dfaa5-config-volume\") pod \"dns-default-8q6d8\" (UID: \"b8daa84c-73b5-4346-8f92-81dd451dfaa5\") " pod="openshift-dns/dns-default-8q6d8" Jul 24 12:17:22.000354 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.000132 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8daa84c-73b5-4346-8f92-81dd451dfaa5-metrics-tls\") pod \"dns-default-8q6d8\" (UID: \"b8daa84c-73b5-4346-8f92-81dd451dfaa5\") " pod="openshift-dns/dns-default-8q6d8" Jul 24 12:17:22.101002 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.100958 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f6e6a89-d316-425a-9138-c0318824371d-registry-tls\") pod \"image-registry-59c89c9f84-ldxwc\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" Jul 24 12:17:22.101207 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.101014 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f6e6a89-d316-425a-9138-c0318824371d-registry-certificates\") pod \"image-registry-59c89c9f84-ldxwc\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" Jul 24 12:17:22.101207 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.101043 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lsx2\" (UniqueName: \"kubernetes.io/projected/22ea11f4-48aa-48a3-9310-eb5ad5ceef5c-kube-api-access-6lsx2\") pod \"ingress-canary-mzw5p\" (UID: \"22ea11f4-48aa-48a3-9310-eb5ad5ceef5c\") " pod="openshift-ingress-canary/ingress-canary-mzw5p" Jul 24 12:17:22.101207 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.101111 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f6e6a89-d316-425a-9138-c0318824371d-bound-sa-token\") pod \"image-registry-59c89c9f84-ldxwc\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" Jul 24 12:17:22.101207 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.101134 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22ea11f4-48aa-48a3-9310-eb5ad5ceef5c-cert\") pod \"ingress-canary-mzw5p\" (UID: \"22ea11f4-48aa-48a3-9310-eb5ad5ceef5c\") " pod="openshift-ingress-canary/ingress-canary-mzw5p" Jul 24 12:17:22.101207 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.101158 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8daa84c-73b5-4346-8f92-81dd451dfaa5-tmp-dir\") pod \"dns-default-8q6d8\" (UID: \"b8daa84c-73b5-4346-8f92-81dd451dfaa5\") " pod="openshift-dns/dns-default-8q6d8" Jul 24 12:17:22.101207 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.101188 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8f6e6a89-d316-425a-9138-c0318824371d-image-registry-private-configuration\") pod \"image-registry-59c89c9f84-ldxwc\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" Jul 24 12:17:22.101487 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.101216 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f6e6a89-d316-425a-9138-c0318824371d-installation-pull-secrets\") pod \"image-registry-59c89c9f84-ldxwc\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" Jul 24 12:17:22.101487 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.101239 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b8daa84c-73b5-4346-8f92-81dd451dfaa5-config-volume\") pod \"dns-default-8q6d8\" (UID: \"b8daa84c-73b5-4346-8f92-81dd451dfaa5\") " pod="openshift-dns/dns-default-8q6d8" Jul 24 12:17:22.101487 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.101292 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8daa84c-73b5-4346-8f92-81dd451dfaa5-metrics-tls\") pod \"dns-default-8q6d8\" (UID: \"b8daa84c-73b5-4346-8f92-81dd451dfaa5\") " pod="openshift-dns/dns-default-8q6d8" Jul 24 12:17:22.101487 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.101322 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f6e6a89-d316-425a-9138-c0318824371d-ca-trust-extracted\") pod \"image-registry-59c89c9f84-ldxwc\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" Jul 24 12:17:22.101487 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.101347 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f6e6a89-d316-425a-9138-c0318824371d-trusted-ca\") pod \"image-registry-59c89c9f84-ldxwc\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" Jul 24 12:17:22.101487 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.101374 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wk8x\" (UniqueName: \"kubernetes.io/projected/8f6e6a89-d316-425a-9138-c0318824371d-kube-api-access-5wk8x\") pod \"image-registry-59c89c9f84-ldxwc\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" Jul 24 12:17:22.101487 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.101399 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnnrk\" (UniqueName: \"kubernetes.io/projected/b8daa84c-73b5-4346-8f92-81dd451dfaa5-kube-api-access-lnnrk\") pod \"dns-default-8q6d8\" (UID: \"b8daa84c-73b5-4346-8f92-81dd451dfaa5\") " pod="openshift-dns/dns-default-8q6d8" Jul 24 12:17:22.102178 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.102152 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f6e6a89-d316-425a-9138-c0318824371d-registry-certificates\") pod \"image-registry-59c89c9f84-ldxwc\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" Jul 24 12:17:22.102350 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.102328 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f6e6a89-d316-425a-9138-c0318824371d-ca-trust-extracted\") pod \"image-registry-59c89c9f84-ldxwc\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" Jul 24 12:17:22.102484 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.102449 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b8daa84c-73b5-4346-8f92-81dd451dfaa5-config-volume\") pod \"dns-default-8q6d8\" (UID: \"b8daa84c-73b5-4346-8f92-81dd451dfaa5\") " pod="openshift-dns/dns-default-8q6d8" Jul 24 12:17:22.102644 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:22.101156 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 12:17:22.102722 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:22.102656 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59c89c9f84-ldxwc: secret "image-registry-tls" not found Jul 24 12:17:22.102722 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:22.102721 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f6e6a89-d316-425a-9138-c0318824371d-registry-tls podName:8f6e6a89-d316-425a-9138-c0318824371d nodeName:}" failed. No retries permitted until 2026-07-24 12:17:22.602703139 +0000 UTC m=+35.653948113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f6e6a89-d316-425a-9138-c0318824371d-registry-tls") pod "image-registry-59c89c9f84-ldxwc" (UID: "8f6e6a89-d316-425a-9138-c0318824371d") : secret "image-registry-tls" not found Jul 24 12:17:22.103093 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:22.101953 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 12:17:22.103193 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.103132 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8daa84c-73b5-4346-8f92-81dd451dfaa5-tmp-dir\") pod \"dns-default-8q6d8\" (UID: \"b8daa84c-73b5-4346-8f92-81dd451dfaa5\") " pod="openshift-dns/dns-default-8q6d8" Jul 24 12:17:22.103193 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:22.103149 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8daa84c-73b5-4346-8f92-81dd451dfaa5-metrics-tls podName:b8daa84c-73b5-4346-8f92-81dd451dfaa5 nodeName:}" failed. No retries permitted until 2026-07-24 12:17:22.603128755 +0000 UTC m=+35.654373728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b8daa84c-73b5-4346-8f92-81dd451dfaa5-metrics-tls") pod "dns-default-8q6d8" (UID: "b8daa84c-73b5-4346-8f92-81dd451dfaa5") : secret "dns-default-metrics-tls" not found Jul 24 12:17:22.103386 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.103367 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f6e6a89-d316-425a-9138-c0318824371d-trusted-ca\") pod \"image-registry-59c89c9f84-ldxwc\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" Jul 24 12:17:22.107078 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.106949 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22ea11f4-48aa-48a3-9310-eb5ad5ceef5c-cert\") pod \"ingress-canary-mzw5p\" (UID: \"22ea11f4-48aa-48a3-9310-eb5ad5ceef5c\") " pod="openshift-ingress-canary/ingress-canary-mzw5p" Jul 24 12:17:22.107163 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.106955 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8f6e6a89-d316-425a-9138-c0318824371d-image-registry-private-configuration\") pod \"image-registry-59c89c9f84-ldxwc\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" Jul 24 12:17:22.107163 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.106988 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f6e6a89-d316-425a-9138-c0318824371d-installation-pull-secrets\") pod \"image-registry-59c89c9f84-ldxwc\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" Jul 24 12:17:22.111000 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.110981 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f6e6a89-d316-425a-9138-c0318824371d-bound-sa-token\") pod \"image-registry-59c89c9f84-ldxwc\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" Jul 24 12:17:22.114169 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.114050 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wk8x\" (UniqueName: \"kubernetes.io/projected/8f6e6a89-d316-425a-9138-c0318824371d-kube-api-access-5wk8x\") pod \"image-registry-59c89c9f84-ldxwc\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" Jul 24 12:17:22.114261 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.114186 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lsx2\" (UniqueName: \"kubernetes.io/projected/22ea11f4-48aa-48a3-9310-eb5ad5ceef5c-kube-api-access-6lsx2\") pod \"ingress-canary-mzw5p\" (UID: \"22ea11f4-48aa-48a3-9310-eb5ad5ceef5c\") " pod="openshift-ingress-canary/ingress-canary-mzw5p" Jul 24 12:17:22.114261 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.114236 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnnrk\" (UniqueName: \"kubernetes.io/projected/b8daa84c-73b5-4346-8f92-81dd451dfaa5-kube-api-access-lnnrk\") pod \"dns-default-8q6d8\" (UID: \"b8daa84c-73b5-4346-8f92-81dd451dfaa5\") " pod="openshift-dns/dns-default-8q6d8" Jul 24 12:17:22.135779 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.135744 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mzw5p" Jul 24 12:17:22.417105 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.417071 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5gc6" Jul 24 12:17:22.417298 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.417118 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcjn9" Jul 24 12:17:22.417298 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.417119 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrwlt" Jul 24 12:17:22.421474 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.421450 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 12:17:22.421603 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.421511 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x8csv\"" Jul 24 12:17:22.421603 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.421528 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 12:17:22.421712 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.421620 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 12:17:22.421765 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.421723 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 12:17:22.421852 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.421835 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wdbbv\"" Jul 24 12:17:22.605714 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.605672 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8daa84c-73b5-4346-8f92-81dd451dfaa5-metrics-tls\") pod \"dns-default-8q6d8\" (UID: \"b8daa84c-73b5-4346-8f92-81dd451dfaa5\") " pod="openshift-dns/dns-default-8q6d8" Jul 24 12:17:22.605901 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.605741 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f6e6a89-d316-425a-9138-c0318824371d-registry-tls\") pod \"image-registry-59c89c9f84-ldxwc\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" Jul 24 12:17:22.605901 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:22.605817 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 12:17:22.606025 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:22.605896 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 12:17:22.606025 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:22.605918 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59c89c9f84-ldxwc: secret "image-registry-tls" not found Jul 24 12:17:22.606025 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:22.605904 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8daa84c-73b5-4346-8f92-81dd451dfaa5-metrics-tls podName:b8daa84c-73b5-4346-8f92-81dd451dfaa5 nodeName:}" failed. No retries permitted until 2026-07-24 12:17:23.605881209 +0000 UTC m=+36.657126190 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b8daa84c-73b5-4346-8f92-81dd451dfaa5-metrics-tls") pod "dns-default-8q6d8" (UID: "b8daa84c-73b5-4346-8f92-81dd451dfaa5") : secret "dns-default-metrics-tls" not found Jul 24 12:17:22.606025 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:22.605996 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f6e6a89-d316-425a-9138-c0318824371d-registry-tls podName:8f6e6a89-d316-425a-9138-c0318824371d nodeName:}" failed. No retries permitted until 2026-07-24 12:17:23.605976793 +0000 UTC m=+36.657221770 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f6e6a89-d316-425a-9138-c0318824371d-registry-tls") pod "image-registry-59c89c9f84-ldxwc" (UID: "8f6e6a89-d316-425a-9138-c0318824371d") : secret "image-registry-tls" not found Jul 24 12:17:22.921775 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:22.921748 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mzw5p"] Jul 24 12:17:22.932950 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:17:22.932926 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22ea11f4_48aa_48a3_9310_eb5ad5ceef5c.slice/crio-8ab74ede8c9b280bd4d7a6354ee06c528acc7fb09d23040878d69646a7952399 WatchSource:0}: Error finding container 8ab74ede8c9b280bd4d7a6354ee06c528acc7fb09d23040878d69646a7952399: Status 404 returned error can't find the container with id 8ab74ede8c9b280bd4d7a6354ee06c528acc7fb09d23040878d69646a7952399 Jul 24 12:17:23.613315 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:23.613267 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8daa84c-73b5-4346-8f92-81dd451dfaa5-metrics-tls\") pod \"dns-default-8q6d8\" (UID: \"b8daa84c-73b5-4346-8f92-81dd451dfaa5\") " pod="openshift-dns/dns-default-8q6d8" Jul 24 12:17:23.613315 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:23.613327 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f6e6a89-d316-425a-9138-c0318824371d-registry-tls\") pod \"image-registry-59c89c9f84-ldxwc\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" Jul 24 12:17:23.613539 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:23.613424 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 12:17:23.613539 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:23.613490 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8daa84c-73b5-4346-8f92-81dd451dfaa5-metrics-tls podName:b8daa84c-73b5-4346-8f92-81dd451dfaa5 nodeName:}" failed. No retries permitted until 2026-07-24 12:17:25.613475198 +0000 UTC m=+38.664720167 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b8daa84c-73b5-4346-8f92-81dd451dfaa5-metrics-tls") pod "dns-default-8q6d8" (UID: "b8daa84c-73b5-4346-8f92-81dd451dfaa5") : secret "dns-default-metrics-tls" not found Jul 24 12:17:23.613539 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:23.613433 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 12:17:23.613539 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:23.613529 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59c89c9f84-ldxwc: secret "image-registry-tls" not found Jul 24 12:17:23.613664 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:23.613569 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f6e6a89-d316-425a-9138-c0318824371d-registry-tls podName:8f6e6a89-d316-425a-9138-c0318824371d nodeName:}" failed. No retries permitted until 2026-07-24 12:17:25.613557618 +0000 UTC m=+38.664802587 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f6e6a89-d316-425a-9138-c0318824371d-registry-tls") pod "image-registry-59c89c9f84-ldxwc" (UID: "8f6e6a89-d316-425a-9138-c0318824371d") : secret "image-registry-tls" not found Jul 24 12:17:23.638801 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:23.638772 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mzw5p" event={"ID":"22ea11f4-48aa-48a3-9310-eb5ad5ceef5c","Type":"ContainerStarted","Data":"8ab74ede8c9b280bd4d7a6354ee06c528acc7fb09d23040878d69646a7952399"} Jul 24 12:17:23.641379 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:23.641356 2555 generic.go:356] "Generic (PLEG): container finished" podID="52ae33c6-374a-4670-a197-3368045677ef" containerID="e054cf55ad54d85c8fb988bfca960ef5fd5d85e486215e44f0f2444c170c9c97" exitCode=0 Jul 24 12:17:23.641481 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:23.641408 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7xzrz" event={"ID":"52ae33c6-374a-4670-a197-3368045677ef","Type":"ContainerDied","Data":"e054cf55ad54d85c8fb988bfca960ef5fd5d85e486215e44f0f2444c170c9c97"} Jul 24 12:17:24.271343 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:24.271297 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:24.375544 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:24.375507 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:24.475459 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:24.475394 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:24.573246 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:24.573162 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:24.647501 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:24.647467 2555 generic.go:356] "Generic (PLEG): container finished" podID="52ae33c6-374a-4670-a197-3368045677ef" containerID="c58fa0fe98e7909f8c15b39389f7bc4a32a433971286bfb2d7f04ceceb0f582f" exitCode=0 Jul 24 12:17:24.647671 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:24.647513 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7xzrz" event={"ID":"52ae33c6-374a-4670-a197-3368045677ef","Type":"ContainerDied","Data":"c58fa0fe98e7909f8c15b39389f7bc4a32a433971286bfb2d7f04ceceb0f582f"} Jul 24 12:17:24.811914 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:24.811880 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:24.908122 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:24.908089 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:25.364563 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:25.364535 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:25.418655 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:25.418620 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:25.630088 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:25.630049 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8daa84c-73b5-4346-8f92-81dd451dfaa5-metrics-tls\") pod \"dns-default-8q6d8\" (UID: \"b8daa84c-73b5-4346-8f92-81dd451dfaa5\") " pod="openshift-dns/dns-default-8q6d8" Jul 24 12:17:25.630285 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:25.630109 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f6e6a89-d316-425a-9138-c0318824371d-registry-tls\") pod \"image-registry-59c89c9f84-ldxwc\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" Jul 24 12:17:25.630285 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:25.630150 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 12:17:25.630285 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:25.630200 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8daa84c-73b5-4346-8f92-81dd451dfaa5-metrics-tls podName:b8daa84c-73b5-4346-8f92-81dd451dfaa5 nodeName:}" failed. No retries permitted until 2026-07-24 12:17:29.630185446 +0000 UTC m=+42.681430419 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b8daa84c-73b5-4346-8f92-81dd451dfaa5-metrics-tls") pod "dns-default-8q6d8" (UID: "b8daa84c-73b5-4346-8f92-81dd451dfaa5") : secret "dns-default-metrics-tls" not found Jul 24 12:17:25.630285 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:25.630201 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 12:17:25.630285 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:25.630212 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59c89c9f84-ldxwc: secret "image-registry-tls" not found Jul 24 12:17:25.630285 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:25.630251 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f6e6a89-d316-425a-9138-c0318824371d-registry-tls podName:8f6e6a89-d316-425a-9138-c0318824371d nodeName:}" failed. No retries permitted until 2026-07-24 12:17:29.63024065 +0000 UTC m=+42.681485620 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f6e6a89-d316-425a-9138-c0318824371d-registry-tls") pod "image-registry-59c89c9f84-ldxwc" (UID: "8f6e6a89-d316-425a-9138-c0318824371d") : secret "image-registry-tls" not found Jul 24 12:17:25.651403 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:25.651364 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mzw5p" event={"ID":"22ea11f4-48aa-48a3-9310-eb5ad5ceef5c","Type":"ContainerStarted","Data":"4127801f61ce046648504d5e280922adab535ac70f81d53834f4aed8b14bb3b3"} Jul 24 12:17:25.654647 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:25.654620 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7xzrz" event={"ID":"52ae33c6-374a-4670-a197-3368045677ef","Type":"ContainerStarted","Data":"815b6077550a63ca4f17cfb4c3d0494f7e52b184240946ab80269cbe0b65a5aa"} Jul 24 12:17:25.667543 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:25.667502 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mzw5p" podStartSLOduration=2.081114914 podStartE2EDuration="4.667488702s" totalImagesPullingTime="2.586373788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:17:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:17:25.666278249 +0000 UTC m=+38.717523261" watchObservedRunningTime="2026-07-24 12:17:25.667488702 +0000 UTC m=+38.718733729" Jul 24 12:17:25.688044 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:25.687999 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7xzrz" podStartSLOduration=8.800624718 podStartE2EDuration="38.68798346s" totalImagesPullingTime="29.887358742s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:16:47 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:17:25.686315226 +0000 UTC m=+38.737560279" watchObservedRunningTime="2026-07-24 12:17:25.68798346 +0000 UTC m=+38.739228452" Jul 24 12:17:25.763575 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:25.763531 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:25.824613 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:25.824584 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:26.566891 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:26.566858 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:26.628272 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:26.628185 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:27.009073 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:27.009020 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:27.106046 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:27.106018 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:27.577505 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:27.577471 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:29.662685 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:29.662652 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8daa84c-73b5-4346-8f92-81dd451dfaa5-metrics-tls\") pod \"dns-default-8q6d8\" (UID: \"b8daa84c-73b5-4346-8f92-81dd451dfaa5\") " pod="openshift-dns/dns-default-8q6d8" Jul 24 12:17:29.663169 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:29.662692 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f6e6a89-d316-425a-9138-c0318824371d-registry-tls\") pod \"image-registry-59c89c9f84-ldxwc\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" Jul 24 12:17:29.663169 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:29.662775 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 12:17:29.663169 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:29.662822 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 12:17:29.663169 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:29.662832 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8daa84c-73b5-4346-8f92-81dd451dfaa5-metrics-tls podName:b8daa84c-73b5-4346-8f92-81dd451dfaa5 nodeName:}" failed. No retries permitted until 2026-07-24 12:17:37.662817867 +0000 UTC m=+50.714062838 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b8daa84c-73b5-4346-8f92-81dd451dfaa5-metrics-tls") pod "dns-default-8q6d8" (UID: "b8daa84c-73b5-4346-8f92-81dd451dfaa5") : secret "dns-default-metrics-tls" not found Jul 24 12:17:29.663169 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:29.662835 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59c89c9f84-ldxwc: secret "image-registry-tls" not found Jul 24 12:17:29.663169 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:29.662915 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f6e6a89-d316-425a-9138-c0318824371d-registry-tls podName:8f6e6a89-d316-425a-9138-c0318824371d nodeName:}" failed. No retries permitted until 2026-07-24 12:17:37.662890156 +0000 UTC m=+50.714135126 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f6e6a89-d316-425a-9138-c0318824371d-registry-tls") pod "image-registry-59c89c9f84-ldxwc" (UID: "8f6e6a89-d316-425a-9138-c0318824371d") : secret "image-registry-tls" not found Jul 24 12:17:32.049528 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.049496 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-c9nwk"] Jul 24 12:17:32.080768 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.080740 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-c9nwk"] Jul 24 12:17:32.080890 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.080829 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-c9nwk" Jul 24 12:17:32.083549 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.083523 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 24 12:17:32.083675 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.083524 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 24 12:17:32.083675 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.083552 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-fdjt8\"" Jul 24 12:17:32.150584 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.150546 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-w6gwd"] Jul 24 12:17:32.168959 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.168895 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-drd9f"] Jul 24 12:17:32.169158 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.168978 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-w6gwd" Jul 24 12:17:32.171956 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.171928 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-t9hd2\"" Jul 24 12:17:32.177123 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.177098 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q54n\" (UniqueName: \"kubernetes.io/projected/0042792e-edab-4c36-99e2-1b51e51cf81d-kube-api-access-6q54n\") pod \"network-check-source-7d88cb55d8-w6gwd\" (UID: \"0042792e-edab-4c36-99e2-1b51e51cf81d\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-w6gwd" Jul 24 12:17:32.177216 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.177138 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kfkn\" (UniqueName: \"kubernetes.io/projected/c22f8eb3-8726-43ce-8818-ca6ad3392b6d-kube-api-access-6kfkn\") pod \"volume-data-source-validator-549c6d54cf-c9nwk\" (UID: \"c22f8eb3-8726-43ce-8818-ca6ad3392b6d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-c9nwk" Jul 24 12:17:32.191098 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.191052 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-prgmm"] Jul 24 12:17:32.191200 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.191168 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-drd9f" Jul 24 12:17:32.193769 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.193736 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 24 12:17:32.193769 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.193744 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 24 12:17:32.193915 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.193793 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 24 12:17:32.193915 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.193810 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 24 12:17:32.193915 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.193836 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-cxsgc\"" Jul 24 12:17:32.208869 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.208846 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-prgmm" Jul 24 12:17:32.208869 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.208854 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-b2q26"] Jul 24 12:17:32.213333 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.213296 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9crh2\"" Jul 24 12:17:32.214866 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.214846 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 24 12:17:32.215637 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.215616 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 24 12:17:32.215723 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.215626 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 24 12:17:32.215906 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.215889 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 24 12:17:32.233134 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.233114 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-847c5d5c9-ljlw8"] Jul 24 12:17:32.233218 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.233143 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-b2q26" Jul 24 12:17:32.236129 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.236094 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 24 12:17:32.236129 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.236112 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 24 12:17:32.236242 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.236193 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-c4jtt\"" Jul 24 12:17:32.236470 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.236450 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 24 12:17:32.253215 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.253196 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-w6gwd"] Jul 24 12:17:32.253322 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.253239 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-drd9f"] Jul 24 12:17:32.253322 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.253263 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-b2q26"] Jul 24 12:17:32.253322 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.253290 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-prgmm"] Jul 24 12:17:32.253322 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.253313 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-847c5d5c9-ljlw8"] Jul 24 12:17:32.253510 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.253348 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4hhsg"] Jul 24 12:17:32.253510 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.253352 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-847c5d5c9-ljlw8" Jul 24 12:17:32.257305 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.257288 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 24 12:17:32.257383 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.257324 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-pwhnh\"" Jul 24 12:17:32.261149 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.261129 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 24 12:17:32.261254 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.261134 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 24 12:17:32.261420 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.261402 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 24 12:17:32.261472 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.261405 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 24 12:17:32.261522 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.261431 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 24 12:17:32.267359 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.267345 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-576dn"] Jul 24 12:17:32.267464 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.267451 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4hhsg" Jul 24 12:17:32.273794 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.273772 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-48wgr\"" Jul 24 12:17:32.273907 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.273800 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 24 12:17:32.273907 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.273800 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 24 12:17:32.273907 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.273902 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 24 12:17:32.274099 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.273986 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 24 12:17:32.277631 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.277611 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnpvd\" (UniqueName: \"kubernetes.io/projected/5f0aa6bf-6f8e-4157-8c39-4b5d44ce9475-kube-api-access-jnpvd\") pod \"service-ca-operator-5d6c75f84f-4hhsg\" (UID: \"5f0aa6bf-6f8e-4157-8c39-4b5d44ce9475\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4hhsg" Jul 24 12:17:32.277731 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.277640 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-b2q26\" (UID: \"6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-b2q26" Jul 24 12:17:32.277731 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.277658 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2sdx\" (UniqueName: \"kubernetes.io/projected/80196e1f-58e5-4a8e-a92d-bf979f9d95a1-kube-api-access-h2sdx\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-drd9f\" (UID: \"80196e1f-58e5-4a8e-a92d-bf979f9d95a1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-drd9f" Jul 24 12:17:32.277731 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.277674 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4a130a4a-ed5a-4a1e-821a-e5e0c115a0de-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-prgmm\" (UID: \"4a130a4a-ed5a-4a1e-821a-e5e0c115a0de\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-prgmm" Jul 24 12:17:32.277731 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.277714 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25zkh\" (UniqueName: \"kubernetes.io/projected/6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4-kube-api-access-25zkh\") pod \"cluster-samples-operator-6748489656-b2q26\" (UID: \"6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-b2q26" Jul 24 12:17:32.277936 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.277772 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05ae7260-6786-4542-bf6d-4979f4d5bf1d-metrics-certs\") pod \"router-default-847c5d5c9-ljlw8\" (UID: \"05ae7260-6786-4542-bf6d-4979f4d5bf1d\") " pod="openshift-ingress/router-default-847c5d5c9-ljlw8" Jul 24 12:17:32.277936 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.277810 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05ae7260-6786-4542-bf6d-4979f4d5bf1d-service-ca-bundle\") pod \"router-default-847c5d5c9-ljlw8\" (UID: \"05ae7260-6786-4542-bf6d-4979f4d5bf1d\") " pod="openshift-ingress/router-default-847c5d5c9-ljlw8" Jul 24 12:17:32.277936 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.277851 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/05ae7260-6786-4542-bf6d-4979f4d5bf1d-stats-auth\") pod \"router-default-847c5d5c9-ljlw8\" (UID: \"05ae7260-6786-4542-bf6d-4979f4d5bf1d\") " pod="openshift-ingress/router-default-847c5d5c9-ljlw8" Jul 24 12:17:32.277936 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.277885 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q54n\" (UniqueName: \"kubernetes.io/projected/0042792e-edab-4c36-99e2-1b51e51cf81d-kube-api-access-6q54n\") pod \"network-check-source-7d88cb55d8-w6gwd\" (UID: \"0042792e-edab-4c36-99e2-1b51e51cf81d\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-w6gwd" Jul 24 12:17:32.277936 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.277920 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5f0aa6bf-6f8e-4157-8c39-4b5d44ce9475-serving-cert\") pod \"service-ca-operator-5d6c75f84f-4hhsg\" (UID: \"5f0aa6bf-6f8e-4157-8c39-4b5d44ce9475\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4hhsg" Jul 24 12:17:32.278251 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.277945 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f0aa6bf-6f8e-4157-8c39-4b5d44ce9475-config\") pod \"service-ca-operator-5d6c75f84f-4hhsg\" (UID: \"5f0aa6bf-6f8e-4157-8c39-4b5d44ce9475\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4hhsg" Jul 24 12:17:32.278251 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.277975 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kfkn\" (UniqueName: \"kubernetes.io/projected/c22f8eb3-8726-43ce-8818-ca6ad3392b6d-kube-api-access-6kfkn\") pod \"volume-data-source-validator-549c6d54cf-c9nwk\" (UID: \"c22f8eb3-8726-43ce-8818-ca6ad3392b6d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-c9nwk" Jul 24 12:17:32.278251 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.278006 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/80196e1f-58e5-4a8e-a92d-bf979f9d95a1-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-drd9f\" (UID: \"80196e1f-58e5-4a8e-a92d-bf979f9d95a1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-drd9f" Jul 24 12:17:32.278251 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.278073 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a130a4a-ed5a-4a1e-821a-e5e0c115a0de-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-prgmm\" (UID: \"4a130a4a-ed5a-4a1e-821a-e5e0c115a0de\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-prgmm" Jul 24 12:17:32.278251 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.278123 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqv8q\" (UniqueName: \"kubernetes.io/projected/05ae7260-6786-4542-bf6d-4979f4d5bf1d-kube-api-access-zqv8q\") pod \"router-default-847c5d5c9-ljlw8\" (UID: \"05ae7260-6786-4542-bf6d-4979f4d5bf1d\") " pod="openshift-ingress/router-default-847c5d5c9-ljlw8" Jul 24 12:17:32.278251 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.278168 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80196e1f-58e5-4a8e-a92d-bf979f9d95a1-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-drd9f\" (UID: \"80196e1f-58e5-4a8e-a92d-bf979f9d95a1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-drd9f" Jul 24 12:17:32.278251 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.278190 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhltn\" (UniqueName: \"kubernetes.io/projected/4a130a4a-ed5a-4a1e-821a-e5e0c115a0de-kube-api-access-nhltn\") pod \"cluster-monitoring-operator-548b489cb8-prgmm\" (UID: \"4a130a4a-ed5a-4a1e-821a-e5e0c115a0de\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-prgmm" Jul 24 12:17:32.278251 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.278206 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/05ae7260-6786-4542-bf6d-4979f4d5bf1d-default-certificate\") pod \"router-default-847c5d5c9-ljlw8\" (UID: \"05ae7260-6786-4542-bf6d-4979f4d5bf1d\") " pod="openshift-ingress/router-default-847c5d5c9-ljlw8" Jul 24 12:17:32.289301 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.289265 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-mttrp"] Jul 24 12:17:32.289609 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.289590 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-576dn" Jul 24 12:17:32.292728 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.292708 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 24 12:17:32.293258 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.293240 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-ws8pb\"" Jul 24 12:17:32.293932 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.293915 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 24 12:17:32.303252 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.303202 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q54n\" (UniqueName: \"kubernetes.io/projected/0042792e-edab-4c36-99e2-1b51e51cf81d-kube-api-access-6q54n\") pod \"network-check-source-7d88cb55d8-w6gwd\" (UID: \"0042792e-edab-4c36-99e2-1b51e51cf81d\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-w6gwd" Jul 24 12:17:32.303252 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.303239 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kfkn\" (UniqueName: \"kubernetes.io/projected/c22f8eb3-8726-43ce-8818-ca6ad3392b6d-kube-api-access-6kfkn\") pod \"volume-data-source-validator-549c6d54cf-c9nwk\" (UID: \"c22f8eb3-8726-43ce-8818-ca6ad3392b6d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-c9nwk" Jul 24 12:17:32.309475 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.309455 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-mttrp" Jul 24 12:17:32.309582 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.309456 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-g5v4m"] Jul 24 12:17:32.312203 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.312180 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 24 12:17:32.312298 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.312282 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 24 12:17:32.312578 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.312562 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 24 12:17:32.312797 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.312782 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 24 12:17:32.313006 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.312993 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-vdfmt\"" Jul 24 12:17:32.321066 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.321037 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 24 12:17:32.331776 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.331760 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4hhsg"] Jul 24 12:17:32.331853 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.331789 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-mttrp"] Jul 24 12:17:32.331853 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.331802 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-576dn"] Jul 24 12:17:32.331853 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.331818 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-g5v4m"] Jul 24 12:17:32.331954 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.331871 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-g5v4m" Jul 24 12:17:32.334769 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.334749 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 24 12:17:32.334942 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.334929 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 24 12:17:32.335128 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.335114 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-gq5l6\"" Jul 24 12:17:32.335740 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.335718 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 24 12:17:32.335827 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.335729 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 24 12:17:32.344184 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.344166 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 24 12:17:32.355523 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.355499 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:32.378718 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.378696 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a130a4a-ed5a-4a1e-821a-e5e0c115a0de-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-prgmm\" (UID: \"4a130a4a-ed5a-4a1e-821a-e5e0c115a0de\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-prgmm" Jul 24 12:17:32.378821 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.378728 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c385960c-6bf7-4b33-8ce0-f627cb711d9c-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-576dn\" (UID: \"c385960c-6bf7-4b33-8ce0-f627cb711d9c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-576dn" Jul 24 12:17:32.378821 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.378748 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e1b58e8-bdad-423e-a12b-a8b0fc1c900e-config\") pod \"console-operator-584dcb6b54-g5v4m\" (UID: \"7e1b58e8-bdad-423e-a12b-a8b0fc1c900e\") " pod="openshift-console-operator/console-operator-584dcb6b54-g5v4m" Jul 24 12:17:32.378821 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.378766 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqv8q\" (UniqueName: \"kubernetes.io/projected/05ae7260-6786-4542-bf6d-4979f4d5bf1d-kube-api-access-zqv8q\") pod \"router-default-847c5d5c9-ljlw8\" (UID: \"05ae7260-6786-4542-bf6d-4979f4d5bf1d\") " pod="openshift-ingress/router-default-847c5d5c9-ljlw8" Jul 24 12:17:32.378938 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:32.378849 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 12:17:32.378938 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.378861 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c385960c-6bf7-4b33-8ce0-f627cb711d9c-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-576dn\" (UID: \"c385960c-6bf7-4b33-8ce0-f627cb711d9c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-576dn" Jul 24 12:17:32.379031 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.378985 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80196e1f-58e5-4a8e-a92d-bf979f9d95a1-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-drd9f\" (UID: \"80196e1f-58e5-4a8e-a92d-bf979f9d95a1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-drd9f" Jul 24 12:17:32.379031 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:32.379013 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a130a4a-ed5a-4a1e-821a-e5e0c115a0de-cluster-monitoring-operator-tls podName:4a130a4a-ed5a-4a1e-821a-e5e0c115a0de nodeName:}" failed. No retries permitted until 2026-07-24 12:17:32.878990471 +0000 UTC m=+45.930235456 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4a130a4a-ed5a-4a1e-821a-e5e0c115a0de-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-prgmm" (UID: "4a130a4a-ed5a-4a1e-821a-e5e0c115a0de") : secret "cluster-monitoring-operator-tls" not found Jul 24 12:17:32.379175 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.379094 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhltn\" (UniqueName: \"kubernetes.io/projected/4a130a4a-ed5a-4a1e-821a-e5e0c115a0de-kube-api-access-nhltn\") pod \"cluster-monitoring-operator-548b489cb8-prgmm\" (UID: \"4a130a4a-ed5a-4a1e-821a-e5e0c115a0de\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-prgmm" Jul 24 12:17:32.379175 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.379117 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/05ae7260-6786-4542-bf6d-4979f4d5bf1d-default-certificate\") pod \"router-default-847c5d5c9-ljlw8\" (UID: \"05ae7260-6786-4542-bf6d-4979f4d5bf1d\") " pod="openshift-ingress/router-default-847c5d5c9-ljlw8" Jul 24 12:17:32.379175 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.379141 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7e1b58e8-bdad-423e-a12b-a8b0fc1c900e-trusted-ca\") pod \"console-operator-584dcb6b54-g5v4m\" (UID: \"7e1b58e8-bdad-423e-a12b-a8b0fc1c900e\") " pod="openshift-console-operator/console-operator-584dcb6b54-g5v4m" Jul 24 12:17:32.379175 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.379171 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1d02e6e2-54f3-43fc-a712-faf751240dad-snapshots\") pod \"insights-operator-5885fdb759-mttrp\" (UID: \"1d02e6e2-54f3-43fc-a712-faf751240dad\") " pod="openshift-insights/insights-operator-5885fdb759-mttrp" Jul 24 12:17:32.379339 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.379226 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7e1b58e8-bdad-423e-a12b-a8b0fc1c900e-serving-cert\") pod \"console-operator-584dcb6b54-g5v4m\" (UID: \"7e1b58e8-bdad-423e-a12b-a8b0fc1c900e\") " pod="openshift-console-operator/console-operator-584dcb6b54-g5v4m" Jul 24 12:17:32.379339 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.379259 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnpvd\" (UniqueName: \"kubernetes.io/projected/5f0aa6bf-6f8e-4157-8c39-4b5d44ce9475-kube-api-access-jnpvd\") pod \"service-ca-operator-5d6c75f84f-4hhsg\" (UID: \"5f0aa6bf-6f8e-4157-8c39-4b5d44ce9475\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4hhsg" Jul 24 12:17:32.379339 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.379281 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8z7v\" (UniqueName: \"kubernetes.io/projected/7e1b58e8-bdad-423e-a12b-a8b0fc1c900e-kube-api-access-q8z7v\") pod \"console-operator-584dcb6b54-g5v4m\" (UID: \"7e1b58e8-bdad-423e-a12b-a8b0fc1c900e\") " pod="openshift-console-operator/console-operator-584dcb6b54-g5v4m" Jul 24 12:17:32.379339 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.379316 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-b2q26\" (UID: \"6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-b2q26" Jul 24 12:17:32.379523 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:32.379385 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 24 12:17:32.379523 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.379378 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2sdx\" (UniqueName: \"kubernetes.io/projected/80196e1f-58e5-4a8e-a92d-bf979f9d95a1-kube-api-access-h2sdx\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-drd9f\" (UID: \"80196e1f-58e5-4a8e-a92d-bf979f9d95a1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-drd9f" Jul 24 12:17:32.379523 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:32.379445 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4-samples-operator-tls podName:6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4 nodeName:}" failed. No retries permitted until 2026-07-24 12:17:32.879429466 +0000 UTC m=+45.930674439 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4-samples-operator-tls") pod "cluster-samples-operator-6748489656-b2q26" (UID: "6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4") : secret "samples-operator-tls" not found Jul 24 12:17:32.379523 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.379475 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4a130a4a-ed5a-4a1e-821a-e5e0c115a0de-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-prgmm\" (UID: \"4a130a4a-ed5a-4a1e-821a-e5e0c115a0de\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-prgmm" Jul 24 12:17:32.379523 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.379510 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25zkh\" (UniqueName: \"kubernetes.io/projected/6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4-kube-api-access-25zkh\") pod \"cluster-samples-operator-6748489656-b2q26\" (UID: \"6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-b2q26" Jul 24 12:17:32.379777 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.379618 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05ae7260-6786-4542-bf6d-4979f4d5bf1d-metrics-certs\") pod \"router-default-847c5d5c9-ljlw8\" (UID: \"05ae7260-6786-4542-bf6d-4979f4d5bf1d\") " pod="openshift-ingress/router-default-847c5d5c9-ljlw8" Jul 24 12:17:32.379777 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.379671 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05ae7260-6786-4542-bf6d-4979f4d5bf1d-service-ca-bundle\") pod \"router-default-847c5d5c9-ljlw8\" (UID: \"05ae7260-6786-4542-bf6d-4979f4d5bf1d\") " pod="openshift-ingress/router-default-847c5d5c9-ljlw8" Jul 24 12:17:32.379777 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.379701 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4fbk\" (UniqueName: \"kubernetes.io/projected/1d02e6e2-54f3-43fc-a712-faf751240dad-kube-api-access-d4fbk\") pod \"insights-operator-5885fdb759-mttrp\" (UID: \"1d02e6e2-54f3-43fc-a712-faf751240dad\") " pod="openshift-insights/insights-operator-5885fdb759-mttrp" Jul 24 12:17:32.379777 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.379747 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/05ae7260-6786-4542-bf6d-4979f4d5bf1d-stats-auth\") pod \"router-default-847c5d5c9-ljlw8\" (UID: \"05ae7260-6786-4542-bf6d-4979f4d5bf1d\") " pod="openshift-ingress/router-default-847c5d5c9-ljlw8" Jul 24 12:17:32.379777 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:32.379757 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 12:17:32.379777 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.379772 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d02e6e2-54f3-43fc-a712-faf751240dad-tmp\") pod \"insights-operator-5885fdb759-mttrp\" (UID: \"1d02e6e2-54f3-43fc-a712-faf751240dad\") " pod="openshift-insights/insights-operator-5885fdb759-mttrp" Jul 24 12:17:32.380071 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.379801 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d02e6e2-54f3-43fc-a712-faf751240dad-serving-cert\") pod \"insights-operator-5885fdb759-mttrp\" (UID: \"1d02e6e2-54f3-43fc-a712-faf751240dad\") " pod="openshift-insights/insights-operator-5885fdb759-mttrp" Jul 24 12:17:32.380071 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:32.379821 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05ae7260-6786-4542-bf6d-4979f4d5bf1d-metrics-certs podName:05ae7260-6786-4542-bf6d-4979f4d5bf1d nodeName:}" failed. No retries permitted until 2026-07-24 12:17:32.879804973 +0000 UTC m=+45.931049944 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05ae7260-6786-4542-bf6d-4979f4d5bf1d-metrics-certs") pod "router-default-847c5d5c9-ljlw8" (UID: "05ae7260-6786-4542-bf6d-4979f4d5bf1d") : secret "router-metrics-certs-default" not found Jul 24 12:17:32.380071 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:32.379857 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/05ae7260-6786-4542-bf6d-4979f4d5bf1d-service-ca-bundle podName:05ae7260-6786-4542-bf6d-4979f4d5bf1d nodeName:}" failed. No retries permitted until 2026-07-24 12:17:32.879841303 +0000 UTC m=+45.931086277 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/05ae7260-6786-4542-bf6d-4979f4d5bf1d-service-ca-bundle") pod "router-default-847c5d5c9-ljlw8" (UID: "05ae7260-6786-4542-bf6d-4979f4d5bf1d") : configmap references non-existent config key: service-ca.crt Jul 24 12:17:32.380071 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.379890 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5f0aa6bf-6f8e-4157-8c39-4b5d44ce9475-serving-cert\") pod \"service-ca-operator-5d6c75f84f-4hhsg\" (UID: \"5f0aa6bf-6f8e-4157-8c39-4b5d44ce9475\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4hhsg" Jul 24 12:17:32.380071 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.379915 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f0aa6bf-6f8e-4157-8c39-4b5d44ce9475-config\") pod \"service-ca-operator-5d6c75f84f-4hhsg\" (UID: \"5f0aa6bf-6f8e-4157-8c39-4b5d44ce9475\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4hhsg" Jul 24 12:17:32.380071 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.379945 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/80196e1f-58e5-4a8e-a92d-bf979f9d95a1-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-drd9f\" (UID: \"80196e1f-58e5-4a8e-a92d-bf979f9d95a1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-drd9f" Jul 24 12:17:32.380071 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.379972 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d02e6e2-54f3-43fc-a712-faf751240dad-service-ca-bundle\") pod \"insights-operator-5885fdb759-mttrp\" (UID: \"1d02e6e2-54f3-43fc-a712-faf751240dad\") " pod="openshift-insights/insights-operator-5885fdb759-mttrp" Jul 24 12:17:32.380071 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.380008 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d02e6e2-54f3-43fc-a712-faf751240dad-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-mttrp\" (UID: \"1d02e6e2-54f3-43fc-a712-faf751240dad\") " pod="openshift-insights/insights-operator-5885fdb759-mttrp" Jul 24 12:17:32.380399 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.380377 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4a130a4a-ed5a-4a1e-821a-e5e0c115a0de-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-prgmm\" (UID: \"4a130a4a-ed5a-4a1e-821a-e5e0c115a0de\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-prgmm" Jul 24 12:17:32.380568 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.380546 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/80196e1f-58e5-4a8e-a92d-bf979f9d95a1-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-drd9f\" (UID: \"80196e1f-58e5-4a8e-a92d-bf979f9d95a1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-drd9f" Jul 24 12:17:32.380795 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.380773 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f0aa6bf-6f8e-4157-8c39-4b5d44ce9475-config\") pod \"service-ca-operator-5d6c75f84f-4hhsg\" (UID: \"5f0aa6bf-6f8e-4157-8c39-4b5d44ce9475\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4hhsg" Jul 24 12:17:32.381522 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.381504 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80196e1f-58e5-4a8e-a92d-bf979f9d95a1-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-drd9f\" (UID: \"80196e1f-58e5-4a8e-a92d-bf979f9d95a1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-drd9f" Jul 24 12:17:32.381780 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.381757 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/05ae7260-6786-4542-bf6d-4979f4d5bf1d-default-certificate\") pod \"router-default-847c5d5c9-ljlw8\" (UID: \"05ae7260-6786-4542-bf6d-4979f4d5bf1d\") " pod="openshift-ingress/router-default-847c5d5c9-ljlw8" Jul 24 12:17:32.382016 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.381984 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/05ae7260-6786-4542-bf6d-4979f4d5bf1d-stats-auth\") pod \"router-default-847c5d5c9-ljlw8\" (UID: \"05ae7260-6786-4542-bf6d-4979f4d5bf1d\") " pod="openshift-ingress/router-default-847c5d5c9-ljlw8" Jul 24 12:17:32.382531 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.382507 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5f0aa6bf-6f8e-4157-8c39-4b5d44ce9475-serving-cert\") pod \"service-ca-operator-5d6c75f84f-4hhsg\" (UID: \"5f0aa6bf-6f8e-4157-8c39-4b5d44ce9475\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4hhsg" Jul 24 12:17:32.389411 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.389392 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-c9nwk" Jul 24 12:17:32.392475 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.392454 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2sdx\" (UniqueName: \"kubernetes.io/projected/80196e1f-58e5-4a8e-a92d-bf979f9d95a1-kube-api-access-h2sdx\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-drd9f\" (UID: \"80196e1f-58e5-4a8e-a92d-bf979f9d95a1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-drd9f" Jul 24 12:17:32.392727 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.392704 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhltn\" (UniqueName: \"kubernetes.io/projected/4a130a4a-ed5a-4a1e-821a-e5e0c115a0de-kube-api-access-nhltn\") pod \"cluster-monitoring-operator-548b489cb8-prgmm\" (UID: \"4a130a4a-ed5a-4a1e-821a-e5e0c115a0de\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-prgmm" Jul 24 12:17:32.392804 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.392787 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnpvd\" (UniqueName: \"kubernetes.io/projected/5f0aa6bf-6f8e-4157-8c39-4b5d44ce9475-kube-api-access-jnpvd\") pod \"service-ca-operator-5d6c75f84f-4hhsg\" (UID: \"5f0aa6bf-6f8e-4157-8c39-4b5d44ce9475\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4hhsg" Jul 24 12:17:32.393932 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.393910 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqv8q\" (UniqueName: \"kubernetes.io/projected/05ae7260-6786-4542-bf6d-4979f4d5bf1d-kube-api-access-zqv8q\") pod \"router-default-847c5d5c9-ljlw8\" (UID: \"05ae7260-6786-4542-bf6d-4979f4d5bf1d\") " pod="openshift-ingress/router-default-847c5d5c9-ljlw8" Jul 24 12:17:32.394018 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.393936 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25zkh\" (UniqueName: \"kubernetes.io/projected/6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4-kube-api-access-25zkh\") pod \"cluster-samples-operator-6748489656-b2q26\" (UID: \"6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-b2q26" Jul 24 12:17:32.430437 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.430415 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:32.479355 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.479320 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-w6gwd" Jul 24 12:17:32.480777 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.480669 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c385960c-6bf7-4b33-8ce0-f627cb711d9c-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-576dn\" (UID: \"c385960c-6bf7-4b33-8ce0-f627cb711d9c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-576dn" Jul 24 12:17:32.480777 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.480707 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e1b58e8-bdad-423e-a12b-a8b0fc1c900e-config\") pod \"console-operator-584dcb6b54-g5v4m\" (UID: \"7e1b58e8-bdad-423e-a12b-a8b0fc1c900e\") " pod="openshift-console-operator/console-operator-584dcb6b54-g5v4m" Jul 24 12:17:32.482400 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.481098 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c385960c-6bf7-4b33-8ce0-f627cb711d9c-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-576dn\" (UID: \"c385960c-6bf7-4b33-8ce0-f627cb711d9c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-576dn" Jul 24 12:17:32.482400 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.481169 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7e1b58e8-bdad-423e-a12b-a8b0fc1c900e-trusted-ca\") pod \"console-operator-584dcb6b54-g5v4m\" (UID: \"7e1b58e8-bdad-423e-a12b-a8b0fc1c900e\") " pod="openshift-console-operator/console-operator-584dcb6b54-g5v4m" Jul 24 12:17:32.482400 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.481206 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1d02e6e2-54f3-43fc-a712-faf751240dad-snapshots\") pod \"insights-operator-5885fdb759-mttrp\" (UID: \"1d02e6e2-54f3-43fc-a712-faf751240dad\") " pod="openshift-insights/insights-operator-5885fdb759-mttrp" Jul 24 12:17:32.482400 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.481261 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7e1b58e8-bdad-423e-a12b-a8b0fc1c900e-serving-cert\") pod \"console-operator-584dcb6b54-g5v4m\" (UID: \"7e1b58e8-bdad-423e-a12b-a8b0fc1c900e\") " pod="openshift-console-operator/console-operator-584dcb6b54-g5v4m" Jul 24 12:17:32.482400 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.481298 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8z7v\" (UniqueName: \"kubernetes.io/projected/7e1b58e8-bdad-423e-a12b-a8b0fc1c900e-kube-api-access-q8z7v\") pod \"console-operator-584dcb6b54-g5v4m\" (UID: \"7e1b58e8-bdad-423e-a12b-a8b0fc1c900e\") " pod="openshift-console-operator/console-operator-584dcb6b54-g5v4m" Jul 24 12:17:32.482400 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.481392 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4fbk\" (UniqueName: \"kubernetes.io/projected/1d02e6e2-54f3-43fc-a712-faf751240dad-kube-api-access-d4fbk\") pod \"insights-operator-5885fdb759-mttrp\" (UID: \"1d02e6e2-54f3-43fc-a712-faf751240dad\") " pod="openshift-insights/insights-operator-5885fdb759-mttrp" Jul 24 12:17:32.482400 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.481432 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d02e6e2-54f3-43fc-a712-faf751240dad-tmp\") pod \"insights-operator-5885fdb759-mttrp\" (UID: \"1d02e6e2-54f3-43fc-a712-faf751240dad\") " pod="openshift-insights/insights-operator-5885fdb759-mttrp" Jul 24 12:17:32.482400 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.481461 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d02e6e2-54f3-43fc-a712-faf751240dad-serving-cert\") pod \"insights-operator-5885fdb759-mttrp\" (UID: \"1d02e6e2-54f3-43fc-a712-faf751240dad\") " pod="openshift-insights/insights-operator-5885fdb759-mttrp" Jul 24 12:17:32.482400 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.481466 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e1b58e8-bdad-423e-a12b-a8b0fc1c900e-config\") pod \"console-operator-584dcb6b54-g5v4m\" (UID: \"7e1b58e8-bdad-423e-a12b-a8b0fc1c900e\") " pod="openshift-console-operator/console-operator-584dcb6b54-g5v4m" Jul 24 12:17:32.482400 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.481498 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d02e6e2-54f3-43fc-a712-faf751240dad-service-ca-bundle\") pod \"insights-operator-5885fdb759-mttrp\" (UID: \"1d02e6e2-54f3-43fc-a712-faf751240dad\") " pod="openshift-insights/insights-operator-5885fdb759-mttrp" Jul 24 12:17:32.482400 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.481501 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c385960c-6bf7-4b33-8ce0-f627cb711d9c-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-576dn\" (UID: \"c385960c-6bf7-4b33-8ce0-f627cb711d9c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-576dn" Jul 24 12:17:32.482400 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.481535 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d02e6e2-54f3-43fc-a712-faf751240dad-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-mttrp\" (UID: \"1d02e6e2-54f3-43fc-a712-faf751240dad\") " pod="openshift-insights/insights-operator-5885fdb759-mttrp" Jul 24 12:17:32.482400 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.482272 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1d02e6e2-54f3-43fc-a712-faf751240dad-snapshots\") pod \"insights-operator-5885fdb759-mttrp\" (UID: \"1d02e6e2-54f3-43fc-a712-faf751240dad\") " pod="openshift-insights/insights-operator-5885fdb759-mttrp" Jul 24 12:17:32.483098 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:32.482473 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 24 12:17:32.483098 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.482487 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d02e6e2-54f3-43fc-a712-faf751240dad-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-mttrp\" (UID: \"1d02e6e2-54f3-43fc-a712-faf751240dad\") " pod="openshift-insights/insights-operator-5885fdb759-mttrp" Jul 24 12:17:32.483098 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:32.482533 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c385960c-6bf7-4b33-8ce0-f627cb711d9c-networking-console-plugin-cert podName:c385960c-6bf7-4b33-8ce0-f627cb711d9c nodeName:}" failed. No retries permitted until 2026-07-24 12:17:32.982513756 +0000 UTC m=+46.033758726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c385960c-6bf7-4b33-8ce0-f627cb711d9c-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-576dn" (UID: "c385960c-6bf7-4b33-8ce0-f627cb711d9c") : secret "networking-console-plugin-cert" not found Jul 24 12:17:32.483098 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.482574 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7e1b58e8-bdad-423e-a12b-a8b0fc1c900e-trusted-ca\") pod \"console-operator-584dcb6b54-g5v4m\" (UID: \"7e1b58e8-bdad-423e-a12b-a8b0fc1c900e\") " pod="openshift-console-operator/console-operator-584dcb6b54-g5v4m" Jul 24 12:17:32.483098 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.482740 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d02e6e2-54f3-43fc-a712-faf751240dad-service-ca-bundle\") pod \"insights-operator-5885fdb759-mttrp\" (UID: \"1d02e6e2-54f3-43fc-a712-faf751240dad\") " pod="openshift-insights/insights-operator-5885fdb759-mttrp" Jul 24 12:17:32.483098 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.482971 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d02e6e2-54f3-43fc-a712-faf751240dad-tmp\") pod \"insights-operator-5885fdb759-mttrp\" (UID: \"1d02e6e2-54f3-43fc-a712-faf751240dad\") " pod="openshift-insights/insights-operator-5885fdb759-mttrp" Jul 24 12:17:32.484100 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.484078 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7e1b58e8-bdad-423e-a12b-a8b0fc1c900e-serving-cert\") pod \"console-operator-584dcb6b54-g5v4m\" (UID: \"7e1b58e8-bdad-423e-a12b-a8b0fc1c900e\") " pod="openshift-console-operator/console-operator-584dcb6b54-g5v4m" Jul 24 12:17:32.484743 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.484725 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d02e6e2-54f3-43fc-a712-faf751240dad-serving-cert\") pod \"insights-operator-5885fdb759-mttrp\" (UID: \"1d02e6e2-54f3-43fc-a712-faf751240dad\") " pod="openshift-insights/insights-operator-5885fdb759-mttrp" Jul 24 12:17:32.490340 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.490317 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8z7v\" (UniqueName: \"kubernetes.io/projected/7e1b58e8-bdad-423e-a12b-a8b0fc1c900e-kube-api-access-q8z7v\") pod \"console-operator-584dcb6b54-g5v4m\" (UID: \"7e1b58e8-bdad-423e-a12b-a8b0fc1c900e\") " pod="openshift-console-operator/console-operator-584dcb6b54-g5v4m" Jul 24 12:17:32.490428 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.490365 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4fbk\" (UniqueName: \"kubernetes.io/projected/1d02e6e2-54f3-43fc-a712-faf751240dad-kube-api-access-d4fbk\") pod \"insights-operator-5885fdb759-mttrp\" (UID: \"1d02e6e2-54f3-43fc-a712-faf751240dad\") " pod="openshift-insights/insights-operator-5885fdb759-mttrp" Jul 24 12:17:32.499301 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.499279 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-drd9f" Jul 24 12:17:32.524935 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.524908 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:32.538518 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.538424 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-c9nwk"] Jul 24 12:17:32.543601 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:17:32.543575 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc22f8eb3_8726_43ce_8818_ca6ad3392b6d.slice/crio-22a849ed5ac4a341b7937c023a8014a9090323372f67526971d245af4f581e78 WatchSource:0}: Error finding container 22a849ed5ac4a341b7937c023a8014a9090323372f67526971d245af4f581e78: Status 404 returned error can't find the container with id 22a849ed5ac4a341b7937c023a8014a9090323372f67526971d245af4f581e78 Jul 24 12:17:32.576241 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.576179 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4hhsg" Jul 24 12:17:32.617941 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.617353 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-mttrp" Jul 24 12:17:32.641821 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.641763 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-g5v4m" Jul 24 12:17:32.656716 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.656684 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:32.661985 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.661952 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-w6gwd"] Jul 24 12:17:32.666295 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:17:32.666265 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0042792e_edab_4c36_99e2_1b51e51cf81d.slice/crio-40a34e77fdc584b17767e8b037356a887d3cf1535240034ab6850be703738568 WatchSource:0}: Error finding container 40a34e77fdc584b17767e8b037356a887d3cf1535240034ab6850be703738568: Status 404 returned error can't find the container with id 40a34e77fdc584b17767e8b037356a887d3cf1535240034ab6850be703738568 Jul 24 12:17:32.671751 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.671653 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-w6gwd" event={"ID":"0042792e-edab-4c36-99e2-1b51e51cf81d","Type":"ContainerStarted","Data":"40a34e77fdc584b17767e8b037356a887d3cf1535240034ab6850be703738568"} Jul 24 12:17:32.673674 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.673602 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-c9nwk" event={"ID":"c22f8eb3-8726-43ce-8818-ca6ad3392b6d","Type":"ContainerStarted","Data":"22a849ed5ac4a341b7937c023a8014a9090323372f67526971d245af4f581e78"} Jul 24 12:17:32.714035 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.713921 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-drd9f"] Jul 24 12:17:32.726670 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.725863 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:32.729918 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:17:32.729886 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80196e1f_58e5_4a8e_a92d_bf979f9d95a1.slice/crio-e469626567945a189e5228bb6c796cc38db32c2256df7c4d4ecca6be77d0674a WatchSource:0}: Error finding container e469626567945a189e5228bb6c796cc38db32c2256df7c4d4ecca6be77d0674a: Status 404 returned error can't find the container with id e469626567945a189e5228bb6c796cc38db32c2256df7c4d4ecca6be77d0674a Jul 24 12:17:32.761708 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.761678 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4hhsg"] Jul 24 12:17:32.767195 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:17:32.767032 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f0aa6bf_6f8e_4157_8c39_4b5d44ce9475.slice/crio-d4309f468b350890177813dd20b2ade1865d16318eff9c1afd3fdb7350a0e8b6 WatchSource:0}: Error finding container d4309f468b350890177813dd20b2ade1865d16318eff9c1afd3fdb7350a0e8b6: Status 404 returned error can't find the container with id d4309f468b350890177813dd20b2ade1865d16318eff9c1afd3fdb7350a0e8b6 Jul 24 12:17:32.797348 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.797316 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-mttrp"] Jul 24 12:17:32.800333 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:17:32.800293 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d02e6e2_54f3_43fc_a712_faf751240dad.slice/crio-18fddd1dd7ed9168183d6feb095b4c7db4128a6c1da59457577f503dbbd88f89 WatchSource:0}: Error finding container 18fddd1dd7ed9168183d6feb095b4c7db4128a6c1da59457577f503dbbd88f89: Status 404 returned error can't find the container with id 18fddd1dd7ed9168183d6feb095b4c7db4128a6c1da59457577f503dbbd88f89 Jul 24 12:17:32.822173 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.822154 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-g5v4m"] Jul 24 12:17:32.825752 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:17:32.825730 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e1b58e8_bdad_423e_a12b_a8b0fc1c900e.slice/crio-0612ed02bc58141fcc9085540f3e64e45602d3cea7c48657d6216a83f6db8fcd WatchSource:0}: Error finding container 0612ed02bc58141fcc9085540f3e64e45602d3cea7c48657d6216a83f6db8fcd: Status 404 returned error can't find the container with id 0612ed02bc58141fcc9085540f3e64e45602d3cea7c48657d6216a83f6db8fcd Jul 24 12:17:32.887873 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.887844 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05ae7260-6786-4542-bf6d-4979f4d5bf1d-metrics-certs\") pod \"router-default-847c5d5c9-ljlw8\" (UID: \"05ae7260-6786-4542-bf6d-4979f4d5bf1d\") " pod="openshift-ingress/router-default-847c5d5c9-ljlw8" Jul 24 12:17:32.887873 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.887878 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05ae7260-6786-4542-bf6d-4979f4d5bf1d-service-ca-bundle\") pod \"router-default-847c5d5c9-ljlw8\" (UID: \"05ae7260-6786-4542-bf6d-4979f4d5bf1d\") " pod="openshift-ingress/router-default-847c5d5c9-ljlw8" Jul 24 12:17:32.888049 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:32.887987 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/05ae7260-6786-4542-bf6d-4979f4d5bf1d-service-ca-bundle podName:05ae7260-6786-4542-bf6d-4979f4d5bf1d nodeName:}" failed. No retries permitted until 2026-07-24 12:17:33.887973785 +0000 UTC m=+46.939218754 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/05ae7260-6786-4542-bf6d-4979f4d5bf1d-service-ca-bundle") pod "router-default-847c5d5c9-ljlw8" (UID: "05ae7260-6786-4542-bf6d-4979f4d5bf1d") : configmap references non-existent config key: service-ca.crt Jul 24 12:17:32.888049 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:32.888002 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 12:17:32.888049 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.888035 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a130a4a-ed5a-4a1e-821a-e5e0c115a0de-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-prgmm\" (UID: \"4a130a4a-ed5a-4a1e-821a-e5e0c115a0de\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-prgmm" Jul 24 12:17:32.888197 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:32.888072 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05ae7260-6786-4542-bf6d-4979f4d5bf1d-metrics-certs podName:05ae7260-6786-4542-bf6d-4979f4d5bf1d nodeName:}" failed. No retries permitted until 2026-07-24 12:17:33.888039778 +0000 UTC m=+46.939284752 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05ae7260-6786-4542-bf6d-4979f4d5bf1d-metrics-certs") pod "router-default-847c5d5c9-ljlw8" (UID: "05ae7260-6786-4542-bf6d-4979f4d5bf1d") : secret "router-metrics-certs-default" not found Jul 24 12:17:32.888197 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:32.888130 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 12:17:32.888197 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.888162 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-b2q26\" (UID: \"6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-b2q26" Jul 24 12:17:32.888197 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:32.888168 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a130a4a-ed5a-4a1e-821a-e5e0c115a0de-cluster-monitoring-operator-tls podName:4a130a4a-ed5a-4a1e-821a-e5e0c115a0de nodeName:}" failed. No retries permitted until 2026-07-24 12:17:33.888158953 +0000 UTC m=+46.939403923 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4a130a4a-ed5a-4a1e-821a-e5e0c115a0de-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-prgmm" (UID: "4a130a4a-ed5a-4a1e-821a-e5e0c115a0de") : secret "cluster-monitoring-operator-tls" not found Jul 24 12:17:32.888328 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:32.888236 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 24 12:17:32.888328 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:32.888267 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4-samples-operator-tls podName:6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4 nodeName:}" failed. No retries permitted until 2026-07-24 12:17:33.888259665 +0000 UTC m=+46.939504636 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4-samples-operator-tls") pod "cluster-samples-operator-6748489656-b2q26" (UID: "6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4") : secret "samples-operator-tls" not found Jul 24 12:17:32.988871 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:32.988839 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c385960c-6bf7-4b33-8ce0-f627cb711d9c-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-576dn\" (UID: \"c385960c-6bf7-4b33-8ce0-f627cb711d9c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-576dn" Jul 24 12:17:32.989014 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:32.988975 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 24 12:17:32.989054 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:32.989029 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c385960c-6bf7-4b33-8ce0-f627cb711d9c-networking-console-plugin-cert podName:c385960c-6bf7-4b33-8ce0-f627cb711d9c nodeName:}" failed. No retries permitted until 2026-07-24 12:17:33.989013121 +0000 UTC m=+47.040258092 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c385960c-6bf7-4b33-8ce0-f627cb711d9c-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-576dn" (UID: "c385960c-6bf7-4b33-8ce0-f627cb711d9c") : secret "networking-console-plugin-cert" not found Jul 24 12:17:33.680003 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:33.679963 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-drd9f" event={"ID":"80196e1f-58e5-4a8e-a92d-bf979f9d95a1","Type":"ContainerStarted","Data":"e469626567945a189e5228bb6c796cc38db32c2256df7c4d4ecca6be77d0674a"} Jul 24 12:17:33.682373 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:33.682342 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-g5v4m" event={"ID":"7e1b58e8-bdad-423e-a12b-a8b0fc1c900e","Type":"ContainerStarted","Data":"0612ed02bc58141fcc9085540f3e64e45602d3cea7c48657d6216a83f6db8fcd"} Jul 24 12:17:33.684496 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:33.684468 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4hhsg" event={"ID":"5f0aa6bf-6f8e-4157-8c39-4b5d44ce9475","Type":"ContainerStarted","Data":"d4309f468b350890177813dd20b2ade1865d16318eff9c1afd3fdb7350a0e8b6"} Jul 24 12:17:33.687438 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:33.687391 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-mttrp" event={"ID":"1d02e6e2-54f3-43fc-a712-faf751240dad","Type":"ContainerStarted","Data":"18fddd1dd7ed9168183d6feb095b4c7db4128a6c1da59457577f503dbbd88f89"} Jul 24 12:17:33.898105 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:33.897556 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-b2q26\" (UID: \"6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-b2q26" Jul 24 12:17:33.898105 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:33.897621 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05ae7260-6786-4542-bf6d-4979f4d5bf1d-metrics-certs\") pod \"router-default-847c5d5c9-ljlw8\" (UID: \"05ae7260-6786-4542-bf6d-4979f4d5bf1d\") " pod="openshift-ingress/router-default-847c5d5c9-ljlw8" Jul 24 12:17:33.898105 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:33.897654 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05ae7260-6786-4542-bf6d-4979f4d5bf1d-service-ca-bundle\") pod \"router-default-847c5d5c9-ljlw8\" (UID: \"05ae7260-6786-4542-bf6d-4979f4d5bf1d\") " pod="openshift-ingress/router-default-847c5d5c9-ljlw8" Jul 24 12:17:33.898105 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:33.897732 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a130a4a-ed5a-4a1e-821a-e5e0c115a0de-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-prgmm\" (UID: \"4a130a4a-ed5a-4a1e-821a-e5e0c115a0de\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-prgmm" Jul 24 12:17:33.898105 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:33.897968 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 12:17:33.898105 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:33.898042 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a130a4a-ed5a-4a1e-821a-e5e0c115a0de-cluster-monitoring-operator-tls podName:4a130a4a-ed5a-4a1e-821a-e5e0c115a0de nodeName:}" failed. No retries permitted until 2026-07-24 12:17:35.898022674 +0000 UTC m=+48.949267647 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4a130a4a-ed5a-4a1e-821a-e5e0c115a0de-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-prgmm" (UID: "4a130a4a-ed5a-4a1e-821a-e5e0c115a0de") : secret "cluster-monitoring-operator-tls" not found Jul 24 12:17:33.898535 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:33.898452 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 24 12:17:33.898535 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:33.898502 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4-samples-operator-tls podName:6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4 nodeName:}" failed. No retries permitted until 2026-07-24 12:17:35.898486993 +0000 UTC m=+48.949731968 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4-samples-operator-tls") pod "cluster-samples-operator-6748489656-b2q26" (UID: "6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4") : secret "samples-operator-tls" not found Jul 24 12:17:33.898635 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:33.898558 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 12:17:33.898635 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:33.898624 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05ae7260-6786-4542-bf6d-4979f4d5bf1d-metrics-certs podName:05ae7260-6786-4542-bf6d-4979f4d5bf1d nodeName:}" failed. No retries permitted until 2026-07-24 12:17:35.898580114 +0000 UTC m=+48.949825087 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05ae7260-6786-4542-bf6d-4979f4d5bf1d-metrics-certs") pod "router-default-847c5d5c9-ljlw8" (UID: "05ae7260-6786-4542-bf6d-4979f4d5bf1d") : secret "router-metrics-certs-default" not found Jul 24 12:17:33.898734 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:33.898688 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/05ae7260-6786-4542-bf6d-4979f4d5bf1d-service-ca-bundle podName:05ae7260-6786-4542-bf6d-4979f4d5bf1d nodeName:}" failed. No retries permitted until 2026-07-24 12:17:35.89867679 +0000 UTC m=+48.949921776 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/05ae7260-6786-4542-bf6d-4979f4d5bf1d-service-ca-bundle") pod "router-default-847c5d5c9-ljlw8" (UID: "05ae7260-6786-4542-bf6d-4979f4d5bf1d") : configmap references non-existent config key: service-ca.crt Jul 24 12:17:33.999192 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:33.998987 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c385960c-6bf7-4b33-8ce0-f627cb711d9c-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-576dn\" (UID: \"c385960c-6bf7-4b33-8ce0-f627cb711d9c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-576dn" Jul 24 12:17:33.999904 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:33.999450 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 24 12:17:33.999904 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:33.999525 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c385960c-6bf7-4b33-8ce0-f627cb711d9c-networking-console-plugin-cert podName:c385960c-6bf7-4b33-8ce0-f627cb711d9c nodeName:}" failed. No retries permitted until 2026-07-24 12:17:35.999504581 +0000 UTC m=+49.050749561 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c385960c-6bf7-4b33-8ce0-f627cb711d9c-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-576dn" (UID: "c385960c-6bf7-4b33-8ce0-f627cb711d9c") : secret "networking-console-plugin-cert" not found Jul 24 12:17:35.919006 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:35.918964 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-b2q26\" (UID: \"6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-b2q26" Jul 24 12:17:35.919483 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:35.919029 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05ae7260-6786-4542-bf6d-4979f4d5bf1d-metrics-certs\") pod \"router-default-847c5d5c9-ljlw8\" (UID: \"05ae7260-6786-4542-bf6d-4979f4d5bf1d\") " pod="openshift-ingress/router-default-847c5d5c9-ljlw8" Jul 24 12:17:35.919483 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:35.919082 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05ae7260-6786-4542-bf6d-4979f4d5bf1d-service-ca-bundle\") pod \"router-default-847c5d5c9-ljlw8\" (UID: \"05ae7260-6786-4542-bf6d-4979f4d5bf1d\") " pod="openshift-ingress/router-default-847c5d5c9-ljlw8" Jul 24 12:17:35.919483 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:35.919149 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a130a4a-ed5a-4a1e-821a-e5e0c115a0de-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-prgmm\" (UID: \"4a130a4a-ed5a-4a1e-821a-e5e0c115a0de\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-prgmm" Jul 24 12:17:35.919483 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:35.919157 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 24 12:17:35.919483 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:35.919173 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 12:17:35.919483 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:35.919225 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4-samples-operator-tls podName:6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4 nodeName:}" failed. No retries permitted until 2026-07-24 12:17:39.919209235 +0000 UTC m=+52.970454206 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4-samples-operator-tls") pod "cluster-samples-operator-6748489656-b2q26" (UID: "6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4") : secret "samples-operator-tls" not found Jul 24 12:17:35.919483 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:35.919250 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05ae7260-6786-4542-bf6d-4979f4d5bf1d-metrics-certs podName:05ae7260-6786-4542-bf6d-4979f4d5bf1d nodeName:}" failed. No retries permitted until 2026-07-24 12:17:39.91923256 +0000 UTC m=+52.970477537 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05ae7260-6786-4542-bf6d-4979f4d5bf1d-metrics-certs") pod "router-default-847c5d5c9-ljlw8" (UID: "05ae7260-6786-4542-bf6d-4979f4d5bf1d") : secret "router-metrics-certs-default" not found Jul 24 12:17:35.919483 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:35.919274 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 12:17:35.919483 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:35.919312 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/05ae7260-6786-4542-bf6d-4979f4d5bf1d-service-ca-bundle podName:05ae7260-6786-4542-bf6d-4979f4d5bf1d nodeName:}" failed. No retries permitted until 2026-07-24 12:17:39.919292662 +0000 UTC m=+52.970537657 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/05ae7260-6786-4542-bf6d-4979f4d5bf1d-service-ca-bundle") pod "router-default-847c5d5c9-ljlw8" (UID: "05ae7260-6786-4542-bf6d-4979f4d5bf1d") : configmap references non-existent config key: service-ca.crt Jul 24 12:17:35.919483 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:35.919341 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a130a4a-ed5a-4a1e-821a-e5e0c115a0de-cluster-monitoring-operator-tls podName:4a130a4a-ed5a-4a1e-821a-e5e0c115a0de nodeName:}" failed. No retries permitted until 2026-07-24 12:17:39.919330296 +0000 UTC m=+52.970575270 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4a130a4a-ed5a-4a1e-821a-e5e0c115a0de-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-prgmm" (UID: "4a130a4a-ed5a-4a1e-821a-e5e0c115a0de") : secret "cluster-monitoring-operator-tls" not found Jul 24 12:17:36.020158 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:36.020109 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c385960c-6bf7-4b33-8ce0-f627cb711d9c-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-576dn\" (UID: \"c385960c-6bf7-4b33-8ce0-f627cb711d9c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-576dn" Jul 24 12:17:36.020317 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:36.020261 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 24 12:17:36.020354 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:36.020327 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c385960c-6bf7-4b33-8ce0-f627cb711d9c-networking-console-plugin-cert podName:c385960c-6bf7-4b33-8ce0-f627cb711d9c nodeName:}" failed. No retries permitted until 2026-07-24 12:17:40.020311216 +0000 UTC m=+53.071556186 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c385960c-6bf7-4b33-8ce0-f627cb711d9c-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-576dn" (UID: "c385960c-6bf7-4b33-8ce0-f627cb711d9c") : secret "networking-console-plugin-cert" not found Jul 24 12:17:37.560109 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:37.560052 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:37.663508 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:37.663471 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:37.735762 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:37.735724 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8daa84c-73b5-4346-8f92-81dd451dfaa5-metrics-tls\") pod \"dns-default-8q6d8\" (UID: \"b8daa84c-73b5-4346-8f92-81dd451dfaa5\") " pod="openshift-dns/dns-default-8q6d8" Jul 24 12:17:37.735939 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:37.735793 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f6e6a89-d316-425a-9138-c0318824371d-registry-tls\") pod \"image-registry-59c89c9f84-ldxwc\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" Jul 24 12:17:37.735939 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:37.735891 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 12:17:37.736031 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:37.735955 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 12:17:37.736031 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:37.735966 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8daa84c-73b5-4346-8f92-81dd451dfaa5-metrics-tls podName:b8daa84c-73b5-4346-8f92-81dd451dfaa5 nodeName:}" failed. No retries permitted until 2026-07-24 12:17:53.735942692 +0000 UTC m=+66.787187699 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b8daa84c-73b5-4346-8f92-81dd451dfaa5-metrics-tls") pod "dns-default-8q6d8" (UID: "b8daa84c-73b5-4346-8f92-81dd451dfaa5") : secret "dns-default-metrics-tls" not found Jul 24 12:17:37.736031 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:37.735969 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59c89c9f84-ldxwc: secret "image-registry-tls" not found Jul 24 12:17:37.736031 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:37.736009 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f6e6a89-d316-425a-9138-c0318824371d-registry-tls podName:8f6e6a89-d316-425a-9138-c0318824371d nodeName:}" failed. No retries permitted until 2026-07-24 12:17:53.735998071 +0000 UTC m=+66.787243040 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f6e6a89-d316-425a-9138-c0318824371d-registry-tls") pod "image-registry-59c89c9f84-ldxwc" (UID: "8f6e6a89-d316-425a-9138-c0318824371d") : secret "image-registry-tls" not found Jul 24 12:17:39.706412 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:39.706375 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-w6gwd" event={"ID":"0042792e-edab-4c36-99e2-1b51e51cf81d","Type":"ContainerStarted","Data":"fd450155aa4163e812b85f847d5391a11f8a91bf14c673b8e8e27e9936ec9207"} Jul 24 12:17:39.708715 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:39.708349 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-c9nwk" event={"ID":"c22f8eb3-8726-43ce-8818-ca6ad3392b6d","Type":"ContainerStarted","Data":"8cb8fafcea469ab4b0d2cb548f1ba0886a688f9f0783e5a3da4c18b56532b233"} Jul 24 12:17:39.709982 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:39.709959 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-drd9f" event={"ID":"80196e1f-58e5-4a8e-a92d-bf979f9d95a1","Type":"ContainerStarted","Data":"15d447a23b0d250d76564ea0f8462357ba3a57130a1c67b3e27233ac4667ec32"} Jul 24 12:17:39.711838 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:39.711817 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-g5v4m_7e1b58e8-bdad-423e-a12b-a8b0fc1c900e/console-operator/0.log" Jul 24 12:17:39.711948 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:39.711851 2555 generic.go:356] "Generic (PLEG): container finished" podID="7e1b58e8-bdad-423e-a12b-a8b0fc1c900e" containerID="e4cd721fd243996a76c35d978496913aad8bc87a814250325e3854a983220225" exitCode=255 Jul 24 12:17:39.712083 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:39.712044 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-g5v4m" event={"ID":"7e1b58e8-bdad-423e-a12b-a8b0fc1c900e","Type":"ContainerDied","Data":"e4cd721fd243996a76c35d978496913aad8bc87a814250325e3854a983220225"} Jul 24 12:17:39.712199 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:39.712159 2555 scope.go:117] "RemoveContainer" containerID="e4cd721fd243996a76c35d978496913aad8bc87a814250325e3854a983220225" Jul 24 12:17:39.714947 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:39.714916 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4hhsg" event={"ID":"5f0aa6bf-6f8e-4157-8c39-4b5d44ce9475","Type":"ContainerStarted","Data":"90cc902f2d651f36cca68ca3da46933bc6bae21b6b4e0e2777568a07302ab9cf"} Jul 24 12:17:39.716502 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:39.716481 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-mttrp" event={"ID":"1d02e6e2-54f3-43fc-a712-faf751240dad","Type":"ContainerStarted","Data":"585ebfe79b144ed6f0a021a74c759ceabdd0633876128f504cc0c5ea669b7710"} Jul 24 12:17:39.722169 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:39.722099 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-w6gwd" podStartSLOduration=1.416667786 podStartE2EDuration="7.722082734s" totalImagesPullingTime="6.305414948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:17:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:17:39.721606701 +0000 UTC m=+52.772851694" watchObservedRunningTime="2026-07-24 12:17:39.722082734 +0000 UTC m=+52.773327724" Jul 24 12:17:39.758155 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:39.757341 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-c9nwk" podStartSLOduration=1.3379932079999999 podStartE2EDuration="7.757323024s" totalImagesPullingTime="6.419329816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:17:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:17:39.757072257 +0000 UTC m=+52.808317263" watchObservedRunningTime="2026-07-24 12:17:39.757323024 +0000 UTC m=+52.808568017" Jul 24 12:17:39.774747 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:39.774699 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-drd9f" podStartSLOduration=1.54367228 podStartE2EDuration="7.774686204s" totalImagesPullingTime="6.231013924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:17:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:17:39.774092482 +0000 UTC m=+52.825337491" watchObservedRunningTime="2026-07-24 12:17:39.774686204 +0000 UTC m=+52.825931195" Jul 24 12:17:39.791556 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:39.790626 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4hhsg" podStartSLOduration=1.595421712 podStartE2EDuration="7.790605823s" totalImagesPullingTime="6.195184111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:17:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:17:39.789578729 +0000 UTC m=+52.840823721" watchObservedRunningTime="2026-07-24 12:17:39.790605823 +0000 UTC m=+52.841850834" Jul 24 12:17:39.807245 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:39.807202 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-mttrp" podStartSLOduration=1.645260806 podStartE2EDuration="7.807187216s" totalImagesPullingTime="6.16192641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:17:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:17:39.806166218 +0000 UTC m=+52.857411224" watchObservedRunningTime="2026-07-24 12:17:39.807187216 +0000 UTC m=+52.858432232" Jul 24 12:17:39.905827 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:39.905696 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:39.954919 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:39.954880 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a130a4a-ed5a-4a1e-821a-e5e0c115a0de-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-prgmm\" (UID: \"4a130a4a-ed5a-4a1e-821a-e5e0c115a0de\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-prgmm" Jul 24 12:17:39.955128 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:39.955007 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-b2q26\" (UID: \"6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-b2q26" Jul 24 12:17:39.955128 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:39.955049 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05ae7260-6786-4542-bf6d-4979f4d5bf1d-metrics-certs\") pod \"router-default-847c5d5c9-ljlw8\" (UID: \"05ae7260-6786-4542-bf6d-4979f4d5bf1d\") " pod="openshift-ingress/router-default-847c5d5c9-ljlw8" Jul 24 12:17:39.955128 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:39.955109 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05ae7260-6786-4542-bf6d-4979f4d5bf1d-service-ca-bundle\") pod \"router-default-847c5d5c9-ljlw8\" (UID: \"05ae7260-6786-4542-bf6d-4979f4d5bf1d\") " pod="openshift-ingress/router-default-847c5d5c9-ljlw8" Jul 24 12:17:39.955294 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:39.955053 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 12:17:39.955294 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:39.955190 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 12:17:39.955294 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:39.955156 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 24 12:17:39.955294 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:39.955238 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a130a4a-ed5a-4a1e-821a-e5e0c115a0de-cluster-monitoring-operator-tls podName:4a130a4a-ed5a-4a1e-821a-e5e0c115a0de nodeName:}" failed. No retries permitted until 2026-07-24 12:17:47.955217263 +0000 UTC m=+61.006462239 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4a130a4a-ed5a-4a1e-821a-e5e0c115a0de-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-prgmm" (UID: "4a130a4a-ed5a-4a1e-821a-e5e0c115a0de") : secret "cluster-monitoring-operator-tls" not found Jul 24 12:17:39.955294 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:39.955257 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05ae7260-6786-4542-bf6d-4979f4d5bf1d-metrics-certs podName:05ae7260-6786-4542-bf6d-4979f4d5bf1d nodeName:}" failed. No retries permitted until 2026-07-24 12:17:47.955248279 +0000 UTC m=+61.006493254 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05ae7260-6786-4542-bf6d-4979f4d5bf1d-metrics-certs") pod "router-default-847c5d5c9-ljlw8" (UID: "05ae7260-6786-4542-bf6d-4979f4d5bf1d") : secret "router-metrics-certs-default" not found Jul 24 12:17:39.955294 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:39.955272 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/05ae7260-6786-4542-bf6d-4979f4d5bf1d-service-ca-bundle podName:05ae7260-6786-4542-bf6d-4979f4d5bf1d nodeName:}" failed. No retries permitted until 2026-07-24 12:17:47.955263471 +0000 UTC m=+61.006508447 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/05ae7260-6786-4542-bf6d-4979f4d5bf1d-service-ca-bundle") pod "router-default-847c5d5c9-ljlw8" (UID: "05ae7260-6786-4542-bf6d-4979f4d5bf1d") : configmap references non-existent config key: service-ca.crt Jul 24 12:17:39.955294 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:39.955286 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4-samples-operator-tls podName:6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4 nodeName:}" failed. No retries permitted until 2026-07-24 12:17:47.955278232 +0000 UTC m=+61.006523206 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4-samples-operator-tls") pod "cluster-samples-operator-6748489656-b2q26" (UID: "6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4") : secret "samples-operator-tls" not found Jul 24 12:17:40.005962 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.005877 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:40.061853 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.056275 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c385960c-6bf7-4b33-8ce0-f627cb711d9c-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-576dn\" (UID: \"c385960c-6bf7-4b33-8ce0-f627cb711d9c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-576dn" Jul 24 12:17:40.061853 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:40.056456 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 24 12:17:40.061853 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:40.056550 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c385960c-6bf7-4b33-8ce0-f627cb711d9c-networking-console-plugin-cert podName:c385960c-6bf7-4b33-8ce0-f627cb711d9c nodeName:}" failed. No retries permitted until 2026-07-24 12:17:48.056511826 +0000 UTC m=+61.107756800 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c385960c-6bf7-4b33-8ce0-f627cb711d9c-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-576dn" (UID: "c385960c-6bf7-4b33-8ce0-f627cb711d9c") : secret "networking-console-plugin-cert" not found Jul 24 12:17:40.386092 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.385983 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qsfrm"] Jul 24 12:17:40.412634 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.412598 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qsfrm"] Jul 24 12:17:40.412807 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.412729 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qsfrm" Jul 24 12:17:40.415136 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.415110 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 24 12:17:40.415269 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.415217 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9p5qg\"" Jul 24 12:17:40.415343 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.415273 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 24 12:17:40.417684 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.417659 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:40.460701 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.460671 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-data-volume\") pod \"insights-runtime-extractor-qsfrm\" (UID: \"5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db\") " pod="openshift-insights/insights-runtime-extractor-qsfrm" Jul 24 12:17:40.460876 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.460834 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qsfrm\" (UID: \"5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db\") " pod="openshift-insights/insights-runtime-extractor-qsfrm" Jul 24 12:17:40.460949 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.460934 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j7bq\" (UniqueName: \"kubernetes.io/projected/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-kube-api-access-4j7bq\") pod \"insights-runtime-extractor-qsfrm\" (UID: \"5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db\") " pod="openshift-insights/insights-runtime-extractor-qsfrm" Jul 24 12:17:40.461015 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.460986 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qsfrm\" (UID: \"5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db\") " pod="openshift-insights/insights-runtime-extractor-qsfrm" Jul 24 12:17:40.461162 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.461142 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-crio-socket\") pod \"insights-runtime-extractor-qsfrm\" (UID: \"5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db\") " pod="openshift-insights/insights-runtime-extractor-qsfrm" Jul 24 12:17:40.475591 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.475561 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:40.561837 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.561808 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qsfrm\" (UID: \"5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db\") " pod="openshift-insights/insights-runtime-extractor-qsfrm" Jul 24 12:17:40.561997 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.561895 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4j7bq\" (UniqueName: \"kubernetes.io/projected/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-kube-api-access-4j7bq\") pod \"insights-runtime-extractor-qsfrm\" (UID: \"5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db\") " pod="openshift-insights/insights-runtime-extractor-qsfrm" Jul 24 12:17:40.561997 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.561930 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qsfrm\" (UID: \"5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db\") " pod="openshift-insights/insights-runtime-extractor-qsfrm" Jul 24 12:17:40.561997 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:40.561940 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 12:17:40.561997 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.561970 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-crio-socket\") pod \"insights-runtime-extractor-qsfrm\" (UID: \"5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db\") " pod="openshift-insights/insights-runtime-extractor-qsfrm" Jul 24 12:17:40.562232 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:40.562025 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-kube-rbac-proxy-cm podName:5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db nodeName:}" failed. No retries permitted until 2026-07-24 12:17:41.061992076 +0000 UTC m=+54.113237050 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qsfrm" (UID: "5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db") : configmap "kube-rbac-proxy" not found Jul 24 12:17:40.562232 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.561994 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-data-volume\") pod \"insights-runtime-extractor-qsfrm\" (UID: \"5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db\") " pod="openshift-insights/insights-runtime-extractor-qsfrm" Jul 24 12:17:40.562232 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:40.562103 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 12:17:40.562232 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.562141 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-crio-socket\") pod \"insights-runtime-extractor-qsfrm\" (UID: \"5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db\") " pod="openshift-insights/insights-runtime-extractor-qsfrm" Jul 24 12:17:40.562232 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:40.562158 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-insights-runtime-extractor-tls podName:5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db nodeName:}" failed. No retries permitted until 2026-07-24 12:17:41.062142389 +0000 UTC m=+54.113387370 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qsfrm" (UID: "5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db") : secret "insights-runtime-extractor-tls" not found Jul 24 12:17:40.562449 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.562318 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-data-volume\") pod \"insights-runtime-extractor-qsfrm\" (UID: \"5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db\") " pod="openshift-insights/insights-runtime-extractor-qsfrm" Jul 24 12:17:40.570372 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.570346 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j7bq\" (UniqueName: \"kubernetes.io/projected/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-kube-api-access-4j7bq\") pod \"insights-runtime-extractor-qsfrm\" (UID: \"5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db\") " pod="openshift-insights/insights-runtime-extractor-qsfrm" Jul 24 12:17:40.628089 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.628041 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:40.714345 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.714301 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:40.723905 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.723882 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-g5v4m_7e1b58e8-bdad-423e-a12b-a8b0fc1c900e/console-operator/1.log" Jul 24 12:17:40.724628 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.724594 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-g5v4m_7e1b58e8-bdad-423e-a12b-a8b0fc1c900e/console-operator/0.log" Jul 24 12:17:40.724762 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.724636 2555 generic.go:356] "Generic (PLEG): container finished" podID="7e1b58e8-bdad-423e-a12b-a8b0fc1c900e" containerID="4dfc64ef75027600eb6bd51188d6b261679e65554e2591fbac86af99bda0c920" exitCode=255 Jul 24 12:17:40.726663 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.725696 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-g5v4m" event={"ID":"7e1b58e8-bdad-423e-a12b-a8b0fc1c900e","Type":"ContainerDied","Data":"4dfc64ef75027600eb6bd51188d6b261679e65554e2591fbac86af99bda0c920"} Jul 24 12:17:40.726663 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.725771 2555 scope.go:117] "RemoveContainer" containerID="e4cd721fd243996a76c35d978496913aad8bc87a814250325e3854a983220225" Jul 24 12:17:40.727597 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.727579 2555 scope.go:117] "RemoveContainer" containerID="4dfc64ef75027600eb6bd51188d6b261679e65554e2591fbac86af99bda0c920" Jul 24 12:17:40.728044 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:40.727769 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-g5v4m_openshift-console-operator(7e1b58e8-bdad-423e-a12b-a8b0fc1c900e)\"" pod="openshift-console-operator/console-operator-584dcb6b54-g5v4m" podUID="7e1b58e8-bdad-423e-a12b-a8b0fc1c900e" Jul 24 12:17:40.744576 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.744550 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-zxcmg"] Jul 24 12:17:40.759574 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.759551 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-zxcmg" Jul 24 12:17:40.762161 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.762135 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-zxcmg"] Jul 24 12:17:40.762408 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.762391 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-czcg9\"" Jul 24 12:17:40.762669 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.762641 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 24 12:17:40.762888 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.762869 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 24 12:17:40.817738 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.817709 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:40.866017 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.865981 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzdbc\" (UniqueName: \"kubernetes.io/projected/0fb49080-c837-4e18-a53c-c2111df9af22-kube-api-access-kzdbc\") pod \"migrator-6865c9967-zxcmg\" (UID: \"0fb49080-c837-4e18-a53c-c2111df9af22\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-zxcmg" Jul 24 12:17:40.910269 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.910236 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:40.963766 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.963731 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:40.966830 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.966787 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzdbc\" (UniqueName: \"kubernetes.io/projected/0fb49080-c837-4e18-a53c-c2111df9af22-kube-api-access-kzdbc\") pod \"migrator-6865c9967-zxcmg\" (UID: \"0fb49080-c837-4e18-a53c-c2111df9af22\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-zxcmg" Jul 24 12:17:40.974750 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:40.974730 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzdbc\" (UniqueName: \"kubernetes.io/projected/0fb49080-c837-4e18-a53c-c2111df9af22-kube-api-access-kzdbc\") pod \"migrator-6865c9967-zxcmg\" (UID: \"0fb49080-c837-4e18-a53c-c2111df9af22\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-zxcmg" Jul 24 12:17:41.067451 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:41.067419 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qsfrm\" (UID: \"5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db\") " pod="openshift-insights/insights-runtime-extractor-qsfrm" Jul 24 12:17:41.067567 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:41.067515 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qsfrm\" (UID: \"5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db\") " pod="openshift-insights/insights-runtime-extractor-qsfrm" Jul 24 12:17:41.067607 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:41.067573 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 12:17:41.067607 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:41.067587 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 12:17:41.067672 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:41.067635 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-insights-runtime-extractor-tls podName:5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db nodeName:}" failed. No retries permitted until 2026-07-24 12:17:42.067620813 +0000 UTC m=+55.118865786 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qsfrm" (UID: "5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db") : secret "insights-runtime-extractor-tls" not found Jul 24 12:17:41.067672 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:41.067652 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-kube-rbac-proxy-cm podName:5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db nodeName:}" failed. No retries permitted until 2026-07-24 12:17:42.06764456 +0000 UTC m=+55.118889534 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qsfrm" (UID: "5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db") : configmap "kube-rbac-proxy" not found Jul 24 12:17:41.071320 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:41.071305 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-zxcmg" Jul 24 12:17:41.197268 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:41.197203 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:41.227242 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:41.227220 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-zxcmg"] Jul 24 12:17:41.229185 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:17:41.229152 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fb49080_c837_4e18_a53c_c2111df9af22.slice/crio-9f18c7e8dd074b331535d030a9224e3465dd7eb78d8d1481fc955f5e382e33e1 WatchSource:0}: Error finding container 9f18c7e8dd074b331535d030a9224e3465dd7eb78d8d1481fc955f5e382e33e1: Status 404 returned error can't find the container with id 9f18c7e8dd074b331535d030a9224e3465dd7eb78d8d1481fc955f5e382e33e1 Jul 24 12:17:41.303640 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:41.303610 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:41.573096 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:41.572996 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qhshz_6dc76beb-b2b1-422c-a272-5623d2fb2f5e/dns-node-resolver/0.log" Jul 24 12:17:41.729488 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:41.729462 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-g5v4m_7e1b58e8-bdad-423e-a12b-a8b0fc1c900e/console-operator/1.log" Jul 24 12:17:41.733399 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:41.730100 2555 scope.go:117] "RemoveContainer" containerID="4dfc64ef75027600eb6bd51188d6b261679e65554e2591fbac86af99bda0c920" Jul 24 12:17:41.733399 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:41.730396 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-g5v4m_openshift-console-operator(7e1b58e8-bdad-423e-a12b-a8b0fc1c900e)\"" pod="openshift-console-operator/console-operator-584dcb6b54-g5v4m" podUID="7e1b58e8-bdad-423e-a12b-a8b0fc1c900e" Jul 24 12:17:41.734474 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:41.734449 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-zxcmg" event={"ID":"0fb49080-c837-4e18-a53c-c2111df9af22","Type":"ContainerStarted","Data":"9f18c7e8dd074b331535d030a9224e3465dd7eb78d8d1481fc955f5e382e33e1"} Jul 24 12:17:42.076568 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:42.076518 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qsfrm\" (UID: \"5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db\") " pod="openshift-insights/insights-runtime-extractor-qsfrm" Jul 24 12:17:42.076762 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:42.076723 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 12:17:42.076809 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:42.076750 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qsfrm\" (UID: \"5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db\") " pod="openshift-insights/insights-runtime-extractor-qsfrm" Jul 24 12:17:42.076809 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:42.076797 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-insights-runtime-extractor-tls podName:5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db nodeName:}" failed. No retries permitted until 2026-07-24 12:17:44.07677596 +0000 UTC m=+57.128020948 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qsfrm" (UID: "5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db") : secret "insights-runtime-extractor-tls" not found Jul 24 12:17:42.076913 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:42.076839 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 12:17:42.076913 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:42.076895 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-kube-rbac-proxy-cm podName:5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db nodeName:}" failed. No retries permitted until 2026-07-24 12:17:44.076879386 +0000 UTC m=+57.128124357 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qsfrm" (UID: "5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db") : configmap "kube-rbac-proxy" not found Jul 24 12:17:42.573145 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:42.573122 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bwdsq_aebc0623-951c-431c-9ac0-f7c139f35c12/node-ca/0.log" Jul 24 12:17:42.642719 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:42.642696 2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-g5v4m" Jul 24 12:17:42.642813 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:42.642747 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-g5v4m" Jul 24 12:17:42.738986 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:42.738948 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-zxcmg" event={"ID":"0fb49080-c837-4e18-a53c-c2111df9af22","Type":"ContainerStarted","Data":"f44001469438b5886f21aae6ed98444daf5ef06341017cf62218bd7b3c4e1a55"} Jul 24 12:17:42.739402 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:42.739012 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-zxcmg" event={"ID":"0fb49080-c837-4e18-a53c-c2111df9af22","Type":"ContainerStarted","Data":"36327d1a5d9e210eecb128fe5391508555bae1dc8f995b7e712cba739a6bed24"} Jul 24 12:17:42.739402 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:42.739275 2555 scope.go:117] "RemoveContainer" containerID="4dfc64ef75027600eb6bd51188d6b261679e65554e2591fbac86af99bda0c920" Jul 24 12:17:42.739517 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:42.739448 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-g5v4m_openshift-console-operator(7e1b58e8-bdad-423e-a12b-a8b0fc1c900e)\"" pod="openshift-console-operator/console-operator-584dcb6b54-g5v4m" podUID="7e1b58e8-bdad-423e-a12b-a8b0fc1c900e" Jul 24 12:17:42.755691 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:42.755646 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-zxcmg" podStartSLOduration=1.429993892 podStartE2EDuration="2.755631098s" totalImagesPullingTime="1.325637206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:17:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:17:42.755007632 +0000 UTC m=+55.806252641" watchObservedRunningTime="2026-07-24 12:17:42.755631098 +0000 UTC m=+55.806876092" Jul 24 12:17:42.806745 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:42.806685 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-ntnfg"] Jul 24 12:17:42.808619 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:42.808604 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-ntnfg" Jul 24 12:17:42.811221 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:42.811201 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 24 12:17:42.811469 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:42.811450 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-kctn6\"" Jul 24 12:17:42.811580 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:42.811470 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 24 12:17:42.811580 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:42.811454 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 24 12:17:42.811695 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:42.811591 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 24 12:17:42.816817 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:42.816795 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-ntnfg"] Jul 24 12:17:42.850157 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:42.850127 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:42.886327 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:42.886304 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/042e84ab-75ca-440b-a350-240d7264170e-signing-key\") pod \"service-ca-658d7b7c78-ntnfg\" (UID: \"042e84ab-75ca-440b-a350-240d7264170e\") " pod="openshift-service-ca/service-ca-658d7b7c78-ntnfg" Jul 24 12:17:42.886432 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:42.886346 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxtcx\" (UniqueName: \"kubernetes.io/projected/042e84ab-75ca-440b-a350-240d7264170e-kube-api-access-qxtcx\") pod \"service-ca-658d7b7c78-ntnfg\" (UID: \"042e84ab-75ca-440b-a350-240d7264170e\") " pod="openshift-service-ca/service-ca-658d7b7c78-ntnfg" Jul 24 12:17:42.886432 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:42.886383 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/042e84ab-75ca-440b-a350-240d7264170e-signing-cabundle\") pod \"service-ca-658d7b7c78-ntnfg\" (UID: \"042e84ab-75ca-440b-a350-240d7264170e\") " pod="openshift-service-ca/service-ca-658d7b7c78-ntnfg" Jul 24 12:17:42.903077 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:42.903024 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:42.987821 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:42.987791 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/042e84ab-75ca-440b-a350-240d7264170e-signing-key\") pod \"service-ca-658d7b7c78-ntnfg\" (UID: \"042e84ab-75ca-440b-a350-240d7264170e\") " pod="openshift-service-ca/service-ca-658d7b7c78-ntnfg" Jul 24 12:17:42.987954 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:42.987833 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxtcx\" (UniqueName: \"kubernetes.io/projected/042e84ab-75ca-440b-a350-240d7264170e-kube-api-access-qxtcx\") pod \"service-ca-658d7b7c78-ntnfg\" (UID: \"042e84ab-75ca-440b-a350-240d7264170e\") " pod="openshift-service-ca/service-ca-658d7b7c78-ntnfg" Jul 24 12:17:42.987954 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:42.987878 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/042e84ab-75ca-440b-a350-240d7264170e-signing-cabundle\") pod \"service-ca-658d7b7c78-ntnfg\" (UID: \"042e84ab-75ca-440b-a350-240d7264170e\") " pod="openshift-service-ca/service-ca-658d7b7c78-ntnfg" Jul 24 12:17:42.988590 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:42.988573 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/042e84ab-75ca-440b-a350-240d7264170e-signing-cabundle\") pod \"service-ca-658d7b7c78-ntnfg\" (UID: \"042e84ab-75ca-440b-a350-240d7264170e\") " pod="openshift-service-ca/service-ca-658d7b7c78-ntnfg" Jul 24 12:17:42.990300 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:42.990277 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/042e84ab-75ca-440b-a350-240d7264170e-signing-key\") pod \"service-ca-658d7b7c78-ntnfg\" (UID: \"042e84ab-75ca-440b-a350-240d7264170e\") " pod="openshift-service-ca/service-ca-658d7b7c78-ntnfg" Jul 24 12:17:42.999977 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:42.999957 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxtcx\" (UniqueName: \"kubernetes.io/projected/042e84ab-75ca-440b-a350-240d7264170e-kube-api-access-qxtcx\") pod \"service-ca-658d7b7c78-ntnfg\" (UID: \"042e84ab-75ca-440b-a350-240d7264170e\") " pod="openshift-service-ca/service-ca-658d7b7c78-ntnfg" Jul 24 12:17:43.118275 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:43.118192 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-ntnfg" Jul 24 12:17:43.177598 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:43.177573 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mzw5p_22ea11f4-48aa-48a3-9310-eb5ad5ceef5c/serve-healthcheck-canary/0.log" Jul 24 12:17:43.236258 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:43.236227 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-ntnfg"] Jul 24 12:17:43.239807 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:17:43.239780 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod042e84ab_75ca_440b_a350_240d7264170e.slice/crio-29e96ba055e557283230dc6bae1f4a7550d3d250ab0bea4a56da9566abbc4f96 WatchSource:0}: Error finding container 29e96ba055e557283230dc6bae1f4a7550d3d250ab0bea4a56da9566abbc4f96: Status 404 returned error can't find the container with id 29e96ba055e557283230dc6bae1f4a7550d3d250ab0bea4a56da9566abbc4f96 Jul 24 12:17:43.743953 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:43.743915 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-ntnfg" event={"ID":"042e84ab-75ca-440b-a350-240d7264170e","Type":"ContainerStarted","Data":"207c1e7ef9d325588c9584ecaf7c87e3e4e080a2599fbbc214d6806b7ee7af2e"} Jul 24 12:17:43.744338 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:43.743967 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-ntnfg" event={"ID":"042e84ab-75ca-440b-a350-240d7264170e","Type":"ContainerStarted","Data":"29e96ba055e557283230dc6bae1f4a7550d3d250ab0bea4a56da9566abbc4f96"} Jul 24 12:17:43.761158 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:43.761117 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-ntnfg" podStartSLOduration=1.761100406 podStartE2EDuration="1.761100406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:17:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:17:43.760020091 +0000 UTC m=+56.811265084" watchObservedRunningTime="2026-07-24 12:17:43.761100406 +0000 UTC m=+56.812345398" Jul 24 12:17:44.068043 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:44.067950 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:44.103004 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:44.102572 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qsfrm\" (UID: \"5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db\") " pod="openshift-insights/insights-runtime-extractor-qsfrm" Jul 24 12:17:44.103004 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:44.102734 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qsfrm\" (UID: \"5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db\") " pod="openshift-insights/insights-runtime-extractor-qsfrm" Jul 24 12:17:44.103004 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:44.102952 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 12:17:44.103448 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:44.103433 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-kube-rbac-proxy-cm podName:5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db nodeName:}" failed. No retries permitted until 2026-07-24 12:17:48.103412496 +0000 UTC m=+61.154657467 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qsfrm" (UID: "5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db") : configmap "kube-rbac-proxy" not found Jul 24 12:17:44.103526 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:44.103454 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 12:17:44.103526 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:44.103519 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-insights-runtime-extractor-tls podName:5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db nodeName:}" failed. No retries permitted until 2026-07-24 12:17:48.103499491 +0000 UTC m=+61.154744476 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qsfrm" (UID: "5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db") : secret "insights-runtime-extractor-tls" not found Jul 24 12:17:44.708945 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:44.708906 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:45.646099 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:45.646049 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:45.747140 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:45.747102 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:46.301027 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:46.300996 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" limit=1024 Jul 24 12:17:48.037216 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:48.037185 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-b2q26\" (UID: \"6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-b2q26" Jul 24 12:17:48.037738 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:48.037234 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05ae7260-6786-4542-bf6d-4979f4d5bf1d-metrics-certs\") pod \"router-default-847c5d5c9-ljlw8\" (UID: \"05ae7260-6786-4542-bf6d-4979f4d5bf1d\") " pod="openshift-ingress/router-default-847c5d5c9-ljlw8" Jul 24 12:17:48.037738 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:48.037276 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05ae7260-6786-4542-bf6d-4979f4d5bf1d-service-ca-bundle\") pod \"router-default-847c5d5c9-ljlw8\" (UID: \"05ae7260-6786-4542-bf6d-4979f4d5bf1d\") " pod="openshift-ingress/router-default-847c5d5c9-ljlw8" Jul 24 12:17:48.037738 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:48.037368 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a130a4a-ed5a-4a1e-821a-e5e0c115a0de-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-prgmm\" (UID: \"4a130a4a-ed5a-4a1e-821a-e5e0c115a0de\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-prgmm" Jul 24 12:17:48.037738 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:48.037418 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 12:17:48.037738 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:48.037485 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05ae7260-6786-4542-bf6d-4979f4d5bf1d-metrics-certs podName:05ae7260-6786-4542-bf6d-4979f4d5bf1d nodeName:}" failed. No retries permitted until 2026-07-24 12:18:04.037464555 +0000 UTC m=+77.088709525 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05ae7260-6786-4542-bf6d-4979f4d5bf1d-metrics-certs") pod "router-default-847c5d5c9-ljlw8" (UID: "05ae7260-6786-4542-bf6d-4979f4d5bf1d") : secret "router-metrics-certs-default" not found Jul 24 12:17:48.037738 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:48.037500 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/05ae7260-6786-4542-bf6d-4979f4d5bf1d-service-ca-bundle podName:05ae7260-6786-4542-bf6d-4979f4d5bf1d nodeName:}" failed. No retries permitted until 2026-07-24 12:18:04.037494319 +0000 UTC m=+77.088739289 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/05ae7260-6786-4542-bf6d-4979f4d5bf1d-service-ca-bundle") pod "router-default-847c5d5c9-ljlw8" (UID: "05ae7260-6786-4542-bf6d-4979f4d5bf1d") : configmap references non-existent config key: service-ca.crt Jul 24 12:17:48.037738 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:48.037522 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 12:17:48.037738 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:48.037578 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a130a4a-ed5a-4a1e-821a-e5e0c115a0de-cluster-monitoring-operator-tls podName:4a130a4a-ed5a-4a1e-821a-e5e0c115a0de nodeName:}" failed. No retries permitted until 2026-07-24 12:18:04.037562875 +0000 UTC m=+77.088807862 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4a130a4a-ed5a-4a1e-821a-e5e0c115a0de-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-prgmm" (UID: "4a130a4a-ed5a-4a1e-821a-e5e0c115a0de") : secret "cluster-monitoring-operator-tls" not found Jul 24 12:17:48.039643 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:48.039621 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-b2q26\" (UID: \"6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-b2q26" Jul 24 12:17:48.138097 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:48.138034 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c385960c-6bf7-4b33-8ce0-f627cb711d9c-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-576dn\" (UID: \"c385960c-6bf7-4b33-8ce0-f627cb711d9c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-576dn" Jul 24 12:17:48.138268 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:48.138105 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qsfrm\" (UID: \"5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db\") " pod="openshift-insights/insights-runtime-extractor-qsfrm" Jul 24 12:17:48.138268 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:48.138177 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 24 12:17:48.138268 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:48.138192 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qsfrm\" (UID: \"5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db\") " pod="openshift-insights/insights-runtime-extractor-qsfrm" Jul 24 12:17:48.138268 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:48.138235 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c385960c-6bf7-4b33-8ce0-f627cb711d9c-networking-console-plugin-cert podName:c385960c-6bf7-4b33-8ce0-f627cb711d9c nodeName:}" failed. No retries permitted until 2026-07-24 12:18:04.138221141 +0000 UTC m=+77.189466111 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c385960c-6bf7-4b33-8ce0-f627cb711d9c-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-576dn" (UID: "c385960c-6bf7-4b33-8ce0-f627cb711d9c") : secret "networking-console-plugin-cert" not found Jul 24 12:17:48.138268 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:48.138259 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 12:17:48.138479 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:48.138259 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 12:17:48.138479 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:48.138307 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-kube-rbac-proxy-cm podName:5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db nodeName:}" failed. No retries permitted until 2026-07-24 12:17:56.138292192 +0000 UTC m=+69.189537162 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qsfrm" (UID: "5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db") : configmap "kube-rbac-proxy" not found Jul 24 12:17:48.138479 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:17:48.138327 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-insights-runtime-extractor-tls podName:5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db nodeName:}" failed. No retries permitted until 2026-07-24 12:17:56.138319775 +0000 UTC m=+69.189564744 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qsfrm" (UID: "5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db") : secret "insights-runtime-extractor-tls" not found Jul 24 12:17:48.143169 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:48.143147 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-c4jtt\"" Jul 24 12:17:48.151282 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:48.151253 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-b2q26" Jul 24 12:17:48.313584 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:48.313518 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-b2q26"] Jul 24 12:17:48.635793 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:48.635726 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ssvdc" Jul 24 12:17:48.759652 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:48.759617 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-b2q26" event={"ID":"6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4","Type":"ContainerStarted","Data":"ae02e0ef65f78a3ca51309b2bed9eac972b78ad70d560f0dce4f119befdf8bbb"} Jul 24 12:17:50.769158 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:50.769050 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-b2q26" event={"ID":"6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4","Type":"ContainerStarted","Data":"f6d7afefaf625de1bf9fb0e778569ec09082f56a2b5e3f7bae8c2fc4c904faf3"} Jul 24 12:17:50.769509 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:50.769173 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-b2q26" event={"ID":"6fbc7f8d-a0c8-4965-ae1f-9c0f07d894e4","Type":"ContainerStarted","Data":"9a780c8a433114baf92a92acd91a03cf13e4cb07500ef1635dfcb20dab882694"} Jul 24 12:17:50.785974 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:50.785930 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-b2q26" podStartSLOduration=16.655919751 podStartE2EDuration="18.785914661s" totalImagesPullingTime="2.12999491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:17:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:17:50.784838483 +0000 UTC m=+63.836083476" watchObservedRunningTime="2026-07-24 12:17:50.785914661 +0000 UTC m=+63.837159712" Jul 24 12:17:53.186963 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:53.186924 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cbn4\" (UniqueName: \"kubernetes.io/projected/7036166d-005a-4b55-bb2b-9445962a0a63-kube-api-access-4cbn4\") pod \"network-check-target-lcjn9\" (UID: \"7036166d-005a-4b55-bb2b-9445962a0a63\") " pod="openshift-network-diagnostics/network-check-target-lcjn9" Jul 24 12:17:53.189342 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:53.189320 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cbn4\" (UniqueName: \"kubernetes.io/projected/7036166d-005a-4b55-bb2b-9445962a0a63-kube-api-access-4cbn4\") pod \"network-check-target-lcjn9\" (UID: \"7036166d-005a-4b55-bb2b-9445962a0a63\") " pod="openshift-network-diagnostics/network-check-target-lcjn9" Jul 24 12:17:53.287840 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:53.287811 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5eec886f-16aa-409b-97c6-743f0ff1dacf-original-pull-secret\") pod \"global-pull-secret-syncer-rrwlt\" (UID: \"5eec886f-16aa-409b-97c6-743f0ff1dacf\") " pod="kube-system/global-pull-secret-syncer-rrwlt" Jul 24 12:17:53.287997 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:53.287927 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d766121-a79e-4f1e-ba3b-ed964d6f05c9-metrics-certs\") pod \"network-metrics-daemon-v5gc6\" (UID: \"1d766121-a79e-4f1e-ba3b-ed964d6f05c9\") " pod="openshift-multus/network-metrics-daemon-v5gc6" Jul 24 12:17:53.290634 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:53.290613 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 12:17:53.291555 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:53.291541 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 12:17:53.300745 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:53.300727 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d766121-a79e-4f1e-ba3b-ed964d6f05c9-metrics-certs\") pod \"network-metrics-daemon-v5gc6\" (UID: \"1d766121-a79e-4f1e-ba3b-ed964d6f05c9\") " pod="openshift-multus/network-metrics-daemon-v5gc6" Jul 24 12:17:53.300837 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:53.300794 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5eec886f-16aa-409b-97c6-743f0ff1dacf-original-pull-secret\") pod \"global-pull-secret-syncer-rrwlt\" (UID: \"5eec886f-16aa-409b-97c6-743f0ff1dacf\") " pod="kube-system/global-pull-secret-syncer-rrwlt" Jul 24 12:17:53.331028 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:53.331005 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wdbbv\"" Jul 24 12:17:53.337546 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:53.337523 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x8csv\"" Jul 24 12:17:53.338569 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:53.338552 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v5gc6" Jul 24 12:17:53.341378 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:53.341364 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrwlt" Jul 24 12:17:53.346026 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:53.346007 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcjn9" Jul 24 12:17:53.493782 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:53.493746 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v5gc6"] Jul 24 12:17:53.498102 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:17:53.498043 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d766121_a79e_4f1e_ba3b_ed964d6f05c9.slice/crio-297f4b07875685407d46c30839406454e6c27fdb65bb273f30b677b8e92547fa WatchSource:0}: Error finding container 297f4b07875685407d46c30839406454e6c27fdb65bb273f30b677b8e92547fa: Status 404 returned error can't find the container with id 297f4b07875685407d46c30839406454e6c27fdb65bb273f30b677b8e92547fa Jul 24 12:17:53.514534 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:53.514509 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rrwlt"] Jul 24 12:17:53.517282 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:17:53.517259 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eec886f_16aa_409b_97c6_743f0ff1dacf.slice/crio-7af3103e1b05c96c2c08b6ac9840ad511354a989cbcc58033be1c4fbd70ca3d9 WatchSource:0}: Error finding container 7af3103e1b05c96c2c08b6ac9840ad511354a989cbcc58033be1c4fbd70ca3d9: Status 404 returned error can't find the container with id 7af3103e1b05c96c2c08b6ac9840ad511354a989cbcc58033be1c4fbd70ca3d9 Jul 24 12:17:53.714573 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:53.714506 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lcjn9"] Jul 24 12:17:53.718537 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:17:53.718513 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7036166d_005a_4b55_bb2b_9445962a0a63.slice/crio-0c268b9c5a3787c29f883469f671e3d91d8343a9362ba31049a216ae7abc7c9f WatchSource:0}: Error finding container 0c268b9c5a3787c29f883469f671e3d91d8343a9362ba31049a216ae7abc7c9f: Status 404 returned error can't find the container with id 0c268b9c5a3787c29f883469f671e3d91d8343a9362ba31049a216ae7abc7c9f Jul 24 12:17:53.779208 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:53.779178 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lcjn9" event={"ID":"7036166d-005a-4b55-bb2b-9445962a0a63","Type":"ContainerStarted","Data":"0c268b9c5a3787c29f883469f671e3d91d8343a9362ba31049a216ae7abc7c9f"} Jul 24 12:17:53.780403 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:53.780378 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v5gc6" event={"ID":"1d766121-a79e-4f1e-ba3b-ed964d6f05c9","Type":"ContainerStarted","Data":"297f4b07875685407d46c30839406454e6c27fdb65bb273f30b677b8e92547fa"} Jul 24 12:17:53.781448 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:53.781428 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rrwlt" event={"ID":"5eec886f-16aa-409b-97c6-743f0ff1dacf","Type":"ContainerStarted","Data":"7af3103e1b05c96c2c08b6ac9840ad511354a989cbcc58033be1c4fbd70ca3d9"} Jul 24 12:17:53.795095 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:53.795074 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f6e6a89-d316-425a-9138-c0318824371d-registry-tls\") pod \"image-registry-59c89c9f84-ldxwc\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" Jul 24 12:17:53.795209 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:53.795196 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8daa84c-73b5-4346-8f92-81dd451dfaa5-metrics-tls\") pod \"dns-default-8q6d8\" (UID: \"b8daa84c-73b5-4346-8f92-81dd451dfaa5\") " pod="openshift-dns/dns-default-8q6d8" Jul 24 12:17:53.797230 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:53.797212 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f6e6a89-d316-425a-9138-c0318824371d-registry-tls\") pod \"image-registry-59c89c9f84-ldxwc\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" Jul 24 12:17:53.797328 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:53.797286 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8daa84c-73b5-4346-8f92-81dd451dfaa5-metrics-tls\") pod \"dns-default-8q6d8\" (UID: \"b8daa84c-73b5-4346-8f92-81dd451dfaa5\") " pod="openshift-dns/dns-default-8q6d8" Jul 24 12:17:53.929208 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:53.929179 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wjjb4\"" Jul 24 12:17:53.937418 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:53.937397 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" Jul 24 12:17:53.948232 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:53.948213 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-54nwn\"" Jul 24 12:17:53.956415 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:53.956394 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8q6d8" Jul 24 12:17:54.077245 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:54.077116 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59c89c9f84-ldxwc"] Jul 24 12:17:54.079638 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:17:54.079608 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f6e6a89_d316_425a_9138_c0318824371d.slice/crio-5885292bed553a44fefeef6994976dda035868d776ef5b9a0d311ce39953523e WatchSource:0}: Error finding container 5885292bed553a44fefeef6994976dda035868d776ef5b9a0d311ce39953523e: Status 404 returned error can't find the container with id 5885292bed553a44fefeef6994976dda035868d776ef5b9a0d311ce39953523e Jul 24 12:17:54.090789 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:54.090768 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8q6d8"] Jul 24 12:17:54.093376 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:17:54.093357 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8daa84c_73b5_4346_8f92_81dd451dfaa5.slice/crio-d8544cc8f7099186b5efdb8b46d92d83ffb4e968f91b7868401ad08468d10e99 WatchSource:0}: Error finding container d8544cc8f7099186b5efdb8b46d92d83ffb4e968f91b7868401ad08468d10e99: Status 404 returned error can't find the container with id d8544cc8f7099186b5efdb8b46d92d83ffb4e968f91b7868401ad08468d10e99 Jul 24 12:17:54.789037 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:54.788899 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" event={"ID":"8f6e6a89-d316-425a-9138-c0318824371d","Type":"ContainerStarted","Data":"83e6c540cbe005391831a6afe0ba2dcf8e9531754e03c342d933a8ccb01c7417"} Jul 24 12:17:54.789037 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:54.788956 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" event={"ID":"8f6e6a89-d316-425a-9138-c0318824371d","Type":"ContainerStarted","Data":"5885292bed553a44fefeef6994976dda035868d776ef5b9a0d311ce39953523e"} Jul 24 12:17:54.789037 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:54.788984 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" Jul 24 12:17:54.790848 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:54.790792 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8q6d8" event={"ID":"b8daa84c-73b5-4346-8f92-81dd451dfaa5","Type":"ContainerStarted","Data":"d8544cc8f7099186b5efdb8b46d92d83ffb4e968f91b7868401ad08468d10e99"} Jul 24 12:17:54.792521 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:54.792492 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lcjn9" event={"ID":"7036166d-005a-4b55-bb2b-9445962a0a63","Type":"ContainerStarted","Data":"cccd6463b1b77a785c80dc10a186bd819d1659b2d35662a1f7e3ed39b16f1595"} Jul 24 12:17:54.792652 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:54.792615 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lcjn9" Jul 24 12:17:54.812519 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:54.812463 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" podStartSLOduration=67.812443593 podStartE2EDuration="1m7.812443593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:16:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:17:54.812188172 +0000 UTC m=+67.863433195" watchObservedRunningTime="2026-07-24 12:17:54.812443593 +0000 UTC m=+67.863688583" Jul 24 12:17:54.828451 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:54.828393 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lcjn9" podStartSLOduration=67.828373358 podStartE2EDuration="1m7.828373358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:16:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:17:54.827350034 +0000 UTC m=+67.878595049" watchObservedRunningTime="2026-07-24 12:17:54.828373358 +0000 UTC m=+67.879618346" Jul 24 12:17:56.217132 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:56.217095 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qsfrm\" (UID: \"5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db\") " pod="openshift-insights/insights-runtime-extractor-qsfrm" Jul 24 12:17:56.217497 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:56.217169 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qsfrm\" (UID: \"5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db\") " pod="openshift-insights/insights-runtime-extractor-qsfrm" Jul 24 12:17:56.217671 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:56.217651 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qsfrm\" (UID: \"5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db\") " pod="openshift-insights/insights-runtime-extractor-qsfrm" Jul 24 12:17:56.219282 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:56.219263 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qsfrm\" (UID: \"5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db\") " pod="openshift-insights/insights-runtime-extractor-qsfrm" Jul 24 12:17:56.326072 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:56.326038 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9p5qg\"" Jul 24 12:17:56.333474 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:56.333453 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qsfrm" Jul 24 12:17:56.417075 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:56.417038 2555 scope.go:117] "RemoveContainer" containerID="4dfc64ef75027600eb6bd51188d6b261679e65554e2591fbac86af99bda0c920" Jul 24 12:17:56.728664 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:56.728632 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qsfrm"] Jul 24 12:17:56.733588 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:17:56.733557 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dfaeea8_5ae6_4ea4_b735_dfd9bd4747db.slice/crio-f4552367583e2571de69c365cd0302f19893f70dc52b722964012b124da8d938 WatchSource:0}: Error finding container f4552367583e2571de69c365cd0302f19893f70dc52b722964012b124da8d938: Status 404 returned error can't find the container with id f4552367583e2571de69c365cd0302f19893f70dc52b722964012b124da8d938 Jul 24 12:17:56.808208 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:56.808126 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8q6d8" event={"ID":"b8daa84c-73b5-4346-8f92-81dd451dfaa5","Type":"ContainerStarted","Data":"8c4b78a0c494f47751da5015902c3d5c21daf5982988b0506c0edfa006e6894f"} Jul 24 12:17:56.811417 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:56.811288 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-g5v4m_7e1b58e8-bdad-423e-a12b-a8b0fc1c900e/console-operator/1.log" Jul 24 12:17:56.811526 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:56.811408 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-g5v4m" event={"ID":"7e1b58e8-bdad-423e-a12b-a8b0fc1c900e","Type":"ContainerStarted","Data":"083ef592b74c305f768a92922d0dd4ddde351439748b54c310c03a8f82604a6f"} Jul 24 12:17:56.811910 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:56.811756 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-g5v4m" Jul 24 12:17:56.815140 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:56.815097 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v5gc6" event={"ID":"1d766121-a79e-4f1e-ba3b-ed964d6f05c9","Type":"ContainerStarted","Data":"cea6acf14cde93c485a043b882021a2d4027e017568e7ca177fecddb8b8906df"} Jul 24 12:17:56.817015 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:56.816635 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qsfrm" event={"ID":"5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db","Type":"ContainerStarted","Data":"f4552367583e2571de69c365cd0302f19893f70dc52b722964012b124da8d938"} Jul 24 12:17:57.788125 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:57.788092 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-g5v4m" Jul 24 12:17:57.818557 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:57.818493 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-g5v4m" podStartSLOduration=19.681338992 podStartE2EDuration="25.818471951s" totalImagesPullingTime="6.137132959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:17:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:17:56.83407288 +0000 UTC m=+69.885317896" watchObservedRunningTime="2026-07-24 12:17:57.818471951 +0000 UTC m=+70.869716944" Jul 24 12:17:57.826635 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:57.826598 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8q6d8" event={"ID":"b8daa84c-73b5-4346-8f92-81dd451dfaa5","Type":"ContainerStarted","Data":"6524745df11fbfdf6905f6655badc65a2e7fc86e24adfa77dd928cb3bade231d"} Jul 24 12:17:57.826861 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:57.826672 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8q6d8" Jul 24 12:17:57.832410 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:57.832382 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v5gc6" event={"ID":"1d766121-a79e-4f1e-ba3b-ed964d6f05c9","Type":"ContainerStarted","Data":"6300180acf2efa4300ae7b02f898f7c7dfb3436924215d0e1fa23243d7bdbddc"} Jul 24 12:17:57.848092 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:57.848011 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8q6d8" podStartSLOduration=34.373220707 podStartE2EDuration="36.847988764s" totalImagesPullingTime="2.474768057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:17:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:17:57.847170732 +0000 UTC m=+70.898415746" watchObservedRunningTime="2026-07-24 12:17:57.847988764 +0000 UTC m=+70.899233757" Jul 24 12:17:57.866661 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:57.866610 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-v5gc6" podStartSLOduration=67.806813487 podStartE2EDuration="1m10.866594925s" totalImagesPullingTime="3.059781438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:16:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:17:57.865794034 +0000 UTC m=+70.917039028" watchObservedRunningTime="2026-07-24 12:17:57.866594925 +0000 UTC m=+70.917839916" Jul 24 12:17:58.842460 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:17:58.842373 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rrwlt" event={"ID":"5eec886f-16aa-409b-97c6-743f0ff1dacf","Type":"ContainerStarted","Data":"5b3f5c4e09edcaac8cbeeac6ab2ce523519a9e9e76000f8a6970e607e9a90aaa"} Jul 24 12:18:03.569720 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.569664 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rrwlt" podStartSLOduration=71.632700165 podStartE2EDuration="1m16.569643011s" totalImagesPullingTime="4.936942846s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:16:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:17:58.869875486 +0000 UTC m=+71.921120503" watchObservedRunningTime="2026-07-24 12:18:03.569643011 +0000 UTC m=+76.620887999" Jul 24 12:18:03.571052 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.571032 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55457fd4c8-kkldt"] Jul 24 12:18:03.574291 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.574267 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55457fd4c8-kkldt" Jul 24 12:18:03.580674 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.580557 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f898cb-7jgfw"] Jul 24 12:18:03.581999 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.581973 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 24 12:18:03.582231 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.582216 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-9s5rg\"" Jul 24 12:18:03.583338 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.583320 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 24 12:18:03.583425 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.583354 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 24 12:18:03.583773 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.583760 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f898cb-7jgfw" Jul 24 12:18:03.584774 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.584760 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 24 12:18:03.587763 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.587744 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 24 12:18:03.587932 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.587915 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bb9bfb65-748zg"] Jul 24 12:18:03.590921 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.590907 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bb9bfb65-748zg" Jul 24 12:18:03.594770 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.594750 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 24 12:18:03.594896 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.594758 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 24 12:18:03.594958 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.594893 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 24 12:18:03.595086 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.595054 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 24 12:18:03.608920 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.608900 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f898cb-7jgfw"] Jul 24 12:18:03.654376 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.654348 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bb9bfb65-748zg"] Jul 24 12:18:03.664326 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.664299 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55457fd4c8-kkldt"] Jul 24 12:18:03.670335 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.670313 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-kg2nr"] Jul 24 12:18:03.673453 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.673438 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-kg2nr" Jul 24 12:18:03.679441 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.679421 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 24 12:18:03.679815 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.679800 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 24 12:18:03.680213 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.680198 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-7ddqp\"" Jul 24 12:18:03.684505 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.684475 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/153d8200-536a-4d31-be07-76117c071abe-hub\") pod \"cluster-proxy-proxy-agent-75bb9bfb65-748zg\" (UID: \"153d8200-536a-4d31-be07-76117c071abe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bb9bfb65-748zg" Jul 24 12:18:03.684505 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.684511 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/153d8200-536a-4d31-be07-76117c071abe-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-75bb9bfb65-748zg\" (UID: \"153d8200-536a-4d31-be07-76117c071abe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bb9bfb65-748zg" Jul 24 12:18:03.684631 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.684535 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/cc91cd57-09bc-4bc3-bd39-df824e4f790f-klusterlet-config\") pod \"klusterlet-addon-workmgr-578f898cb-7jgfw\" (UID: \"cc91cd57-09bc-4bc3-bd39-df824e4f790f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f898cb-7jgfw" Jul 24 12:18:03.684631 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.684604 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/153d8200-536a-4d31-be07-76117c071abe-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-75bb9bfb65-748zg\" (UID: \"153d8200-536a-4d31-be07-76117c071abe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bb9bfb65-748zg" Jul 24 12:18:03.684700 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.684638 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6tdx\" (UniqueName: \"kubernetes.io/projected/8a4b1562-4b47-471d-8f1b-f5c2e2d6ea5c-kube-api-access-p6tdx\") pod \"managed-serviceaccount-addon-agent-55457fd4c8-kkldt\" (UID: \"8a4b1562-4b47-471d-8f1b-f5c2e2d6ea5c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55457fd4c8-kkldt" Jul 24 12:18:03.684700 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.684687 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8a4b1562-4b47-471d-8f1b-f5c2e2d6ea5c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-55457fd4c8-kkldt\" (UID: \"8a4b1562-4b47-471d-8f1b-f5c2e2d6ea5c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55457fd4c8-kkldt" Jul 24 12:18:03.684774 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.684714 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5qfj\" (UniqueName: \"kubernetes.io/projected/cc91cd57-09bc-4bc3-bd39-df824e4f790f-kube-api-access-k5qfj\") pod \"klusterlet-addon-workmgr-578f898cb-7jgfw\" (UID: \"cc91cd57-09bc-4bc3-bd39-df824e4f790f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f898cb-7jgfw" Jul 24 12:18:03.684774 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.684758 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp78g\" (UniqueName: \"kubernetes.io/projected/153d8200-536a-4d31-be07-76117c071abe-kube-api-access-qp78g\") pod \"cluster-proxy-proxy-agent-75bb9bfb65-748zg\" (UID: \"153d8200-536a-4d31-be07-76117c071abe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bb9bfb65-748zg" Jul 24 12:18:03.684844 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.684776 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc91cd57-09bc-4bc3-bd39-df824e4f790f-tmp\") pod \"klusterlet-addon-workmgr-578f898cb-7jgfw\" (UID: \"cc91cd57-09bc-4bc3-bd39-df824e4f790f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f898cb-7jgfw" Jul 24 12:18:03.684844 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.684796 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/153d8200-536a-4d31-be07-76117c071abe-additional-service-ca\") pod \"cluster-proxy-proxy-agent-75bb9bfb65-748zg\" (UID: \"153d8200-536a-4d31-be07-76117c071abe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bb9bfb65-748zg" Jul 24 12:18:03.684844 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.684816 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/153d8200-536a-4d31-be07-76117c071abe-ca\") pod \"cluster-proxy-proxy-agent-75bb9bfb65-748zg\" (UID: \"153d8200-536a-4d31-be07-76117c071abe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bb9bfb65-748zg" Jul 24 12:18:03.714773 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.714746 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-kg2nr"] Jul 24 12:18:03.785939 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.785912 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6hl7\" (UniqueName: \"kubernetes.io/projected/ea5a6ec0-554e-47e8-9e7b-ebaeec1c368d-kube-api-access-w6hl7\") pod \"downloads-7c97dc4555-kg2nr\" (UID: \"ea5a6ec0-554e-47e8-9e7b-ebaeec1c368d\") " pod="openshift-console/downloads-7c97dc4555-kg2nr" Jul 24 12:18:03.786148 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.785944 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/153d8200-536a-4d31-be07-76117c071abe-hub\") pod \"cluster-proxy-proxy-agent-75bb9bfb65-748zg\" (UID: \"153d8200-536a-4d31-be07-76117c071abe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bb9bfb65-748zg" Jul 24 12:18:03.786148 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.785964 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/153d8200-536a-4d31-be07-76117c071abe-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-75bb9bfb65-748zg\" (UID: \"153d8200-536a-4d31-be07-76117c071abe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bb9bfb65-748zg" Jul 24 12:18:03.786148 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.785987 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/cc91cd57-09bc-4bc3-bd39-df824e4f790f-klusterlet-config\") pod \"klusterlet-addon-workmgr-578f898cb-7jgfw\" (UID: \"cc91cd57-09bc-4bc3-bd39-df824e4f790f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f898cb-7jgfw" Jul 24 12:18:03.786148 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.786080 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/153d8200-536a-4d31-be07-76117c071abe-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-75bb9bfb65-748zg\" (UID: \"153d8200-536a-4d31-be07-76117c071abe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bb9bfb65-748zg" Jul 24 12:18:03.786553 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.786524 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6tdx\" (UniqueName: \"kubernetes.io/projected/8a4b1562-4b47-471d-8f1b-f5c2e2d6ea5c-kube-api-access-p6tdx\") pod \"managed-serviceaccount-addon-agent-55457fd4c8-kkldt\" (UID: \"8a4b1562-4b47-471d-8f1b-f5c2e2d6ea5c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55457fd4c8-kkldt" Jul 24 12:18:03.786692 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.786646 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8a4b1562-4b47-471d-8f1b-f5c2e2d6ea5c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-55457fd4c8-kkldt\" (UID: \"8a4b1562-4b47-471d-8f1b-f5c2e2d6ea5c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55457fd4c8-kkldt" Jul 24 12:18:03.786692 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.786681 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5qfj\" (UniqueName: \"kubernetes.io/projected/cc91cd57-09bc-4bc3-bd39-df824e4f790f-kube-api-access-k5qfj\") pod \"klusterlet-addon-workmgr-578f898cb-7jgfw\" (UID: \"cc91cd57-09bc-4bc3-bd39-df824e4f790f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f898cb-7jgfw" Jul 24 12:18:03.786821 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.786745 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp78g\" (UniqueName: \"kubernetes.io/projected/153d8200-536a-4d31-be07-76117c071abe-kube-api-access-qp78g\") pod \"cluster-proxy-proxy-agent-75bb9bfb65-748zg\" (UID: \"153d8200-536a-4d31-be07-76117c071abe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bb9bfb65-748zg" Jul 24 12:18:03.786821 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.786788 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc91cd57-09bc-4bc3-bd39-df824e4f790f-tmp\") pod \"klusterlet-addon-workmgr-578f898cb-7jgfw\" (UID: \"cc91cd57-09bc-4bc3-bd39-df824e4f790f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f898cb-7jgfw" Jul 24 12:18:03.786931 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.786841 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/153d8200-536a-4d31-be07-76117c071abe-additional-service-ca\") pod \"cluster-proxy-proxy-agent-75bb9bfb65-748zg\" (UID: \"153d8200-536a-4d31-be07-76117c071abe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bb9bfb65-748zg" Jul 24 12:18:03.788004 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.787636 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/153d8200-536a-4d31-be07-76117c071abe-additional-service-ca\") pod \"cluster-proxy-proxy-agent-75bb9bfb65-748zg\" (UID: \"153d8200-536a-4d31-be07-76117c071abe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bb9bfb65-748zg" Jul 24 12:18:03.788004 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.787924 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/153d8200-536a-4d31-be07-76117c071abe-ca\") pod \"cluster-proxy-proxy-agent-75bb9bfb65-748zg\" (UID: \"153d8200-536a-4d31-be07-76117c071abe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bb9bfb65-748zg" Jul 24 12:18:03.789619 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.788971 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc91cd57-09bc-4bc3-bd39-df824e4f790f-tmp\") pod \"klusterlet-addon-workmgr-578f898cb-7jgfw\" (UID: \"cc91cd57-09bc-4bc3-bd39-df824e4f790f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f898cb-7jgfw" Jul 24 12:18:03.789619 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.789469 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/153d8200-536a-4d31-be07-76117c071abe-hub\") pod \"cluster-proxy-proxy-agent-75bb9bfb65-748zg\" (UID: \"153d8200-536a-4d31-be07-76117c071abe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bb9bfb65-748zg" Jul 24 12:18:03.791296 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.790044 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/153d8200-536a-4d31-be07-76117c071abe-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-75bb9bfb65-748zg\" (UID: \"153d8200-536a-4d31-be07-76117c071abe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bb9bfb65-748zg" Jul 24 12:18:03.791296 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.790816 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/cc91cd57-09bc-4bc3-bd39-df824e4f790f-klusterlet-config\") pod \"klusterlet-addon-workmgr-578f898cb-7jgfw\" (UID: \"cc91cd57-09bc-4bc3-bd39-df824e4f790f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f898cb-7jgfw" Jul 24 12:18:03.791296 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.790866 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/153d8200-536a-4d31-be07-76117c071abe-ca\") pod \"cluster-proxy-proxy-agent-75bb9bfb65-748zg\" (UID: \"153d8200-536a-4d31-be07-76117c071abe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bb9bfb65-748zg" Jul 24 12:18:03.793725 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.792849 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/153d8200-536a-4d31-be07-76117c071abe-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-75bb9bfb65-748zg\" (UID: \"153d8200-536a-4d31-be07-76117c071abe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bb9bfb65-748zg" Jul 24 12:18:03.794691 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.794670 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8a4b1562-4b47-471d-8f1b-f5c2e2d6ea5c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-55457fd4c8-kkldt\" (UID: \"8a4b1562-4b47-471d-8f1b-f5c2e2d6ea5c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55457fd4c8-kkldt" Jul 24 12:18:03.806998 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.806975 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6tdx\" (UniqueName: \"kubernetes.io/projected/8a4b1562-4b47-471d-8f1b-f5c2e2d6ea5c-kube-api-access-p6tdx\") pod \"managed-serviceaccount-addon-agent-55457fd4c8-kkldt\" (UID: \"8a4b1562-4b47-471d-8f1b-f5c2e2d6ea5c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55457fd4c8-kkldt" Jul 24 12:18:03.807840 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.807819 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp78g\" (UniqueName: \"kubernetes.io/projected/153d8200-536a-4d31-be07-76117c071abe-kube-api-access-qp78g\") pod \"cluster-proxy-proxy-agent-75bb9bfb65-748zg\" (UID: \"153d8200-536a-4d31-be07-76117c071abe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bb9bfb65-748zg" Jul 24 12:18:03.819382 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.819360 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5qfj\" (UniqueName: \"kubernetes.io/projected/cc91cd57-09bc-4bc3-bd39-df824e4f790f-kube-api-access-k5qfj\") pod \"klusterlet-addon-workmgr-578f898cb-7jgfw\" (UID: \"cc91cd57-09bc-4bc3-bd39-df824e4f790f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f898cb-7jgfw" Jul 24 12:18:03.866789 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.866713 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qsfrm" event={"ID":"5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db","Type":"ContainerStarted","Data":"d62bb863fdef71bc3ac82e6cce4e42f0a15cf460ea4ffb752dcbacc7ec47c011"} Jul 24 12:18:03.888892 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.888865 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6hl7\" (UniqueName: \"kubernetes.io/projected/ea5a6ec0-554e-47e8-9e7b-ebaeec1c368d-kube-api-access-w6hl7\") pod \"downloads-7c97dc4555-kg2nr\" (UID: \"ea5a6ec0-554e-47e8-9e7b-ebaeec1c368d\") " pod="openshift-console/downloads-7c97dc4555-kg2nr" Jul 24 12:18:03.898749 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.898721 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55457fd4c8-kkldt" Jul 24 12:18:03.903489 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.903469 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6hl7\" (UniqueName: \"kubernetes.io/projected/ea5a6ec0-554e-47e8-9e7b-ebaeec1c368d-kube-api-access-w6hl7\") pod \"downloads-7c97dc4555-kg2nr\" (UID: \"ea5a6ec0-554e-47e8-9e7b-ebaeec1c368d\") " pod="openshift-console/downloads-7c97dc4555-kg2nr" Jul 24 12:18:03.906691 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.906671 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f898cb-7jgfw" Jul 24 12:18:03.912641 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.912621 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bb9bfb65-748zg" Jul 24 12:18:03.996701 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:03.996635 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-kg2nr" Jul 24 12:18:04.060565 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:04.060453 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55457fd4c8-kkldt"] Jul 24 12:18:04.062936 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:18:04.062905 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a4b1562_4b47_471d_8f1b_f5c2e2d6ea5c.slice/crio-bdad8037c7e575a2368d2256bee9fe911baae081dfe2addb993e759f71bb0910 WatchSource:0}: Error finding container bdad8037c7e575a2368d2256bee9fe911baae081dfe2addb993e759f71bb0910: Status 404 returned error can't find the container with id bdad8037c7e575a2368d2256bee9fe911baae081dfe2addb993e759f71bb0910 Jul 24 12:18:04.090539 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:04.090510 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05ae7260-6786-4542-bf6d-4979f4d5bf1d-metrics-certs\") pod \"router-default-847c5d5c9-ljlw8\" (UID: \"05ae7260-6786-4542-bf6d-4979f4d5bf1d\") " pod="openshift-ingress/router-default-847c5d5c9-ljlw8" Jul 24 12:18:04.090667 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:04.090553 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05ae7260-6786-4542-bf6d-4979f4d5bf1d-service-ca-bundle\") pod \"router-default-847c5d5c9-ljlw8\" (UID: \"05ae7260-6786-4542-bf6d-4979f4d5bf1d\") " pod="openshift-ingress/router-default-847c5d5c9-ljlw8" Jul 24 12:18:04.090667 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:04.090635 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a130a4a-ed5a-4a1e-821a-e5e0c115a0de-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-prgmm\" (UID: \"4a130a4a-ed5a-4a1e-821a-e5e0c115a0de\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-prgmm" Jul 24 12:18:04.091404 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:04.091377 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05ae7260-6786-4542-bf6d-4979f4d5bf1d-service-ca-bundle\") pod \"router-default-847c5d5c9-ljlw8\" (UID: \"05ae7260-6786-4542-bf6d-4979f4d5bf1d\") " pod="openshift-ingress/router-default-847c5d5c9-ljlw8" Jul 24 12:18:04.092930 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:04.092911 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05ae7260-6786-4542-bf6d-4979f4d5bf1d-metrics-certs\") pod \"router-default-847c5d5c9-ljlw8\" (UID: \"05ae7260-6786-4542-bf6d-4979f4d5bf1d\") " pod="openshift-ingress/router-default-847c5d5c9-ljlw8" Jul 24 12:18:04.093025 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:04.092909 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a130a4a-ed5a-4a1e-821a-e5e0c115a0de-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-prgmm\" (UID: \"4a130a4a-ed5a-4a1e-821a-e5e0c115a0de\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-prgmm" Jul 24 12:18:04.176100 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:04.176073 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-kg2nr"] Jul 24 12:18:04.178344 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:18:04.178313 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea5a6ec0_554e_47e8_9e7b_ebaeec1c368d.slice/crio-57fc18c203d7c7638efe14e24694cff4812d06d14a43d2a75d1a2161579f6b64 WatchSource:0}: Error finding container 57fc18c203d7c7638efe14e24694cff4812d06d14a43d2a75d1a2161579f6b64: Status 404 returned error can't find the container with id 57fc18c203d7c7638efe14e24694cff4812d06d14a43d2a75d1a2161579f6b64 Jul 24 12:18:04.191547 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:04.191516 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c385960c-6bf7-4b33-8ce0-f627cb711d9c-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-576dn\" (UID: \"c385960c-6bf7-4b33-8ce0-f627cb711d9c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-576dn" Jul 24 12:18:04.194429 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:04.194404 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c385960c-6bf7-4b33-8ce0-f627cb711d9c-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-576dn\" (UID: \"c385960c-6bf7-4b33-8ce0-f627cb711d9c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-576dn" Jul 24 12:18:04.305402 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:04.305312 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bb9bfb65-748zg"] Jul 24 12:18:04.308623 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:04.306717 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f898cb-7jgfw"] Jul 24 12:18:04.322931 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:04.322910 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9crh2\"" Jul 24 12:18:04.330513 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:04.330490 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-prgmm" Jul 24 12:18:04.365243 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:04.365214 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-pwhnh\"" Jul 24 12:18:04.372634 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:04.372605 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-847c5d5c9-ljlw8" Jul 24 12:18:04.403100 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:04.402825 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-ws8pb\"" Jul 24 12:18:04.409759 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:04.409720 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-576dn" Jul 24 12:18:04.533230 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:04.532928 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-prgmm"] Jul 24 12:18:04.537101 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:18:04.537014 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a130a4a_ed5a_4a1e_821a_e5e0c115a0de.slice/crio-5a12fa2df5f9325e3a3ce56378abcafc8158d87ceeb629467ba80e40b1958193 WatchSource:0}: Error finding container 5a12fa2df5f9325e3a3ce56378abcafc8158d87ceeb629467ba80e40b1958193: Status 404 returned error can't find the container with id 5a12fa2df5f9325e3a3ce56378abcafc8158d87ceeb629467ba80e40b1958193 Jul 24 12:18:04.583053 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:04.583021 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-847c5d5c9-ljlw8"] Jul 24 12:18:04.585139 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:18:04.585107 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05ae7260_6786_4542_bf6d_4979f4d5bf1d.slice/crio-67ea45d6df8fdf5c19e280d3b6989dcd9bc58d6094cf704ff4e346c1beea8efd WatchSource:0}: Error finding container 67ea45d6df8fdf5c19e280d3b6989dcd9bc58d6094cf704ff4e346c1beea8efd: Status 404 returned error can't find the container with id 67ea45d6df8fdf5c19e280d3b6989dcd9bc58d6094cf704ff4e346c1beea8efd Jul 24 12:18:04.604832 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:04.604753 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-576dn"] Jul 24 12:18:04.608036 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:18:04.607987 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc385960c_6bf7_4b33_8ce0_f627cb711d9c.slice/crio-7ba7f12a72fb47a227ee5b9e130d4dffa7fb12e45497ace1f7270c314859325c WatchSource:0}: Error finding container 7ba7f12a72fb47a227ee5b9e130d4dffa7fb12e45497ace1f7270c314859325c: Status 404 returned error can't find the container with id 7ba7f12a72fb47a227ee5b9e130d4dffa7fb12e45497ace1f7270c314859325c Jul 24 12:18:04.878876 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:04.878752 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bb9bfb65-748zg" event={"ID":"153d8200-536a-4d31-be07-76117c071abe","Type":"ContainerStarted","Data":"1dc6dfb7908c6754cda90789423608e61da5e72c39dc7f9937356fc3375fdd10"} Jul 24 12:18:04.882766 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:04.882732 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-576dn" event={"ID":"c385960c-6bf7-4b33-8ce0-f627cb711d9c","Type":"ContainerStarted","Data":"7ba7f12a72fb47a227ee5b9e130d4dffa7fb12e45497ace1f7270c314859325c"} Jul 24 12:18:04.885967 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:04.885864 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-kg2nr" event={"ID":"ea5a6ec0-554e-47e8-9e7b-ebaeec1c368d","Type":"ContainerStarted","Data":"57fc18c203d7c7638efe14e24694cff4812d06d14a43d2a75d1a2161579f6b64"} Jul 24 12:18:04.889923 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:04.889054 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-847c5d5c9-ljlw8" event={"ID":"05ae7260-6786-4542-bf6d-4979f4d5bf1d","Type":"ContainerStarted","Data":"564070ba30ba1482c30af2245c256999d74dff24e04f8499f47dfa1746e300f8"} Jul 24 12:18:04.889923 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:04.889116 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-847c5d5c9-ljlw8" event={"ID":"05ae7260-6786-4542-bf6d-4979f4d5bf1d","Type":"ContainerStarted","Data":"67ea45d6df8fdf5c19e280d3b6989dcd9bc58d6094cf704ff4e346c1beea8efd"} Jul 24 12:18:04.892107 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:04.892046 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f898cb-7jgfw" event={"ID":"cc91cd57-09bc-4bc3-bd39-df824e4f790f","Type":"ContainerStarted","Data":"a928b59d57a4d7272fac929655ee7def02931e76ca891513957024c6514b7776"} Jul 24 12:18:04.893551 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:04.893500 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55457fd4c8-kkldt" event={"ID":"8a4b1562-4b47-471d-8f1b-f5c2e2d6ea5c","Type":"ContainerStarted","Data":"bdad8037c7e575a2368d2256bee9fe911baae081dfe2addb993e759f71bb0910"} Jul 24 12:18:04.895769 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:04.895745 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-prgmm" event={"ID":"4a130a4a-ed5a-4a1e-821a-e5e0c115a0de","Type":"ContainerStarted","Data":"5a12fa2df5f9325e3a3ce56378abcafc8158d87ceeb629467ba80e40b1958193"} Jul 24 12:18:04.926324 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:04.924718 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-847c5d5c9-ljlw8" podStartSLOduration=32.924696576 podStartE2EDuration="32.924696576s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:17:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:18:04.923330949 +0000 UTC m=+77.974575942" watchObservedRunningTime="2026-07-24 12:18:04.924696576 +0000 UTC m=+77.975941571" Jul 24 12:18:05.374546 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:05.374090 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-847c5d5c9-ljlw8" Jul 24 12:18:05.380602 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:05.380378 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-847c5d5c9-ljlw8" Jul 24 12:18:05.913847 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:05.913660 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-847c5d5c9-ljlw8" Jul 24 12:18:05.915551 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:05.915346 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-847c5d5c9-ljlw8" Jul 24 12:18:07.845174 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:07.845125 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8q6d8" Jul 24 12:18:13.943041 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:13.942951 2555 patch_prober.go:28] interesting pod/image-registry-59c89c9f84-ldxwc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 24 12:18:13.943041 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:13.943015 2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" podUID="8f6e6a89-d316-425a-9138-c0318824371d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 24 12:18:15.802791 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:15.802674 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" Jul 24 12:18:15.982073 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:15.981741 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-prgmm" event={"ID":"4a130a4a-ed5a-4a1e-821a-e5e0c115a0de","Type":"ContainerStarted","Data":"fca78bbbf4e864a2e2e7d7238908dcd01df07141fac00b6c5bb8ac01d6932e22"} Jul 24 12:18:15.984719 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:15.984687 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qsfrm" event={"ID":"5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db","Type":"ContainerStarted","Data":"1cb493f1ba14e94236664ff57ccd84a8a2cbe46166ab4ec704cdc3eaf80cbd70"} Jul 24 12:18:15.987189 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:15.987095 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bb9bfb65-748zg" event={"ID":"153d8200-536a-4d31-be07-76117c071abe","Type":"ContainerStarted","Data":"4a4b7937b0d885fc4ee5fc297bd316c115fa6e7471d9b2079822786d011818ea"} Jul 24 12:18:15.987189 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:15.987145 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bb9bfb65-748zg" event={"ID":"153d8200-536a-4d31-be07-76117c071abe","Type":"ContainerStarted","Data":"7d65072f4b0dddb1db34f44565af628e9d89fde334decc2899372c28561a1f42"} Jul 24 12:18:15.987189 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:15.987164 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bb9bfb65-748zg" event={"ID":"153d8200-536a-4d31-be07-76117c071abe","Type":"ContainerStarted","Data":"3ca06110112b49e9cf598569ea9e4c362ccd35f525f793e0e36433f8948b5a04"} Jul 24 12:18:15.989223 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:15.989198 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-576dn" event={"ID":"c385960c-6bf7-4b33-8ce0-f627cb711d9c","Type":"ContainerStarted","Data":"05b052939b29c9d6b96bf28091ce9fd3133cb040ed652144a391ee3c0a71b8ad"} Jul 24 12:18:15.991267 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:15.991213 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f898cb-7jgfw" event={"ID":"cc91cd57-09bc-4bc3-bd39-df824e4f790f","Type":"ContainerStarted","Data":"d0532a1ea844e61efa67fb890d3bd7b20bd5eed218506250e8e5892a0be31b1b"} Jul 24 12:18:15.991521 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:15.991473 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f898cb-7jgfw" Jul 24 12:18:15.993362 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:15.993320 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55457fd4c8-kkldt" event={"ID":"8a4b1562-4b47-471d-8f1b-f5c2e2d6ea5c","Type":"ContainerStarted","Data":"5cb71e664fc119e7ddf4223088d40d4c2f4e8c9c133238952cde3918f826bf6f"} Jul 24 12:18:15.994371 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:15.994334 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f898cb-7jgfw" Jul 24 12:18:16.002363 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:16.002321 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-prgmm" podStartSLOduration=33.043277305 podStartE2EDuration="44.002307281s" totalImagesPullingTime="10.959029976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:17:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:18:16.000848155 +0000 UTC m=+89.052093172" watchObservedRunningTime="2026-07-24 12:18:16.002307281 +0000 UTC m=+89.053552273" Jul 24 12:18:16.017934 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:16.017881 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578f898cb-7jgfw" podStartSLOduration=1.78839221 podStartE2EDuration="13.017867149s" totalImagesPullingTime="11.229474939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:18:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:18:16.016640315 +0000 UTC m=+89.067885309" watchObservedRunningTime="2026-07-24 12:18:16.017867149 +0000 UTC m=+89.069112132" Jul 24 12:18:16.059914 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:16.059852 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55457fd4c8-kkldt" podStartSLOduration=1.6203512629999999 podStartE2EDuration="13.059830385s" totalImagesPullingTime="11.439479122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:18:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:18:16.032429525 +0000 UTC m=+89.083674518" watchObservedRunningTime="2026-07-24 12:18:16.059830385 +0000 UTC m=+89.111075378" Jul 24 12:18:16.061923 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:16.061842 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-576dn" podStartSLOduration=33.182452578 podStartE2EDuration="44.061827403s" totalImagesPullingTime="10.879374825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:17:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:18:16.058965806 +0000 UTC m=+89.110210798" watchObservedRunningTime="2026-07-24 12:18:16.061827403 +0000 UTC m=+89.113072397" Jul 24 12:18:16.083289 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:16.081096 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75bb9bfb65-748zg" podStartSLOduration=1.8524094180000001 podStartE2EDuration="13.081043851s" totalImagesPullingTime="11.228634433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:18:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:18:16.080706666 +0000 UTC m=+89.131951650" watchObservedRunningTime="2026-07-24 12:18:16.081043851 +0000 UTC m=+89.132288844" Jul 24 12:18:25.035720 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:25.035615 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-kg2nr" event={"ID":"ea5a6ec0-554e-47e8-9e7b-ebaeec1c368d","Type":"ContainerStarted","Data":"353309359ca0e3c76e3fbc71c4ba0e58b39e414f685dafbcce8844ef1d8df114"} Jul 24 12:18:25.036325 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:25.035787 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-kg2nr" Jul 24 12:18:25.045085 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:25.045045 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-kg2nr" Jul 24 12:18:25.056981 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:25.056887 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-kg2nr" podStartSLOduration=2.018006083 podStartE2EDuration="22.056865936s" totalImagesPullingTime="20.038859853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:18:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:18:25.055412592 +0000 UTC m=+98.106657610" watchObservedRunningTime="2026-07-24 12:18:25.056865936 +0000 UTC m=+98.108110929" Jul 24 12:18:25.801182 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:25.800348 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lcjn9" Jul 24 12:18:26.580750 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:26.580710 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ft2vq"] Jul 24 12:18:26.634102 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:26.633636 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ft2vq" Jul 24 12:18:26.645853 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:26.639987 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2vftn\"" Jul 24 12:18:26.645853 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:26.640209 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 24 12:18:26.645853 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:26.640322 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 24 12:18:26.645853 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:26.640384 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 24 12:18:26.645853 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:26.640574 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 24 12:18:26.703469 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:26.703019 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f-node-exporter-accelerators-collector-config\") pod \"node-exporter-ft2vq\" (UID: \"e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f\") " pod="openshift-monitoring/node-exporter-ft2vq" Jul 24 12:18:26.703469 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:26.703077 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f-sys\") pod \"node-exporter-ft2vq\" (UID: \"e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f\") " pod="openshift-monitoring/node-exporter-ft2vq" Jul 24 12:18:26.703469 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:26.703104 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f-metrics-client-ca\") pod \"node-exporter-ft2vq\" (UID: \"e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f\") " pod="openshift-monitoring/node-exporter-ft2vq" Jul 24 12:18:26.703469 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:26.703137 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f-node-exporter-tls\") pod \"node-exporter-ft2vq\" (UID: \"e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f\") " pod="openshift-monitoring/node-exporter-ft2vq" Jul 24 12:18:26.703469 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:26.703171 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nn4rr\" (UniqueName: \"kubernetes.io/projected/e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f-kube-api-access-nn4rr\") pod \"node-exporter-ft2vq\" (UID: \"e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f\") " pod="openshift-monitoring/node-exporter-ft2vq" Jul 24 12:18:26.703469 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:26.703197 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f-node-exporter-wtmp\") pod \"node-exporter-ft2vq\" (UID: \"e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f\") " pod="openshift-monitoring/node-exporter-ft2vq" Jul 24 12:18:26.703469 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:26.703239 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ft2vq\" (UID: \"e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f\") " pod="openshift-monitoring/node-exporter-ft2vq" Jul 24 12:18:26.703469 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:26.703277 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f-root\") pod \"node-exporter-ft2vq\" (UID: \"e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f\") " pod="openshift-monitoring/node-exporter-ft2vq" Jul 24 12:18:26.703469 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:26.703309 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f-node-exporter-textfile\") pod \"node-exporter-ft2vq\" (UID: \"e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f\") " pod="openshift-monitoring/node-exporter-ft2vq" Jul 24 12:18:26.805778 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:26.803778 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f-node-exporter-accelerators-collector-config\") pod \"node-exporter-ft2vq\" (UID: \"e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f\") " pod="openshift-monitoring/node-exporter-ft2vq" Jul 24 12:18:26.805778 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:26.803831 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f-sys\") pod \"node-exporter-ft2vq\" (UID: \"e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f\") " pod="openshift-monitoring/node-exporter-ft2vq" Jul 24 12:18:26.805778 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:26.803857 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f-metrics-client-ca\") pod \"node-exporter-ft2vq\" (UID: \"e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f\") " pod="openshift-monitoring/node-exporter-ft2vq" Jul 24 12:18:26.805778 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:26.803888 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f-node-exporter-tls\") pod \"node-exporter-ft2vq\" (UID: \"e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f\") " pod="openshift-monitoring/node-exporter-ft2vq" Jul 24 12:18:26.805778 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:26.803921 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nn4rr\" (UniqueName: \"kubernetes.io/projected/e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f-kube-api-access-nn4rr\") pod \"node-exporter-ft2vq\" (UID: \"e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f\") " pod="openshift-monitoring/node-exporter-ft2vq" Jul 24 12:18:26.805778 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:26.803968 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f-node-exporter-wtmp\") pod \"node-exporter-ft2vq\" (UID: \"e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f\") " pod="openshift-monitoring/node-exporter-ft2vq" Jul 24 12:18:26.805778 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:26.804012 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ft2vq\" (UID: \"e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f\") " pod="openshift-monitoring/node-exporter-ft2vq" Jul 24 12:18:26.805778 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:26.804049 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f-root\") pod \"node-exporter-ft2vq\" (UID: \"e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f\") " pod="openshift-monitoring/node-exporter-ft2vq" Jul 24 12:18:26.805778 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:26.804095 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f-node-exporter-textfile\") pod \"node-exporter-ft2vq\" (UID: \"e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f\") " pod="openshift-monitoring/node-exporter-ft2vq" Jul 24 12:18:26.805778 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:26.804452 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f-node-exporter-textfile\") pod \"node-exporter-ft2vq\" (UID: \"e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f\") " pod="openshift-monitoring/node-exporter-ft2vq" Jul 24 12:18:26.805778 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:26.804948 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f-node-exporter-accelerators-collector-config\") pod \"node-exporter-ft2vq\" (UID: \"e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f\") " pod="openshift-monitoring/node-exporter-ft2vq" Jul 24 12:18:26.805778 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:26.805012 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f-sys\") pod \"node-exporter-ft2vq\" (UID: \"e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f\") " pod="openshift-monitoring/node-exporter-ft2vq" Jul 24 12:18:26.805778 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:26.805439 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f-metrics-client-ca\") pod \"node-exporter-ft2vq\" (UID: \"e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f\") " pod="openshift-monitoring/node-exporter-ft2vq" Jul 24 12:18:26.807361 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:26.806692 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f-node-exporter-wtmp\") pod \"node-exporter-ft2vq\" (UID: \"e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f\") " pod="openshift-monitoring/node-exporter-ft2vq" Jul 24 12:18:26.807361 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:26.807321 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f-root\") pod \"node-exporter-ft2vq\" (UID: \"e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f\") " pod="openshift-monitoring/node-exporter-ft2vq" Jul 24 12:18:26.813464 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:26.813421 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ft2vq\" (UID: \"e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f\") " pod="openshift-monitoring/node-exporter-ft2vq" Jul 24 12:18:26.818613 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:26.817391 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f-node-exporter-tls\") pod \"node-exporter-ft2vq\" (UID: \"e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f\") " pod="openshift-monitoring/node-exporter-ft2vq" Jul 24 12:18:26.823743 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:26.823547 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nn4rr\" (UniqueName: \"kubernetes.io/projected/e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f-kube-api-access-nn4rr\") pod \"node-exporter-ft2vq\" (UID: \"e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f\") " pod="openshift-monitoring/node-exporter-ft2vq" Jul 24 12:18:26.949347 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:26.949312 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ft2vq" Jul 24 12:18:28.790435 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:18:28.790393 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2a3c9fa_7064_4cd8_9496_d13fa1b93e2f.slice/crio-6d8b087448d9bac1d9cfc1e50237353d78a92069201ad348c4016772a23e7b72 WatchSource:0}: Error finding container 6d8b087448d9bac1d9cfc1e50237353d78a92069201ad348c4016772a23e7b72: Status 404 returned error can't find the container with id 6d8b087448d9bac1d9cfc1e50237353d78a92069201ad348c4016772a23e7b72 Jul 24 12:18:29.059161 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:29.059078 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ft2vq" event={"ID":"e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f","Type":"ContainerStarted","Data":"6d8b087448d9bac1d9cfc1e50237353d78a92069201ad348c4016772a23e7b72"} Jul 24 12:18:30.066719 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:30.066678 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qsfrm" event={"ID":"5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db","Type":"ContainerStarted","Data":"669a6367360773c8fea5bbe276359cf7aea1b1d5a274ce8575250b30174ddedf"} Jul 24 12:18:30.086643 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:30.086584 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qsfrm" podStartSLOduration=17.770769656 podStartE2EDuration="50.086562066s" totalImagesPullingTime="32.31579241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:17:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:18:30.085665547 +0000 UTC m=+103.136910560" watchObservedRunningTime="2026-07-24 12:18:30.086562066 +0000 UTC m=+103.137807062" Jul 24 12:18:31.072996 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:31.072907 2555 generic.go:356] "Generic (PLEG): container finished" podID="e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f" containerID="98945b96c5ada9ad5084172dfbfd1d9d5c3ed4162343853480ea34268609638a" exitCode=0 Jul 24 12:18:31.073480 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:31.073001 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ft2vq" event={"ID":"e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f","Type":"ContainerDied","Data":"98945b96c5ada9ad5084172dfbfd1d9d5c3ed4162343853480ea34268609638a"} Jul 24 12:18:32.080794 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:32.080749 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ft2vq" event={"ID":"e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f","Type":"ContainerStarted","Data":"eb6cfeedaeafae4fe1a3ec059cccf04c8dbf3b3d4f2eac6d431ad910a69b9d79"} Jul 24 12:18:32.081451 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:32.080822 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ft2vq" event={"ID":"e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f","Type":"ContainerStarted","Data":"408bd30fba8c5a7d72c692e44a96829b13ed9e7eaa90e43ca20e9eeea235cc27"} Jul 24 12:18:32.103881 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:32.103809 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ft2vq" podStartSLOduration=4.27174344 podStartE2EDuration="6.103786816s" totalImagesPullingTime="1.718461567s" totalInitContainerRuntime="113.581809ms" isStatefulPod=true podCreationTimestamp="2026-07-24 12:18:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:18:32.101104238 +0000 UTC m=+105.152349261" watchObservedRunningTime="2026-07-24 12:18:32.103786816 +0000 UTC m=+105.155031809" Jul 24 12:18:32.607744 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:32.607709 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59c89c9f84-ldxwc"] Jul 24 12:18:51.155909 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:51.155876 2555 generic.go:356] "Generic (PLEG): container finished" podID="80196e1f-58e5-4a8e-a92d-bf979f9d95a1" containerID="15d447a23b0d250d76564ea0f8462357ba3a57130a1c67b3e27233ac4667ec32" exitCode=0 Jul 24 12:18:51.156350 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:51.155954 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-drd9f" event={"ID":"80196e1f-58e5-4a8e-a92d-bf979f9d95a1","Type":"ContainerDied","Data":"15d447a23b0d250d76564ea0f8462357ba3a57130a1c67b3e27233ac4667ec32"} Jul 24 12:18:51.156350 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:51.156287 2555 scope.go:117] "RemoveContainer" containerID="15d447a23b0d250d76564ea0f8462357ba3a57130a1c67b3e27233ac4667ec32" Jul 24 12:18:52.162506 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:52.162469 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-drd9f" event={"ID":"80196e1f-58e5-4a8e-a92d-bf979f9d95a1","Type":"ContainerStarted","Data":"ac8628fae424265c9ed43e33986e3da7e8d7b6b70a8cadc85110af5b11a7108b"} Jul 24 12:18:55.176116 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:55.176081 2555 generic.go:356] "Generic (PLEG): container finished" podID="1d02e6e2-54f3-43fc-a712-faf751240dad" containerID="585ebfe79b144ed6f0a021a74c759ceabdd0633876128f504cc0c5ea669b7710" exitCode=0 Jul 24 12:18:55.176501 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:55.176151 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-mttrp" event={"ID":"1d02e6e2-54f3-43fc-a712-faf751240dad","Type":"ContainerDied","Data":"585ebfe79b144ed6f0a021a74c759ceabdd0633876128f504cc0c5ea669b7710"} Jul 24 12:18:55.176501 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:55.176478 2555 scope.go:117] "RemoveContainer" containerID="585ebfe79b144ed6f0a021a74c759ceabdd0633876128f504cc0c5ea669b7710" Jul 24 12:18:56.181393 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:56.181361 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-mttrp" event={"ID":"1d02e6e2-54f3-43fc-a712-faf751240dad","Type":"ContainerStarted","Data":"f1e3a6ab68594dd1125b8fb9566caf703c16c02601321dffbdabc0d2502deb4b"} Jul 24 12:18:57.630282 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:57.630234 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" podUID="8f6e6a89-d316-425a-9138-c0318824371d" containerName="registry" containerID="cri-o://83e6c540cbe005391831a6afe0ba2dcf8e9531754e03c342d933a8ccb01c7417" gracePeriod=30 Jul 24 12:18:57.897917 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:57.897858 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" Jul 24 12:18:58.075641 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:58.075606 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f6e6a89-d316-425a-9138-c0318824371d-installation-pull-secrets\") pod \"8f6e6a89-d316-425a-9138-c0318824371d\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " Jul 24 12:18:58.075811 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:58.075662 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f6e6a89-d316-425a-9138-c0318824371d-bound-sa-token\") pod \"8f6e6a89-d316-425a-9138-c0318824371d\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " Jul 24 12:18:58.075811 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:58.075694 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8f6e6a89-d316-425a-9138-c0318824371d-image-registry-private-configuration\") pod \"8f6e6a89-d316-425a-9138-c0318824371d\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " Jul 24 12:18:58.075887 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:58.075808 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f6e6a89-d316-425a-9138-c0318824371d-registry-tls\") pod \"8f6e6a89-d316-425a-9138-c0318824371d\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " Jul 24 12:18:58.075887 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:58.075846 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f6e6a89-d316-425a-9138-c0318824371d-registry-certificates\") pod \"8f6e6a89-d316-425a-9138-c0318824371d\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " Jul 24 12:18:58.075959 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:58.075887 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f6e6a89-d316-425a-9138-c0318824371d-ca-trust-extracted\") pod \"8f6e6a89-d316-425a-9138-c0318824371d\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " Jul 24 12:18:58.075959 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:58.075912 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wk8x\" (UniqueName: \"kubernetes.io/projected/8f6e6a89-d316-425a-9138-c0318824371d-kube-api-access-5wk8x\") pod \"8f6e6a89-d316-425a-9138-c0318824371d\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " Jul 24 12:18:58.076088 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:58.075961 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f6e6a89-d316-425a-9138-c0318824371d-trusted-ca\") pod \"8f6e6a89-d316-425a-9138-c0318824371d\" (UID: \"8f6e6a89-d316-425a-9138-c0318824371d\") " Jul 24 12:18:58.076538 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:58.076357 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f6e6a89-d316-425a-9138-c0318824371d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8f6e6a89-d316-425a-9138-c0318824371d" (UID: "8f6e6a89-d316-425a-9138-c0318824371d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 12:18:58.076636 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:58.076609 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f6e6a89-d316-425a-9138-c0318824371d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8f6e6a89-d316-425a-9138-c0318824371d" (UID: "8f6e6a89-d316-425a-9138-c0318824371d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 12:18:58.078477 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:58.078448 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f6e6a89-d316-425a-9138-c0318824371d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8f6e6a89-d316-425a-9138-c0318824371d" (UID: "8f6e6a89-d316-425a-9138-c0318824371d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 12:18:58.078591 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:58.078468 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f6e6a89-d316-425a-9138-c0318824371d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8f6e6a89-d316-425a-9138-c0318824371d" (UID: "8f6e6a89-d316-425a-9138-c0318824371d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 12:18:58.078591 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:58.078526 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f6e6a89-d316-425a-9138-c0318824371d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8f6e6a89-d316-425a-9138-c0318824371d" (UID: "8f6e6a89-d316-425a-9138-c0318824371d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 12:18:58.078591 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:58.078571 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f6e6a89-d316-425a-9138-c0318824371d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8f6e6a89-d316-425a-9138-c0318824371d" (UID: "8f6e6a89-d316-425a-9138-c0318824371d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 12:18:58.078765 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:58.078668 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f6e6a89-d316-425a-9138-c0318824371d-kube-api-access-5wk8x" (OuterVolumeSpecName: "kube-api-access-5wk8x") pod "8f6e6a89-d316-425a-9138-c0318824371d" (UID: "8f6e6a89-d316-425a-9138-c0318824371d"). InnerVolumeSpecName "kube-api-access-5wk8x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 12:18:58.084352 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:58.084325 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f6e6a89-d316-425a-9138-c0318824371d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8f6e6a89-d316-425a-9138-c0318824371d" (UID: "8f6e6a89-d316-425a-9138-c0318824371d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 12:18:58.176852 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:58.176820 2555 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f6e6a89-d316-425a-9138-c0318824371d-registry-tls\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jul 24 12:18:58.176852 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:58.176852 2555 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f6e6a89-d316-425a-9138-c0318824371d-registry-certificates\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jul 24 12:18:58.177045 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:58.176861 2555 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f6e6a89-d316-425a-9138-c0318824371d-ca-trust-extracted\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jul 24 12:18:58.177045 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:58.176870 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wk8x\" (UniqueName: \"kubernetes.io/projected/8f6e6a89-d316-425a-9138-c0318824371d-kube-api-access-5wk8x\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jul 24 12:18:58.177045 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:58.176878 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f6e6a89-d316-425a-9138-c0318824371d-trusted-ca\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jul 24 12:18:58.177045 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:58.176886 2555 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f6e6a89-d316-425a-9138-c0318824371d-installation-pull-secrets\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jul 24 12:18:58.177045 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:58.176894 2555 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f6e6a89-d316-425a-9138-c0318824371d-bound-sa-token\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jul 24 12:18:58.177045 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:58.176904 2555 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8f6e6a89-d316-425a-9138-c0318824371d-image-registry-private-configuration\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jul 24 12:18:58.190357 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:58.190323 2555 generic.go:356] "Generic (PLEG): container finished" podID="8f6e6a89-d316-425a-9138-c0318824371d" containerID="83e6c540cbe005391831a6afe0ba2dcf8e9531754e03c342d933a8ccb01c7417" exitCode=0 Jul 24 12:18:58.190520 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:58.190371 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" Jul 24 12:18:58.190520 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:58.190410 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" event={"ID":"8f6e6a89-d316-425a-9138-c0318824371d","Type":"ContainerDied","Data":"83e6c540cbe005391831a6afe0ba2dcf8e9531754e03c342d933a8ccb01c7417"} Jul 24 12:18:58.190520 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:58.190467 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59c89c9f84-ldxwc" event={"ID":"8f6e6a89-d316-425a-9138-c0318824371d","Type":"ContainerDied","Data":"5885292bed553a44fefeef6994976dda035868d776ef5b9a0d311ce39953523e"} Jul 24 12:18:58.190520 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:58.190488 2555 scope.go:117] "RemoveContainer" containerID="83e6c540cbe005391831a6afe0ba2dcf8e9531754e03c342d933a8ccb01c7417" Jul 24 12:18:58.199532 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:58.199500 2555 scope.go:117] "RemoveContainer" containerID="83e6c540cbe005391831a6afe0ba2dcf8e9531754e03c342d933a8ccb01c7417" Jul 24 12:18:58.199790 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:18:58.199766 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83e6c540cbe005391831a6afe0ba2dcf8e9531754e03c342d933a8ccb01c7417\": container with ID starting with 83e6c540cbe005391831a6afe0ba2dcf8e9531754e03c342d933a8ccb01c7417 not found: ID does not exist" containerID="83e6c540cbe005391831a6afe0ba2dcf8e9531754e03c342d933a8ccb01c7417" Jul 24 12:18:58.199840 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:58.199799 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83e6c540cbe005391831a6afe0ba2dcf8e9531754e03c342d933a8ccb01c7417"} err="failed to get container status \"83e6c540cbe005391831a6afe0ba2dcf8e9531754e03c342d933a8ccb01c7417\": rpc error: code = NotFound desc = could not find container \"83e6c540cbe005391831a6afe0ba2dcf8e9531754e03c342d933a8ccb01c7417\": container with ID starting with 83e6c540cbe005391831a6afe0ba2dcf8e9531754e03c342d933a8ccb01c7417 not found: ID does not exist" Jul 24 12:18:58.213272 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:58.213231 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59c89c9f84-ldxwc"] Jul 24 12:18:58.215110 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:58.215090 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-59c89c9f84-ldxwc"] Jul 24 12:18:59.422297 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:18:59.422262 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f6e6a89-d316-425a-9138-c0318824371d" path="/var/lib/kubelet/pods/8f6e6a89-d316-425a-9138-c0318824371d/volumes" Jul 24 12:19:10.242580 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:19:10.242541 2555 generic.go:356] "Generic (PLEG): container finished" podID="5f0aa6bf-6f8e-4157-8c39-4b5d44ce9475" containerID="90cc902f2d651f36cca68ca3da46933bc6bae21b6b4e0e2777568a07302ab9cf" exitCode=0 Jul 24 12:19:10.243005 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:19:10.242611 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4hhsg" event={"ID":"5f0aa6bf-6f8e-4157-8c39-4b5d44ce9475","Type":"ContainerDied","Data":"90cc902f2d651f36cca68ca3da46933bc6bae21b6b4e0e2777568a07302ab9cf"} Jul 24 12:19:10.243005 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:19:10.242925 2555 scope.go:117] "RemoveContainer" containerID="90cc902f2d651f36cca68ca3da46933bc6bae21b6b4e0e2777568a07302ab9cf" Jul 24 12:19:11.248517 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:19:11.248482 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4hhsg" event={"ID":"5f0aa6bf-6f8e-4157-8c39-4b5d44ce9475","Type":"ContainerStarted","Data":"1d6bb2d8aff41324fa6ee98aa5246e752db5a8ee326681a1966b82cb24c00021"} Jul 24 12:21:41.857163 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:41.857126 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bb8c67698-dr98h"] Jul 24 12:21:41.857620 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:41.857567 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f6e6a89-d316-425a-9138-c0318824371d" containerName="registry" Jul 24 12:21:41.857620 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:41.857584 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f6e6a89-d316-425a-9138-c0318824371d" containerName="registry" Jul 24 12:21:41.857715 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:41.857703 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f6e6a89-d316-425a-9138-c0318824371d" containerName="registry" Jul 24 12:21:41.860517 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:41.860488 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7bb8c67698-dr98h" Jul 24 12:21:41.864326 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:41.864302 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 24 12:21:41.864512 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:41.864485 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 24 12:21:41.864654 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:41.864401 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2c4lf\"" Jul 24 12:21:41.864791 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:41.864365 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 24 12:21:41.864916 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:41.864866 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 24 12:21:41.882780 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:41.882753 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bb8c67698-dr98h"] Jul 24 12:21:41.996974 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:41.996928 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7f233df4-c545-448e-9c80-609e57e9fd77-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bb8c67698-dr98h\" (UID: \"7f233df4-c545-448e-9c80-609e57e9fd77\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb8c67698-dr98h" Jul 24 12:21:41.996974 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:41.996976 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7f233df4-c545-448e-9c80-609e57e9fd77-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bb8c67698-dr98h\" (UID: \"7f233df4-c545-448e-9c80-609e57e9fd77\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb8c67698-dr98h" Jul 24 12:21:41.997275 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:41.997013 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f233df4-c545-448e-9c80-609e57e9fd77-tmp\") pod \"opendatahub-operator-controller-manager-7bb8c67698-dr98h\" (UID: \"7f233df4-c545-448e-9c80-609e57e9fd77\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb8c67698-dr98h" Jul 24 12:21:41.997275 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:41.997119 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8szjh\" (UniqueName: \"kubernetes.io/projected/7f233df4-c545-448e-9c80-609e57e9fd77-kube-api-access-8szjh\") pod \"opendatahub-operator-controller-manager-7bb8c67698-dr98h\" (UID: \"7f233df4-c545-448e-9c80-609e57e9fd77\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb8c67698-dr98h" Jul 24 12:21:41.997275 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:41.997146 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7f233df4-c545-448e-9c80-609e57e9fd77-manifests\") pod \"opendatahub-operator-controller-manager-7bb8c67698-dr98h\" (UID: \"7f233df4-c545-448e-9c80-609e57e9fd77\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb8c67698-dr98h" Jul 24 12:21:42.097930 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:42.097893 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8szjh\" (UniqueName: \"kubernetes.io/projected/7f233df4-c545-448e-9c80-609e57e9fd77-kube-api-access-8szjh\") pod \"opendatahub-operator-controller-manager-7bb8c67698-dr98h\" (UID: \"7f233df4-c545-448e-9c80-609e57e9fd77\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb8c67698-dr98h" Jul 24 12:21:42.097930 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:42.097933 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7f233df4-c545-448e-9c80-609e57e9fd77-manifests\") pod \"opendatahub-operator-controller-manager-7bb8c67698-dr98h\" (UID: \"7f233df4-c545-448e-9c80-609e57e9fd77\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb8c67698-dr98h" Jul 24 12:21:42.098218 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:42.097983 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7f233df4-c545-448e-9c80-609e57e9fd77-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bb8c67698-dr98h\" (UID: \"7f233df4-c545-448e-9c80-609e57e9fd77\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb8c67698-dr98h" Jul 24 12:21:42.098218 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:42.098009 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7f233df4-c545-448e-9c80-609e57e9fd77-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bb8c67698-dr98h\" (UID: \"7f233df4-c545-448e-9c80-609e57e9fd77\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb8c67698-dr98h" Jul 24 12:21:42.098218 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:42.098042 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f233df4-c545-448e-9c80-609e57e9fd77-tmp\") pod \"opendatahub-operator-controller-manager-7bb8c67698-dr98h\" (UID: \"7f233df4-c545-448e-9c80-609e57e9fd77\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb8c67698-dr98h" Jul 24 12:21:42.098484 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:42.098459 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7f233df4-c545-448e-9c80-609e57e9fd77-manifests\") pod \"opendatahub-operator-controller-manager-7bb8c67698-dr98h\" (UID: \"7f233df4-c545-448e-9c80-609e57e9fd77\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb8c67698-dr98h" Jul 24 12:21:42.100361 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:42.100338 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f233df4-c545-448e-9c80-609e57e9fd77-tmp\") pod \"opendatahub-operator-controller-manager-7bb8c67698-dr98h\" (UID: \"7f233df4-c545-448e-9c80-609e57e9fd77\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb8c67698-dr98h" Jul 24 12:21:42.100613 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:42.100595 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7f233df4-c545-448e-9c80-609e57e9fd77-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bb8c67698-dr98h\" (UID: \"7f233df4-c545-448e-9c80-609e57e9fd77\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb8c67698-dr98h" Jul 24 12:21:42.100676 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:42.100614 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7f233df4-c545-448e-9c80-609e57e9fd77-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bb8c67698-dr98h\" (UID: \"7f233df4-c545-448e-9c80-609e57e9fd77\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb8c67698-dr98h" Jul 24 12:21:42.111176 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:42.111119 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8szjh\" (UniqueName: \"kubernetes.io/projected/7f233df4-c545-448e-9c80-609e57e9fd77-kube-api-access-8szjh\") pod \"opendatahub-operator-controller-manager-7bb8c67698-dr98h\" (UID: \"7f233df4-c545-448e-9c80-609e57e9fd77\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb8c67698-dr98h" Jul 24 12:21:42.175051 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:42.175009 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7bb8c67698-dr98h" Jul 24 12:21:42.316342 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:42.316302 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bb8c67698-dr98h"] Jul 24 12:21:42.318789 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:21:42.318750 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f233df4_c545_448e_9c80_609e57e9fd77.slice/crio-8f222ead1696267b7d6ea4c336d0a7e219d92e2b96c4e324e4fd8bf72378a0d5 WatchSource:0}: Error finding container 8f222ead1696267b7d6ea4c336d0a7e219d92e2b96c4e324e4fd8bf72378a0d5: Status 404 returned error can't find the container with id 8f222ead1696267b7d6ea4c336d0a7e219d92e2b96c4e324e4fd8bf72378a0d5 Jul 24 12:21:42.826677 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:42.826639 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bb8c67698-dr98h" event={"ID":"7f233df4-c545-448e-9c80-609e57e9fd77","Type":"ContainerStarted","Data":"8f222ead1696267b7d6ea4c336d0a7e219d92e2b96c4e324e4fd8bf72378a0d5"} Jul 24 12:21:45.843935 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:45.843854 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bb8c67698-dr98h" event={"ID":"7f233df4-c545-448e-9c80-609e57e9fd77","Type":"ContainerStarted","Data":"2517ef27068115a1bcf6f8504b6690dbe81db1912d12298d920ce360c54686c6"} Jul 24 12:21:46.849442 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:46.849403 2555 generic.go:356] "Generic (PLEG): container finished" podID="7f233df4-c545-448e-9c80-609e57e9fd77" containerID="2517ef27068115a1bcf6f8504b6690dbe81db1912d12298d920ce360c54686c6" exitCode=0 Jul 24 12:21:46.849841 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:46.849452 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bb8c67698-dr98h" event={"ID":"7f233df4-c545-448e-9c80-609e57e9fd77","Type":"ContainerDied","Data":"2517ef27068115a1bcf6f8504b6690dbe81db1912d12298d920ce360c54686c6"} Jul 24 12:21:47.327885 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:47.327832 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-g5v4m_7e1b58e8-bdad-423e-a12b-a8b0fc1c900e/console-operator/1.log" Jul 24 12:21:47.335199 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:47.335176 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-g5v4m_7e1b58e8-bdad-423e-a12b-a8b0fc1c900e/console-operator/1.log" Jul 24 12:21:47.340440 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:47.340418 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ssvdc_4ce505f1-38d9-4827-9141-b691d722aa05/ovn-acl-logging/0.log" Jul 24 12:21:47.345547 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:47.345523 2555 kubelet.go:1648] "Image garbage collection succeeded" Jul 24 12:21:47.352304 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:47.352286 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ssvdc_4ce505f1-38d9-4827-9141-b691d722aa05/ovn-acl-logging/0.log" Jul 24 12:21:47.856396 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:47.856346 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bb8c67698-dr98h" event={"ID":"7f233df4-c545-448e-9c80-609e57e9fd77","Type":"ContainerStarted","Data":"ec50894e90a8d8f6df1e6579d3814bbbee9a3d3b339e5b203720bd8d057369b0"} Jul 24 12:21:47.857861 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:47.856562 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7bb8c67698-dr98h" Jul 24 12:21:47.879666 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:47.879616 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7bb8c67698-dr98h" podStartSLOduration=2.065702018 podStartE2EDuration="6.87960064s" totalImagesPullingTime="3.728083014s" totalInitContainerRuntime="1.085815608s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:21:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:21:47.877482797 +0000 UTC m=+300.928727816" watchObservedRunningTime="2026-07-24 12:21:47.87960064 +0000 UTC m=+300.930845633" Jul 24 12:21:58.863379 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:21:58.863350 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7bb8c67698-dr98h" Jul 24 12:22:01.840815 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:01.840779 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-67cd644d69-pg99t"] Jul 24 12:22:01.851731 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:01.851709 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-67cd644d69-pg99t" Jul 24 12:22:01.857987 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:01.857957 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 24 12:22:01.858160 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:01.858005 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 24 12:22:01.860400 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:01.860375 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-67cd644d69-pg99t"] Jul 24 12:22:01.865595 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:01.865574 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/101cde89-dec2-407b-85b4-ba133f974243-tls-certs\") pod \"kube-auth-proxy-67cd644d69-pg99t\" (UID: \"101cde89-dec2-407b-85b4-ba133f974243\") " pod="openshift-ingress/kube-auth-proxy-67cd644d69-pg99t" Jul 24 12:22:01.865708 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:01.865625 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/101cde89-dec2-407b-85b4-ba133f974243-tmp\") pod \"kube-auth-proxy-67cd644d69-pg99t\" (UID: \"101cde89-dec2-407b-85b4-ba133f974243\") " pod="openshift-ingress/kube-auth-proxy-67cd644d69-pg99t" Jul 24 12:22:01.865708 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:01.865661 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z2p2\" (UniqueName: \"kubernetes.io/projected/101cde89-dec2-407b-85b4-ba133f974243-kube-api-access-5z2p2\") pod \"kube-auth-proxy-67cd644d69-pg99t\" (UID: \"101cde89-dec2-407b-85b4-ba133f974243\") " pod="openshift-ingress/kube-auth-proxy-67cd644d69-pg99t" Jul 24 12:22:01.966495 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:01.966448 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z2p2\" (UniqueName: \"kubernetes.io/projected/101cde89-dec2-407b-85b4-ba133f974243-kube-api-access-5z2p2\") pod \"kube-auth-proxy-67cd644d69-pg99t\" (UID: \"101cde89-dec2-407b-85b4-ba133f974243\") " pod="openshift-ingress/kube-auth-proxy-67cd644d69-pg99t" Jul 24 12:22:01.966672 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:01.966576 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/101cde89-dec2-407b-85b4-ba133f974243-tls-certs\") pod \"kube-auth-proxy-67cd644d69-pg99t\" (UID: \"101cde89-dec2-407b-85b4-ba133f974243\") " pod="openshift-ingress/kube-auth-proxy-67cd644d69-pg99t" Jul 24 12:22:01.966672 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:01.966621 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/101cde89-dec2-407b-85b4-ba133f974243-tmp\") pod \"kube-auth-proxy-67cd644d69-pg99t\" (UID: \"101cde89-dec2-407b-85b4-ba133f974243\") " pod="openshift-ingress/kube-auth-proxy-67cd644d69-pg99t" Jul 24 12:22:01.966752 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:22:01.966729 2555 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 24 12:22:01.966825 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:22:01.966812 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/101cde89-dec2-407b-85b4-ba133f974243-tls-certs podName:101cde89-dec2-407b-85b4-ba133f974243 nodeName:}" failed. No retries permitted until 2026-07-24 12:22:02.46679136 +0000 UTC m=+315.518036337 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/101cde89-dec2-407b-85b4-ba133f974243-tls-certs") pod "kube-auth-proxy-67cd644d69-pg99t" (UID: "101cde89-dec2-407b-85b4-ba133f974243") : secret "kube-auth-proxy-tls" not found Jul 24 12:22:01.968911 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:01.968880 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/101cde89-dec2-407b-85b4-ba133f974243-tmp\") pod \"kube-auth-proxy-67cd644d69-pg99t\" (UID: \"101cde89-dec2-407b-85b4-ba133f974243\") " pod="openshift-ingress/kube-auth-proxy-67cd644d69-pg99t" Jul 24 12:22:01.990287 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:01.990254 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z2p2\" (UniqueName: \"kubernetes.io/projected/101cde89-dec2-407b-85b4-ba133f974243-kube-api-access-5z2p2\") pod \"kube-auth-proxy-67cd644d69-pg99t\" (UID: \"101cde89-dec2-407b-85b4-ba133f974243\") " pod="openshift-ingress/kube-auth-proxy-67cd644d69-pg99t" Jul 24 12:22:02.216385 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:02.216347 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2kds8"] Jul 24 12:22:02.219492 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:02.219472 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2kds8" Jul 24 12:22:02.223021 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:02.222991 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 24 12:22:02.223177 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:02.223130 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-mk4rd\"" Jul 24 12:22:02.236379 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:02.236299 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2kds8"] Jul 24 12:22:02.269413 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:02.269371 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61e8ba4a-69c3-4fab-8c14-f1fe50dda8da-cert\") pod \"odh-model-controller-7998c67dc4-2kds8\" (UID: \"61e8ba4a-69c3-4fab-8c14-f1fe50dda8da\") " pod="opendatahub/odh-model-controller-7998c67dc4-2kds8" Jul 24 12:22:02.269603 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:02.269419 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhhvz\" (UniqueName: \"kubernetes.io/projected/61e8ba4a-69c3-4fab-8c14-f1fe50dda8da-kube-api-access-xhhvz\") pod \"odh-model-controller-7998c67dc4-2kds8\" (UID: \"61e8ba4a-69c3-4fab-8c14-f1fe50dda8da\") " pod="opendatahub/odh-model-controller-7998c67dc4-2kds8" Jul 24 12:22:02.370669 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:02.370624 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61e8ba4a-69c3-4fab-8c14-f1fe50dda8da-cert\") pod \"odh-model-controller-7998c67dc4-2kds8\" (UID: \"61e8ba4a-69c3-4fab-8c14-f1fe50dda8da\") " pod="opendatahub/odh-model-controller-7998c67dc4-2kds8" Jul 24 12:22:02.370868 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:02.370672 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhhvz\" (UniqueName: \"kubernetes.io/projected/61e8ba4a-69c3-4fab-8c14-f1fe50dda8da-kube-api-access-xhhvz\") pod \"odh-model-controller-7998c67dc4-2kds8\" (UID: \"61e8ba4a-69c3-4fab-8c14-f1fe50dda8da\") " pod="opendatahub/odh-model-controller-7998c67dc4-2kds8" Jul 24 12:22:02.370868 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:22:02.370788 2555 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 24 12:22:02.370868 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:22:02.370867 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61e8ba4a-69c3-4fab-8c14-f1fe50dda8da-cert podName:61e8ba4a-69c3-4fab-8c14-f1fe50dda8da nodeName:}" failed. No retries permitted until 2026-07-24 12:22:02.870845005 +0000 UTC m=+315.922089975 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/61e8ba4a-69c3-4fab-8c14-f1fe50dda8da-cert") pod "odh-model-controller-7998c67dc4-2kds8" (UID: "61e8ba4a-69c3-4fab-8c14-f1fe50dda8da") : secret "odh-model-controller-webhook-cert" not found Jul 24 12:22:02.396374 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:02.396343 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhhvz\" (UniqueName: \"kubernetes.io/projected/61e8ba4a-69c3-4fab-8c14-f1fe50dda8da-kube-api-access-xhhvz\") pod \"odh-model-controller-7998c67dc4-2kds8\" (UID: \"61e8ba4a-69c3-4fab-8c14-f1fe50dda8da\") " pod="opendatahub/odh-model-controller-7998c67dc4-2kds8" Jul 24 12:22:02.472427 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:02.472325 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/101cde89-dec2-407b-85b4-ba133f974243-tls-certs\") pod \"kube-auth-proxy-67cd644d69-pg99t\" (UID: \"101cde89-dec2-407b-85b4-ba133f974243\") " pod="openshift-ingress/kube-auth-proxy-67cd644d69-pg99t" Jul 24 12:22:02.474925 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:02.474897 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/101cde89-dec2-407b-85b4-ba133f974243-tls-certs\") pod \"kube-auth-proxy-67cd644d69-pg99t\" (UID: \"101cde89-dec2-407b-85b4-ba133f974243\") " pod="openshift-ingress/kube-auth-proxy-67cd644d69-pg99t" Jul 24 12:22:02.763516 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:02.763428 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-67cd644d69-pg99t" Jul 24 12:22:02.876379 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:02.875870 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61e8ba4a-69c3-4fab-8c14-f1fe50dda8da-cert\") pod \"odh-model-controller-7998c67dc4-2kds8\" (UID: \"61e8ba4a-69c3-4fab-8c14-f1fe50dda8da\") " pod="opendatahub/odh-model-controller-7998c67dc4-2kds8" Jul 24 12:22:02.878546 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:02.878523 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61e8ba4a-69c3-4fab-8c14-f1fe50dda8da-cert\") pod \"odh-model-controller-7998c67dc4-2kds8\" (UID: \"61e8ba4a-69c3-4fab-8c14-f1fe50dda8da\") " pod="opendatahub/odh-model-controller-7998c67dc4-2kds8" Jul 24 12:22:02.911502 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:02.911474 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-67cd644d69-pg99t"] Jul 24 12:22:02.913504 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:22:02.913477 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod101cde89_dec2_407b_85b4_ba133f974243.slice/crio-0926b8d87f233f8b21e84680e892eb38c71b8b0f55ea74f08be26d2c472b8944 WatchSource:0}: Error finding container 0926b8d87f233f8b21e84680e892eb38c71b8b0f55ea74f08be26d2c472b8944: Status 404 returned error can't find the container with id 0926b8d87f233f8b21e84680e892eb38c71b8b0f55ea74f08be26d2c472b8944 Jul 24 12:22:02.915183 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:02.915162 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 12:22:02.919863 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:02.919833 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-67cd644d69-pg99t" event={"ID":"101cde89-dec2-407b-85b4-ba133f974243","Type":"ContainerStarted","Data":"0926b8d87f233f8b21e84680e892eb38c71b8b0f55ea74f08be26d2c472b8944"} Jul 24 12:22:03.130254 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.130164 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2kds8" Jul 24 12:22:03.278730 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.278701 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2kds8"] Jul 24 12:22:03.280855 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:22:03.280824 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61e8ba4a_69c3_4fab_8c14_f1fe50dda8da.slice/crio-7b89c4eeedd421af3f90f4033f869292087a010436530fffa9cf2276b8189c25 WatchSource:0}: Error finding container 7b89c4eeedd421af3f90f4033f869292087a010436530fffa9cf2276b8189c25: Status 404 returned error can't find the container with id 7b89c4eeedd421af3f90f4033f869292087a010436530fffa9cf2276b8189c25 Jul 24 12:22:03.443942 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.443909 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fm44z"] Jul 24 12:22:03.448435 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.448414 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-fm44z" Jul 24 12:22:03.453159 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.453135 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 24 12:22:03.453291 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.453195 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-9bvlx\"" Jul 24 12:22:03.459765 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.459733 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fm44z"] Jul 24 12:22:03.480295 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.480251 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b4aba7d-334a-4dd0-acec-659860725298-tls-certs\") pod \"model-serving-api-54d89bd5fc-fm44z\" (UID: \"6b4aba7d-334a-4dd0-acec-659860725298\") " pod="opendatahub/model-serving-api-54d89bd5fc-fm44z" Jul 24 12:22:03.480605 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.480317 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqtws\" (UniqueName: \"kubernetes.io/projected/6b4aba7d-334a-4dd0-acec-659860725298-kube-api-access-bqtws\") pod \"model-serving-api-54d89bd5fc-fm44z\" (UID: \"6b4aba7d-334a-4dd0-acec-659860725298\") " pod="opendatahub/model-serving-api-54d89bd5fc-fm44z" Jul 24 12:22:03.581300 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.581268 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b4aba7d-334a-4dd0-acec-659860725298-tls-certs\") pod \"model-serving-api-54d89bd5fc-fm44z\" (UID: \"6b4aba7d-334a-4dd0-acec-659860725298\") " pod="opendatahub/model-serving-api-54d89bd5fc-fm44z" Jul 24 12:22:03.581467 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.581314 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqtws\" (UniqueName: \"kubernetes.io/projected/6b4aba7d-334a-4dd0-acec-659860725298-kube-api-access-bqtws\") pod \"model-serving-api-54d89bd5fc-fm44z\" (UID: \"6b4aba7d-334a-4dd0-acec-659860725298\") " pod="opendatahub/model-serving-api-54d89bd5fc-fm44z" Jul 24 12:22:03.583679 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.583651 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b4aba7d-334a-4dd0-acec-659860725298-tls-certs\") pod \"model-serving-api-54d89bd5fc-fm44z\" (UID: \"6b4aba7d-334a-4dd0-acec-659860725298\") " pod="opendatahub/model-serving-api-54d89bd5fc-fm44z" Jul 24 12:22:03.596454 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.596429 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqtws\" (UniqueName: \"kubernetes.io/projected/6b4aba7d-334a-4dd0-acec-659860725298-kube-api-access-bqtws\") pod \"model-serving-api-54d89bd5fc-fm44z\" (UID: \"6b4aba7d-334a-4dd0-acec-659860725298\") " pod="opendatahub/model-serving-api-54d89bd5fc-fm44z" Jul 24 12:22:03.718948 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.718859 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks"] Jul 24 12:22:03.722622 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.722597 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks" Jul 24 12:22:03.725619 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.725596 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 24 12:22:03.725759 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.725597 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 24 12:22:03.725934 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.725916 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 24 12:22:03.726284 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.726259 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 24 12:22:03.726399 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.726264 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-677fb\"" Jul 24 12:22:03.741236 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.741211 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks"] Jul 24 12:22:03.761319 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.761286 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-fm44z" Jul 24 12:22:03.782809 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.782781 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-92tks\" (UID: \"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks" Jul 24 12:22:03.782941 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.782815 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrsbd\" (UniqueName: \"kubernetes.io/projected/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-kube-api-access-mrsbd\") pod \"istiod-openshift-gateway-7b7995d5cd-92tks\" (UID: \"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks" Jul 24 12:22:03.782941 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.782834 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-92tks\" (UID: \"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks" Jul 24 12:22:03.782941 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.782857 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-92tks\" (UID: \"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks" Jul 24 12:22:03.782941 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.782891 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-92tks\" (UID: \"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks" Jul 24 12:22:03.783171 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.782955 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-92tks\" (UID: \"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks" Jul 24 12:22:03.783171 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.783019 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-92tks\" (UID: \"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks" Jul 24 12:22:03.883774 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.883727 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-92tks\" (UID: \"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks" Jul 24 12:22:03.884206 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.883808 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-92tks\" (UID: \"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks" Jul 24 12:22:03.884206 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.883838 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrsbd\" (UniqueName: \"kubernetes.io/projected/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-kube-api-access-mrsbd\") pod \"istiod-openshift-gateway-7b7995d5cd-92tks\" (UID: \"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks" Jul 24 12:22:03.884206 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.883865 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-92tks\" (UID: \"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks" Jul 24 12:22:03.884206 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.883900 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-92tks\" (UID: \"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks" Jul 24 12:22:03.884206 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.883962 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-92tks\" (UID: \"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks" Jul 24 12:22:03.884206 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.884014 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-92tks\" (UID: \"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks" Jul 24 12:22:03.891598 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.890847 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-92tks\" (UID: \"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks" Jul 24 12:22:03.898075 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.892872 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-92tks\" (UID: \"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks" Jul 24 12:22:03.898449 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.898390 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-92tks\" (UID: \"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks" Jul 24 12:22:03.899198 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.898858 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-92tks\" (UID: \"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks" Jul 24 12:22:03.900510 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.899954 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-92tks\" (UID: \"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks" Jul 24 12:22:03.904367 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.904262 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-92tks\" (UID: \"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks" Jul 24 12:22:03.905477 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.904780 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrsbd\" (UniqueName: \"kubernetes.io/projected/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-kube-api-access-mrsbd\") pod \"istiod-openshift-gateway-7b7995d5cd-92tks\" (UID: \"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks" Jul 24 12:22:03.927262 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.927224 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2kds8" event={"ID":"61e8ba4a-69c3-4fab-8c14-f1fe50dda8da","Type":"ContainerStarted","Data":"7b89c4eeedd421af3f90f4033f869292087a010436530fffa9cf2276b8189c25"} Jul 24 12:22:03.943825 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:03.943790 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fm44z"] Jul 24 12:22:03.948959 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:22:03.948912 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b4aba7d_334a_4dd0_acec_659860725298.slice/crio-b1b4794bc74eb7745fe6a1d432cfbfa93682cb85c1d493da4d1da666b1cfdfc4 WatchSource:0}: Error finding container b1b4794bc74eb7745fe6a1d432cfbfa93682cb85c1d493da4d1da666b1cfdfc4: Status 404 returned error can't find the container with id b1b4794bc74eb7745fe6a1d432cfbfa93682cb85c1d493da4d1da666b1cfdfc4 Jul 24 12:22:04.036781 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:04.036694 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks" Jul 24 12:22:04.257285 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:04.256609 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks"] Jul 24 12:22:04.262821 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:22:04.262787 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83d65b29_98d9_4ee3_88a1_b3fe28dbfe61.slice/crio-b6c6fc581bdde07c16de3ee7eec1c47b1b27b33ea7266454b121f711db6f3e7e WatchSource:0}: Error finding container b6c6fc581bdde07c16de3ee7eec1c47b1b27b33ea7266454b121f711db6f3e7e: Status 404 returned error can't find the container with id b6c6fc581bdde07c16de3ee7eec1c47b1b27b33ea7266454b121f711db6f3e7e Jul 24 12:22:04.940476 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:04.940408 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks" event={"ID":"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61","Type":"ContainerStarted","Data":"b6c6fc581bdde07c16de3ee7eec1c47b1b27b33ea7266454b121f711db6f3e7e"} Jul 24 12:22:04.944488 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:04.944448 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-fm44z" event={"ID":"6b4aba7d-334a-4dd0-acec-659860725298","Type":"ContainerStarted","Data":"b1b4794bc74eb7745fe6a1d432cfbfa93682cb85c1d493da4d1da666b1cfdfc4"} Jul 24 12:22:08.833260 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:08.833219 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 12:22:08.833657 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:08.833305 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 12:22:08.970235 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:08.969683 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks" event={"ID":"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61","Type":"ContainerStarted","Data":"3621090c059769d82eff2acf946c6fadf3bcc7b6365eb39df3fdd23329e21409"} Jul 24 12:22:08.970868 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:08.970619 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks" Jul 24 12:22:08.972579 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:08.972518 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-fm44z" event={"ID":"6b4aba7d-334a-4dd0-acec-659860725298","Type":"ContainerStarted","Data":"47503a8ca2f88b9eceeab3a5707c1cfc940529340db89c415ed697e6c1745f59"} Jul 24 12:22:08.972752 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:08.972726 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-fm44z" Jul 24 12:22:08.974647 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:08.974623 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-67cd644d69-pg99t" event={"ID":"101cde89-dec2-407b-85b4-ba133f974243","Type":"ContainerStarted","Data":"dc03b6276dcbad17858d4b12375003b095608baeafed5ebf036419cd32f14ae4"} Jul 24 12:22:08.976854 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:08.976832 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2kds8" event={"ID":"61e8ba4a-69c3-4fab-8c14-f1fe50dda8da","Type":"ContainerStarted","Data":"16f0d82979328aed26b470afebf87e90511ee92c994170006717aa7489526946"} Jul 24 12:22:08.976990 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:08.976978 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-2kds8" Jul 24 12:22:08.992347 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:08.992304 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks" podStartSLOduration=1.427232269 podStartE2EDuration="5.992290828s" totalImagesPullingTime="4.565058559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:22:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:22:08.990495835 +0000 UTC m=+322.041740863" watchObservedRunningTime="2026-07-24 12:22:08.992290828 +0000 UTC m=+322.043535798" Jul 24 12:22:09.008540 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:09.008433 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-fm44z" podStartSLOduration=1.139580215 podStartE2EDuration="6.00841382s" totalImagesPullingTime="4.868833605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:22:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:22:09.006301793 +0000 UTC m=+322.057546805" watchObservedRunningTime="2026-07-24 12:22:09.00841382 +0000 UTC m=+322.059658815" Jul 24 12:22:09.021953 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:09.021900 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-67cd644d69-pg99t" podStartSLOduration=2.179584607 podStartE2EDuration="8.02188242s" totalImagesPullingTime="5.842297813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:22:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:22:09.021621536 +0000 UTC m=+322.072866547" watchObservedRunningTime="2026-07-24 12:22:09.02188242 +0000 UTC m=+322.073127414" Jul 24 12:22:09.038262 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:09.038197 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-2kds8" podStartSLOduration=1.486678863 podStartE2EDuration="7.038176223s" totalImagesPullingTime="5.55149736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:22:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:22:09.036720538 +0000 UTC m=+322.087965559" watchObservedRunningTime="2026-07-24 12:22:09.038176223 +0000 UTC m=+322.089421218" Jul 24 12:22:09.984027 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:09.983985 2555 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-92tks container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 24 12:22:09.984490 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:09.984109 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks" podUID="83d65b29-98d9-4ee3-88a1-b3fe28dbfe61" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 24 12:22:10.986933 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:10.986906 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks" Jul 24 12:22:13.785129 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:13.785088 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7rz8z"] Jul 24 12:22:13.788616 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:13.788595 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7rz8z" Jul 24 12:22:13.791257 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:13.791232 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 24 12:22:13.791387 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:13.791369 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-trn4f\"" Jul 24 12:22:13.800793 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:13.800770 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7rz8z"] Jul 24 12:22:13.879885 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:13.879856 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62tp8\" (UniqueName: \"kubernetes.io/projected/9f95c269-50e4-4cc3-a313-3fe31558e657-kube-api-access-62tp8\") pod \"kserve-controller-manager-d6f4b65b8-7rz8z\" (UID: \"9f95c269-50e4-4cc3-a313-3fe31558e657\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7rz8z" Jul 24 12:22:13.880099 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:13.879897 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f95c269-50e4-4cc3-a313-3fe31558e657-cert\") pod \"kserve-controller-manager-d6f4b65b8-7rz8z\" (UID: \"9f95c269-50e4-4cc3-a313-3fe31558e657\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7rz8z" Jul 24 12:22:13.981224 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:13.981191 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f95c269-50e4-4cc3-a313-3fe31558e657-cert\") pod \"kserve-controller-manager-d6f4b65b8-7rz8z\" (UID: \"9f95c269-50e4-4cc3-a313-3fe31558e657\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7rz8z" Jul 24 12:22:13.981405 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:13.981279 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62tp8\" (UniqueName: \"kubernetes.io/projected/9f95c269-50e4-4cc3-a313-3fe31558e657-kube-api-access-62tp8\") pod \"kserve-controller-manager-d6f4b65b8-7rz8z\" (UID: \"9f95c269-50e4-4cc3-a313-3fe31558e657\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7rz8z" Jul 24 12:22:13.983639 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:13.983617 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f95c269-50e4-4cc3-a313-3fe31558e657-cert\") pod \"kserve-controller-manager-d6f4b65b8-7rz8z\" (UID: \"9f95c269-50e4-4cc3-a313-3fe31558e657\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7rz8z" Jul 24 12:22:14.003888 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:14.003855 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62tp8\" (UniqueName: \"kubernetes.io/projected/9f95c269-50e4-4cc3-a313-3fe31558e657-kube-api-access-62tp8\") pod \"kserve-controller-manager-d6f4b65b8-7rz8z\" (UID: \"9f95c269-50e4-4cc3-a313-3fe31558e657\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7rz8z" Jul 24 12:22:14.100373 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:14.100298 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7rz8z" Jul 24 12:22:14.235937 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:14.235912 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7rz8z"] Jul 24 12:22:14.238106 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:22:14.238055 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f95c269_50e4_4cc3_a313_3fe31558e657.slice/crio-b011be435cc66827d14910764adc5cc8cef82e070707418fbae7de8f83668643 WatchSource:0}: Error finding container b011be435cc66827d14910764adc5cc8cef82e070707418fbae7de8f83668643: Status 404 returned error can't find the container with id b011be435cc66827d14910764adc5cc8cef82e070707418fbae7de8f83668643 Jul 24 12:22:15.005017 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:15.004980 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7rz8z" event={"ID":"9f95c269-50e4-4cc3-a313-3fe31558e657","Type":"ContainerStarted","Data":"b011be435cc66827d14910764adc5cc8cef82e070707418fbae7de8f83668643"} Jul 24 12:22:16.687986 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:16.687953 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks"] Jul 24 12:22:16.688438 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:16.688157 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks" podUID="83d65b29-98d9-4ee3-88a1-b3fe28dbfe61" containerName="discovery" containerID="cri-o://3621090c059769d82eff2acf946c6fadf3bcc7b6365eb39df3fdd23329e21409" gracePeriod=30 Jul 24 12:22:16.987112 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:16.987006 2555 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-92tks container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.30:8080/ready\": dial tcp 10.132.0.30:8080: connect: connection refused" start-of-body= Jul 24 12:22:16.987283 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:16.987099 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks" podUID="83d65b29-98d9-4ee3-88a1-b3fe28dbfe61" containerName="discovery" probeResult="failure" output="Get \"http://10.132.0.30:8080/ready\": dial tcp 10.132.0.30:8080: connect: connection refused" Jul 24 12:22:17.176381 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:17.176339 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks" Jul 24 12:22:17.315232 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:17.315124 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-istio-csr-ca-configmap\") pod \"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61\" (UID: \"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61\") " Jul 24 12:22:17.315232 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:17.315193 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-istio-token\") pod \"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61\" (UID: \"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61\") " Jul 24 12:22:17.315460 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:17.315234 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-istio-kubeconfig\") pod \"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61\" (UID: \"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61\") " Jul 24 12:22:17.315460 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:17.315311 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-istio-csr-dns-cert\") pod \"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61\" (UID: \"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61\") " Jul 24 12:22:17.315460 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:17.315335 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-local-certs\") pod \"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61\" (UID: \"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61\") " Jul 24 12:22:17.315460 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:17.315368 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrsbd\" (UniqueName: \"kubernetes.io/projected/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-kube-api-access-mrsbd\") pod \"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61\" (UID: \"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61\") " Jul 24 12:22:17.315460 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:17.315396 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-cacerts\") pod \"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61\" (UID: \"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61\") " Jul 24 12:22:17.315724 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:17.315634 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "83d65b29-98d9-4ee3-88a1-b3fe28dbfe61" (UID: "83d65b29-98d9-4ee3-88a1-b3fe28dbfe61"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 12:22:17.317738 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:17.317697 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-local-certs" (OuterVolumeSpecName: "local-certs") pod "83d65b29-98d9-4ee3-88a1-b3fe28dbfe61" (UID: "83d65b29-98d9-4ee3-88a1-b3fe28dbfe61"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 12:22:17.317872 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:17.317805 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "83d65b29-98d9-4ee3-88a1-b3fe28dbfe61" (UID: "83d65b29-98d9-4ee3-88a1-b3fe28dbfe61"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 12:22:17.317872 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:17.317811 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-istio-token" (OuterVolumeSpecName: "istio-token") pod "83d65b29-98d9-4ee3-88a1-b3fe28dbfe61" (UID: "83d65b29-98d9-4ee3-88a1-b3fe28dbfe61"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 12:22:17.317974 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:17.317914 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "83d65b29-98d9-4ee3-88a1-b3fe28dbfe61" (UID: "83d65b29-98d9-4ee3-88a1-b3fe28dbfe61"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 12:22:17.317974 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:17.317926 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-cacerts" (OuterVolumeSpecName: "cacerts") pod "83d65b29-98d9-4ee3-88a1-b3fe28dbfe61" (UID: "83d65b29-98d9-4ee3-88a1-b3fe28dbfe61"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 12:22:17.318087 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:17.318028 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-kube-api-access-mrsbd" (OuterVolumeSpecName: "kube-api-access-mrsbd") pod "83d65b29-98d9-4ee3-88a1-b3fe28dbfe61" (UID: "83d65b29-98d9-4ee3-88a1-b3fe28dbfe61"). InnerVolumeSpecName "kube-api-access-mrsbd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 12:22:17.416222 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:17.416181 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-istio-token\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jul 24 12:22:17.416222 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:17.416214 2555 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-istio-kubeconfig\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jul 24 12:22:17.416222 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:17.416223 2555 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-istio-csr-dns-cert\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jul 24 12:22:17.416222 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:17.416233 2555 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-local-certs\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jul 24 12:22:17.416576 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:17.416241 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrsbd\" (UniqueName: \"kubernetes.io/projected/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-kube-api-access-mrsbd\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jul 24 12:22:17.416576 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:17.416250 2555 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-cacerts\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jul 24 12:22:17.416576 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:17.416259 2555 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61-istio-csr-ca-configmap\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jul 24 12:22:18.021141 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:18.021099 2555 generic.go:356] "Generic (PLEG): container finished" podID="83d65b29-98d9-4ee3-88a1-b3fe28dbfe61" containerID="3621090c059769d82eff2acf946c6fadf3bcc7b6365eb39df3fdd23329e21409" exitCode=0 Jul 24 12:22:18.021706 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:18.021197 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks" Jul 24 12:22:18.021706 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:18.021219 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks" event={"ID":"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61","Type":"ContainerDied","Data":"3621090c059769d82eff2acf946c6fadf3bcc7b6365eb39df3fdd23329e21409"} Jul 24 12:22:18.021706 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:18.021272 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks" event={"ID":"83d65b29-98d9-4ee3-88a1-b3fe28dbfe61","Type":"ContainerDied","Data":"b6c6fc581bdde07c16de3ee7eec1c47b1b27b33ea7266454b121f711db6f3e7e"} Jul 24 12:22:18.021706 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:18.021299 2555 scope.go:117] "RemoveContainer" containerID="3621090c059769d82eff2acf946c6fadf3bcc7b6365eb39df3fdd23329e21409" Jul 24 12:22:18.023087 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:18.023043 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7rz8z" event={"ID":"9f95c269-50e4-4cc3-a313-3fe31558e657","Type":"ContainerStarted","Data":"88036510d39eeebc07d204ed0d09de4318af9e3215add7ea21dc1724a0266e41"} Jul 24 12:22:18.023476 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:18.023167 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7rz8z" Jul 24 12:22:18.030386 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:18.030363 2555 scope.go:117] "RemoveContainer" containerID="3621090c059769d82eff2acf946c6fadf3bcc7b6365eb39df3fdd23329e21409" Jul 24 12:22:18.030666 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:22:18.030645 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3621090c059769d82eff2acf946c6fadf3bcc7b6365eb39df3fdd23329e21409\": container with ID starting with 3621090c059769d82eff2acf946c6fadf3bcc7b6365eb39df3fdd23329e21409 not found: ID does not exist" containerID="3621090c059769d82eff2acf946c6fadf3bcc7b6365eb39df3fdd23329e21409" Jul 24 12:22:18.030740 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:18.030692 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3621090c059769d82eff2acf946c6fadf3bcc7b6365eb39df3fdd23329e21409"} err="failed to get container status \"3621090c059769d82eff2acf946c6fadf3bcc7b6365eb39df3fdd23329e21409\": rpc error: code = NotFound desc = could not find container \"3621090c059769d82eff2acf946c6fadf3bcc7b6365eb39df3fdd23329e21409\": container with ID starting with 3621090c059769d82eff2acf946c6fadf3bcc7b6365eb39df3fdd23329e21409 not found: ID does not exist" Jul 24 12:22:18.109722 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:18.109670 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7rz8z" podStartSLOduration=2.267273891 podStartE2EDuration="5.109653358s" totalImagesPullingTime="2.842379467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:22:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:22:18.058599212 +0000 UTC m=+331.109844204" watchObservedRunningTime="2026-07-24 12:22:18.109653358 +0000 UTC m=+331.160898350" Jul 24 12:22:18.110680 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:18.110661 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks"] Jul 24 12:22:18.119642 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:18.119617 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-92tks"] Jul 24 12:22:19.422453 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:19.422419 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83d65b29-98d9-4ee3-88a1-b3fe28dbfe61" path="/var/lib/kubelet/pods/83d65b29-98d9-4ee3-88a1-b3fe28dbfe61/volumes" Jul 24 12:22:19.984244 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:19.984214 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-2kds8" Jul 24 12:22:19.985933 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:19.985913 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-fm44z" Jul 24 12:22:49.033995 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:22:49.033960 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7rz8z" Jul 24 12:23:02.970322 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:02.970275 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-56gf5"] Jul 24 12:23:02.970737 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:02.970649 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83d65b29-98d9-4ee3-88a1-b3fe28dbfe61" containerName="discovery" Jul 24 12:23:02.970737 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:02.970661 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="83d65b29-98d9-4ee3-88a1-b3fe28dbfe61" containerName="discovery" Jul 24 12:23:02.970737 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:02.970720 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="83d65b29-98d9-4ee3-88a1-b3fe28dbfe61" containerName="discovery" Jul 24 12:23:02.980619 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:02.980586 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-56gf5" Jul 24 12:23:02.983496 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:02.983461 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 24 12:23:02.983653 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:02.983469 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 24 12:23:02.984526 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:02.984506 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-sgbj2\"" Jul 24 12:23:02.992830 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:02.992801 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-56gf5"] Jul 24 12:23:03.101943 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:03.101907 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lktsv\" (UniqueName: \"kubernetes.io/projected/977a6534-fd34-44e5-ba82-eee51744e4ae-kube-api-access-lktsv\") pod \"kuadrant-operator-catalog-56gf5\" (UID: \"977a6534-fd34-44e5-ba82-eee51744e4ae\") " pod="kuadrant-system/kuadrant-operator-catalog-56gf5" Jul 24 12:23:03.202784 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:03.202745 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lktsv\" (UniqueName: \"kubernetes.io/projected/977a6534-fd34-44e5-ba82-eee51744e4ae-kube-api-access-lktsv\") pod \"kuadrant-operator-catalog-56gf5\" (UID: \"977a6534-fd34-44e5-ba82-eee51744e4ae\") " pod="kuadrant-system/kuadrant-operator-catalog-56gf5" Jul 24 12:23:03.217780 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:03.217749 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lktsv\" (UniqueName: \"kubernetes.io/projected/977a6534-fd34-44e5-ba82-eee51744e4ae-kube-api-access-lktsv\") pod \"kuadrant-operator-catalog-56gf5\" (UID: \"977a6534-fd34-44e5-ba82-eee51744e4ae\") " pod="kuadrant-system/kuadrant-operator-catalog-56gf5" Jul 24 12:23:03.290384 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:03.290300 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-56gf5"] Jul 24 12:23:03.290588 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:03.290576 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-56gf5" Jul 24 12:23:03.437347 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:03.437320 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-56gf5"] Jul 24 12:23:03.440082 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:23:03.440046 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod977a6534_fd34_44e5_ba82_eee51744e4ae.slice/crio-9cb2112904b8dc1dbca8b2d50ffc0ee13a684c6147ebba436e5fd49c9d26e659 WatchSource:0}: Error finding container 9cb2112904b8dc1dbca8b2d50ffc0ee13a684c6147ebba436e5fd49c9d26e659: Status 404 returned error can't find the container with id 9cb2112904b8dc1dbca8b2d50ffc0ee13a684c6147ebba436e5fd49c9d26e659 Jul 24 12:23:03.506178 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:03.506145 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jh7vg"] Jul 24 12:23:03.511131 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:03.511110 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jh7vg" Jul 24 12:23:03.524163 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:03.524137 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jh7vg"] Jul 24 12:23:03.605541 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:03.605443 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhchx\" (UniqueName: \"kubernetes.io/projected/1e54c057-f582-4896-aaa6-2b13f8a5d387-kube-api-access-rhchx\") pod \"kuadrant-operator-catalog-jh7vg\" (UID: \"1e54c057-f582-4896-aaa6-2b13f8a5d387\") " pod="kuadrant-system/kuadrant-operator-catalog-jh7vg" Jul 24 12:23:03.706649 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:03.706612 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhchx\" (UniqueName: \"kubernetes.io/projected/1e54c057-f582-4896-aaa6-2b13f8a5d387-kube-api-access-rhchx\") pod \"kuadrant-operator-catalog-jh7vg\" (UID: \"1e54c057-f582-4896-aaa6-2b13f8a5d387\") " pod="kuadrant-system/kuadrant-operator-catalog-jh7vg" Jul 24 12:23:03.715370 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:03.715339 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhchx\" (UniqueName: \"kubernetes.io/projected/1e54c057-f582-4896-aaa6-2b13f8a5d387-kube-api-access-rhchx\") pod \"kuadrant-operator-catalog-jh7vg\" (UID: \"1e54c057-f582-4896-aaa6-2b13f8a5d387\") " pod="kuadrant-system/kuadrant-operator-catalog-jh7vg" Jul 24 12:23:03.821411 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:03.821373 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jh7vg" Jul 24 12:23:03.970602 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:03.970567 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jh7vg"] Jul 24 12:23:03.974651 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:23:03.974613 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e54c057_f582_4896_aaa6_2b13f8a5d387.slice/crio-6b711b457af4a3c4517122c4cc66b366565053cfdd2d159715d5a1f890904009 WatchSource:0}: Error finding container 6b711b457af4a3c4517122c4cc66b366565053cfdd2d159715d5a1f890904009: Status 404 returned error can't find the container with id 6b711b457af4a3c4517122c4cc66b366565053cfdd2d159715d5a1f890904009 Jul 24 12:23:04.237025 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:04.236986 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-56gf5" event={"ID":"977a6534-fd34-44e5-ba82-eee51744e4ae","Type":"ContainerStarted","Data":"9cb2112904b8dc1dbca8b2d50ffc0ee13a684c6147ebba436e5fd49c9d26e659"} Jul 24 12:23:04.238249 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:04.238222 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jh7vg" event={"ID":"1e54c057-f582-4896-aaa6-2b13f8a5d387","Type":"ContainerStarted","Data":"6b711b457af4a3c4517122c4cc66b366565053cfdd2d159715d5a1f890904009"} Jul 24 12:23:06.251710 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:06.251658 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jh7vg" event={"ID":"1e54c057-f582-4896-aaa6-2b13f8a5d387","Type":"ContainerStarted","Data":"0af8094c6a83ed07ac0891e621ee17cff579f8b0d2187b799447464f6328a255"} Jul 24 12:23:06.253295 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:06.253264 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-56gf5" event={"ID":"977a6534-fd34-44e5-ba82-eee51744e4ae","Type":"ContainerStarted","Data":"605121bd798c1cc66cf8d357364596f0c5298522abc460ac1d6d6d1c0d59cf27"} Jul 24 12:23:06.253432 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:06.253325 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-56gf5" podUID="977a6534-fd34-44e5-ba82-eee51744e4ae" containerName="registry-server" containerID="cri-o://605121bd798c1cc66cf8d357364596f0c5298522abc460ac1d6d6d1c0d59cf27" gracePeriod=2 Jul 24 12:23:06.268901 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:06.268852 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-jh7vg" podStartSLOduration=1.460746252 podStartE2EDuration="3.268837519s" totalImagesPullingTime="1.808091267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:23:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:23:06.267505552 +0000 UTC m=+379.318750545" watchObservedRunningTime="2026-07-24 12:23:06.268837519 +0000 UTC m=+379.320082511" Jul 24 12:23:06.275587 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:23:06.275557 2555 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod977a6534_fd34_44e5_ba82_eee51744e4ae.slice/crio-605121bd798c1cc66cf8d357364596f0c5298522abc460ac1d6d6d1c0d59cf27.scope\": RecentStats: unable to find data in memory cache]" Jul 24 12:23:06.288365 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:06.288306 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-56gf5" podStartSLOduration=2.112204246 podStartE2EDuration="4.28828884s" totalImagesPullingTime="2.176084594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:23:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:23:06.286553257 +0000 UTC m=+379.337798249" watchObservedRunningTime="2026-07-24 12:23:06.28828884 +0000 UTC m=+379.339533832" Jul 24 12:23:06.504625 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:06.504559 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-56gf5" Jul 24 12:23:06.630909 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:06.630872 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lktsv\" (UniqueName: \"kubernetes.io/projected/977a6534-fd34-44e5-ba82-eee51744e4ae-kube-api-access-lktsv\") pod \"977a6534-fd34-44e5-ba82-eee51744e4ae\" (UID: \"977a6534-fd34-44e5-ba82-eee51744e4ae\") " Jul 24 12:23:06.632938 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:06.632908 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/977a6534-fd34-44e5-ba82-eee51744e4ae-kube-api-access-lktsv" (OuterVolumeSpecName: "kube-api-access-lktsv") pod "977a6534-fd34-44e5-ba82-eee51744e4ae" (UID: "977a6534-fd34-44e5-ba82-eee51744e4ae"). InnerVolumeSpecName "kube-api-access-lktsv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 12:23:06.731889 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:06.731846 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lktsv\" (UniqueName: \"kubernetes.io/projected/977a6534-fd34-44e5-ba82-eee51744e4ae-kube-api-access-lktsv\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jul 24 12:23:07.259133 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:07.259093 2555 generic.go:356] "Generic (PLEG): container finished" podID="977a6534-fd34-44e5-ba82-eee51744e4ae" containerID="605121bd798c1cc66cf8d357364596f0c5298522abc460ac1d6d6d1c0d59cf27" exitCode=0 Jul 24 12:23:07.259133 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:07.259123 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-56gf5" Jul 24 12:23:07.259632 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:07.259166 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-56gf5" event={"ID":"977a6534-fd34-44e5-ba82-eee51744e4ae","Type":"ContainerDied","Data":"605121bd798c1cc66cf8d357364596f0c5298522abc460ac1d6d6d1c0d59cf27"} Jul 24 12:23:07.259632 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:07.259214 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-56gf5" event={"ID":"977a6534-fd34-44e5-ba82-eee51744e4ae","Type":"ContainerDied","Data":"9cb2112904b8dc1dbca8b2d50ffc0ee13a684c6147ebba436e5fd49c9d26e659"} Jul 24 12:23:07.259632 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:07.259236 2555 scope.go:117] "RemoveContainer" containerID="605121bd798c1cc66cf8d357364596f0c5298522abc460ac1d6d6d1c0d59cf27" Jul 24 12:23:07.268717 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:07.268693 2555 scope.go:117] "RemoveContainer" containerID="605121bd798c1cc66cf8d357364596f0c5298522abc460ac1d6d6d1c0d59cf27" Jul 24 12:23:07.269013 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:23:07.268997 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"605121bd798c1cc66cf8d357364596f0c5298522abc460ac1d6d6d1c0d59cf27\": container with ID starting with 605121bd798c1cc66cf8d357364596f0c5298522abc460ac1d6d6d1c0d59cf27 not found: ID does not exist" containerID="605121bd798c1cc66cf8d357364596f0c5298522abc460ac1d6d6d1c0d59cf27" Jul 24 12:23:07.269054 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:07.269026 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"605121bd798c1cc66cf8d357364596f0c5298522abc460ac1d6d6d1c0d59cf27"} err="failed to get container status \"605121bd798c1cc66cf8d357364596f0c5298522abc460ac1d6d6d1c0d59cf27\": rpc error: code = NotFound desc = could not find container \"605121bd798c1cc66cf8d357364596f0c5298522abc460ac1d6d6d1c0d59cf27\": container with ID starting with 605121bd798c1cc66cf8d357364596f0c5298522abc460ac1d6d6d1c0d59cf27 not found: ID does not exist" Jul 24 12:23:07.284995 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:07.284958 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-56gf5"] Jul 24 12:23:07.299704 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:07.299666 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-56gf5"] Jul 24 12:23:07.422547 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:07.422512 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="977a6534-fd34-44e5-ba82-eee51744e4ae" path="/var/lib/kubelet/pods/977a6534-fd34-44e5-ba82-eee51744e4ae/volumes" Jul 24 12:23:13.822217 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:13.822177 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-jh7vg" Jul 24 12:23:13.822748 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:13.822244 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-jh7vg" Jul 24 12:23:13.844277 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:13.844249 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-jh7vg" Jul 24 12:23:14.315484 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:14.315451 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-jh7vg" Jul 24 12:23:35.388723 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:35.388670 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hppg"] Jul 24 12:23:35.389290 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:35.389046 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="977a6534-fd34-44e5-ba82-eee51744e4ae" containerName="registry-server" Jul 24 12:23:35.389290 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:35.389083 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="977a6534-fd34-44e5-ba82-eee51744e4ae" containerName="registry-server" Jul 24 12:23:35.389290 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:35.389176 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="977a6534-fd34-44e5-ba82-eee51744e4ae" containerName="registry-server" Jul 24 12:23:35.395579 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:35.395551 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hppg" Jul 24 12:23:35.403360 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:35.403340 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-cgcj6\"" Jul 24 12:23:35.403486 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:35.403464 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 24 12:23:35.414267 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:35.414237 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hppg"] Jul 24 12:23:35.590637 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:35.590604 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnj7j\" (UniqueName: \"kubernetes.io/projected/cfd48e50-ba58-493a-961c-cf746c97ce53-kube-api-access-cnj7j\") pod \"dns-operator-controller-manager-864dd78c4c-9hppg\" (UID: \"cfd48e50-ba58-493a-961c-cf746c97ce53\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hppg" Jul 24 12:23:35.691586 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:35.691546 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnj7j\" (UniqueName: \"kubernetes.io/projected/cfd48e50-ba58-493a-961c-cf746c97ce53-kube-api-access-cnj7j\") pod \"dns-operator-controller-manager-864dd78c4c-9hppg\" (UID: \"cfd48e50-ba58-493a-961c-cf746c97ce53\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hppg" Jul 24 12:23:35.701113 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:35.701085 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnj7j\" (UniqueName: \"kubernetes.io/projected/cfd48e50-ba58-493a-961c-cf746c97ce53-kube-api-access-cnj7j\") pod \"dns-operator-controller-manager-864dd78c4c-9hppg\" (UID: \"cfd48e50-ba58-493a-961c-cf746c97ce53\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hppg" Jul 24 12:23:35.705927 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:35.705897 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hppg" Jul 24 12:23:35.848545 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:35.848519 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hppg"] Jul 24 12:23:35.850822 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:23:35.850791 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfd48e50_ba58_493a_961c_cf746c97ce53.slice/crio-42d3865ed9e800d05ca2625ae753c597b998fb1c70c6f4a219052f43b2d78aa5 WatchSource:0}: Error finding container 42d3865ed9e800d05ca2625ae753c597b998fb1c70c6f4a219052f43b2d78aa5: Status 404 returned error can't find the container with id 42d3865ed9e800d05ca2625ae753c597b998fb1c70c6f4a219052f43b2d78aa5 Jul 24 12:23:36.398420 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:36.398385 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hppg" event={"ID":"cfd48e50-ba58-493a-961c-cf746c97ce53","Type":"ContainerStarted","Data":"42d3865ed9e800d05ca2625ae753c597b998fb1c70c6f4a219052f43b2d78aa5"} Jul 24 12:23:38.408860 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:38.408820 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hppg" event={"ID":"cfd48e50-ba58-493a-961c-cf746c97ce53","Type":"ContainerStarted","Data":"5a1cb6011a7a09d84f39d4447fb40fbb3a32686e1325d349ac3af818e3c9fea1"} Jul 24 12:23:38.409281 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:38.408931 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hppg" Jul 24 12:23:38.436718 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:38.436665 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hppg" podStartSLOduration=1.423045545 podStartE2EDuration="3.436649206s" totalImagesPullingTime="2.013603661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:23:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:23:38.435704932 +0000 UTC m=+411.486949925" watchObservedRunningTime="2026-07-24 12:23:38.436649206 +0000 UTC m=+411.487894246" Jul 24 12:23:38.898781 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:38.898690 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nq2jq"] Jul 24 12:23:38.902351 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:38.902324 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nq2jq" Jul 24 12:23:38.905084 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:38.905036 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-p2nsm\"" Jul 24 12:23:38.917098 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:38.917044 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p58rr\" (UniqueName: \"kubernetes.io/projected/d3b2dcf5-c93d-44c0-9f58-0c93c2824a26-kube-api-access-p58rr\") pod \"limitador-operator-controller-manager-859d7b78bd-nq2jq\" (UID: \"d3b2dcf5-c93d-44c0-9f58-0c93c2824a26\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nq2jq" Jul 24 12:23:38.928874 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:38.928839 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nq2jq"] Jul 24 12:23:39.017925 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:39.017882 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p58rr\" (UniqueName: \"kubernetes.io/projected/d3b2dcf5-c93d-44c0-9f58-0c93c2824a26-kube-api-access-p58rr\") pod \"limitador-operator-controller-manager-859d7b78bd-nq2jq\" (UID: \"d3b2dcf5-c93d-44c0-9f58-0c93c2824a26\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nq2jq" Jul 24 12:23:39.031423 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:39.031394 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p58rr\" (UniqueName: \"kubernetes.io/projected/d3b2dcf5-c93d-44c0-9f58-0c93c2824a26-kube-api-access-p58rr\") pod \"limitador-operator-controller-manager-859d7b78bd-nq2jq\" (UID: \"d3b2dcf5-c93d-44c0-9f58-0c93c2824a26\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nq2jq" Jul 24 12:23:39.212840 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:39.212797 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nq2jq" Jul 24 12:23:39.368921 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:39.368888 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nq2jq"] Jul 24 12:23:39.370867 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:23:39.370835 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3b2dcf5_c93d_44c0_9f58_0c93c2824a26.slice/crio-f3fc86984c7421baeb0c6b4e8d74339d549376417832cbabe2349e971dcd1fd3 WatchSource:0}: Error finding container f3fc86984c7421baeb0c6b4e8d74339d549376417832cbabe2349e971dcd1fd3: Status 404 returned error can't find the container with id f3fc86984c7421baeb0c6b4e8d74339d549376417832cbabe2349e971dcd1fd3 Jul 24 12:23:39.415084 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:39.415018 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nq2jq" event={"ID":"d3b2dcf5-c93d-44c0-9f58-0c93c2824a26","Type":"ContainerStarted","Data":"f3fc86984c7421baeb0c6b4e8d74339d549376417832cbabe2349e971dcd1fd3"} Jul 24 12:23:41.425347 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:41.425310 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nq2jq" event={"ID":"d3b2dcf5-c93d-44c0-9f58-0c93c2824a26","Type":"ContainerStarted","Data":"356b1786014e7a2fc08b315eb84ce5bb1d3a36a21e8c7bda964a388a75476489"} Jul 24 12:23:41.425793 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:41.425440 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nq2jq" Jul 24 12:23:41.460902 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:41.460846 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nq2jq" podStartSLOduration=1.724684613 podStartE2EDuration="3.460829551s" totalImagesPullingTime="1.736144938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:23:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:23:41.458464236 +0000 UTC m=+414.509709249" watchObservedRunningTime="2026-07-24 12:23:41.460829551 +0000 UTC m=+414.512074542" Jul 24 12:23:43.012428 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:43.012383 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-s4mwm"] Jul 24 12:23:43.015829 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:43.015810 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s4mwm" Jul 24 12:23:43.019177 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:43.019155 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-lc429\"" Jul 24 12:23:43.031654 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:43.031620 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-s4mwm"] Jul 24 12:23:43.051351 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:43.051311 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjsv5\" (UniqueName: \"kubernetes.io/projected/3a31f161-0f27-4fc6-9a4c-95a8c3ca4b06-kube-api-access-sjsv5\") pod \"authorino-operator-75cc8d5cb7-s4mwm\" (UID: \"3a31f161-0f27-4fc6-9a4c-95a8c3ca4b06\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-s4mwm" Jul 24 12:23:43.152012 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:43.151973 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjsv5\" (UniqueName: \"kubernetes.io/projected/3a31f161-0f27-4fc6-9a4c-95a8c3ca4b06-kube-api-access-sjsv5\") pod \"authorino-operator-75cc8d5cb7-s4mwm\" (UID: \"3a31f161-0f27-4fc6-9a4c-95a8c3ca4b06\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-s4mwm" Jul 24 12:23:43.167892 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:43.167863 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjsv5\" (UniqueName: \"kubernetes.io/projected/3a31f161-0f27-4fc6-9a4c-95a8c3ca4b06-kube-api-access-sjsv5\") pod \"authorino-operator-75cc8d5cb7-s4mwm\" (UID: \"3a31f161-0f27-4fc6-9a4c-95a8c3ca4b06\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-s4mwm" Jul 24 12:23:43.326679 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:43.326584 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s4mwm" Jul 24 12:23:43.502535 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:43.502495 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-s4mwm"] Jul 24 12:23:43.505112 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:23:43.505051 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a31f161_0f27_4fc6_9a4c_95a8c3ca4b06.slice/crio-eed2617782fc52d3f81335c59a65386641cedcb7b646e73a06a64e3fe123fed4 WatchSource:0}: Error finding container eed2617782fc52d3f81335c59a65386641cedcb7b646e73a06a64e3fe123fed4: Status 404 returned error can't find the container with id eed2617782fc52d3f81335c59a65386641cedcb7b646e73a06a64e3fe123fed4 Jul 24 12:23:44.443037 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:44.442994 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s4mwm" event={"ID":"3a31f161-0f27-4fc6-9a4c-95a8c3ca4b06","Type":"ContainerStarted","Data":"eed2617782fc52d3f81335c59a65386641cedcb7b646e73a06a64e3fe123fed4"} Jul 24 12:23:46.455625 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:46.455586 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s4mwm" event={"ID":"3a31f161-0f27-4fc6-9a4c-95a8c3ca4b06","Type":"ContainerStarted","Data":"e5b51c51dc6712bd3356917581d7673d9d12cbb8ffca43152cf02b8fe5bd39b2"} Jul 24 12:23:46.456109 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:46.455662 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s4mwm" Jul 24 12:23:46.520014 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:46.519956 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s4mwm" podStartSLOduration=2.291927749 podStartE2EDuration="4.519938727s" totalImagesPullingTime="2.228010978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:23:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:23:46.516553943 +0000 UTC m=+419.567798934" watchObservedRunningTime="2026-07-24 12:23:46.519938727 +0000 UTC m=+419.571183719" Jul 24 12:23:48.322453 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:48.322415 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rssbt"] Jul 24 12:23:48.327127 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:48.327106 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rssbt" Jul 24 12:23:48.330775 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:48.330752 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mzktb\"" Jul 24 12:23:48.347194 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:48.347168 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rssbt"] Jul 24 12:23:48.401441 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:48.401398 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgjx2\" (UniqueName: \"kubernetes.io/projected/5af8c3d8-33c6-4bc9-b251-37bed141a6c6-kube-api-access-jgjx2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rssbt\" (UID: \"5af8c3d8-33c6-4bc9-b251-37bed141a6c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rssbt" Jul 24 12:23:48.401441 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:48.401439 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5af8c3d8-33c6-4bc9-b251-37bed141a6c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rssbt\" (UID: \"5af8c3d8-33c6-4bc9-b251-37bed141a6c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rssbt" Jul 24 12:23:48.502642 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:48.502593 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgjx2\" (UniqueName: \"kubernetes.io/projected/5af8c3d8-33c6-4bc9-b251-37bed141a6c6-kube-api-access-jgjx2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rssbt\" (UID: \"5af8c3d8-33c6-4bc9-b251-37bed141a6c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rssbt" Jul 24 12:23:48.502642 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:48.502648 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5af8c3d8-33c6-4bc9-b251-37bed141a6c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rssbt\" (UID: \"5af8c3d8-33c6-4bc9-b251-37bed141a6c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rssbt" Jul 24 12:23:48.503021 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:48.503001 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5af8c3d8-33c6-4bc9-b251-37bed141a6c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rssbt\" (UID: \"5af8c3d8-33c6-4bc9-b251-37bed141a6c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rssbt" Jul 24 12:23:48.516846 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:48.516817 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgjx2\" (UniqueName: \"kubernetes.io/projected/5af8c3d8-33c6-4bc9-b251-37bed141a6c6-kube-api-access-jgjx2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rssbt\" (UID: \"5af8c3d8-33c6-4bc9-b251-37bed141a6c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rssbt" Jul 24 12:23:48.638016 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:48.637936 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rssbt" Jul 24 12:23:48.797025 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:48.796992 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rssbt"] Jul 24 12:23:48.801292 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:23:48.801261 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5af8c3d8_33c6_4bc9_b251_37bed141a6c6.slice/crio-36459caaf78b1b8ed27b907cc069ab22fa8e297bbf9ae29868428d6951eecb74 WatchSource:0}: Error finding container 36459caaf78b1b8ed27b907cc069ab22fa8e297bbf9ae29868428d6951eecb74: Status 404 returned error can't find the container with id 36459caaf78b1b8ed27b907cc069ab22fa8e297bbf9ae29868428d6951eecb74 Jul 24 12:23:49.422852 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:49.422821 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hppg" Jul 24 12:23:49.472186 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:49.472141 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rssbt" event={"ID":"5af8c3d8-33c6-4bc9-b251-37bed141a6c6","Type":"ContainerStarted","Data":"36459caaf78b1b8ed27b907cc069ab22fa8e297bbf9ae29868428d6951eecb74"} Jul 24 12:23:52.432653 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:52.432614 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nq2jq" Jul 24 12:23:54.501757 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:54.501720 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rssbt" event={"ID":"5af8c3d8-33c6-4bc9-b251-37bed141a6c6","Type":"ContainerStarted","Data":"37cdd48d7731820baa2a38a29c02f556ef6c128d1f4b83e29fd10a87ee84f335"} Jul 24 12:23:54.502234 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:54.501826 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rssbt" Jul 24 12:23:54.528687 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:54.528622 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rssbt" podStartSLOduration=1.801862715 podStartE2EDuration="6.528599535s" totalImagesPullingTime="4.72673682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:23:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:23:54.525524146 +0000 UTC m=+427.576769139" watchObservedRunningTime="2026-07-24 12:23:54.528599535 +0000 UTC m=+427.579844528" Jul 24 12:23:57.462963 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:23:57.462928 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s4mwm" Jul 24 12:24:05.509413 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:05.509380 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rssbt" Jul 24 12:24:07.577508 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:07.577454 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rssbt"] Jul 24 12:24:07.578009 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:07.577755 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rssbt" podUID="5af8c3d8-33c6-4bc9-b251-37bed141a6c6" containerName="manager" containerID="cri-o://37cdd48d7731820baa2a38a29c02f556ef6c128d1f4b83e29fd10a87ee84f335" gracePeriod=2 Jul 24 12:24:07.579362 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:07.579337 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rssbt"] Jul 24 12:24:07.581369 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:24:07.581332 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rssbt\" is forbidden: User \"system:node:ip-10-0-139-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-109.ec2.internal' and this object" podUID="5af8c3d8-33c6-4bc9-b251-37bed141a6c6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rssbt" Jul 24 12:24:07.619509 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:07.619474 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nq2jq"] Jul 24 12:24:07.619763 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:07.619721 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nq2jq" podUID="d3b2dcf5-c93d-44c0-9f58-0c93c2824a26" containerName="manager" containerID="cri-o://356b1786014e7a2fc08b315eb84ce5bb1d3a36a21e8c7bda964a388a75476489" gracePeriod=2 Jul 24 12:24:07.627828 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:24:07.627378 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rssbt\" is forbidden: User \"system:node:ip-10-0-139-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-109.ec2.internal' and this object" podUID="5af8c3d8-33c6-4bc9-b251-37bed141a6c6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rssbt" Jul 24 12:24:07.629447 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:07.629418 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nq2jq"] Jul 24 12:24:07.639752 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:24:07.639704 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nq2jq\" is forbidden: User \"system:node:ip-10-0-139-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-109.ec2.internal' and this object" podUID="d3b2dcf5-c93d-44c0-9f58-0c93c2824a26" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nq2jq" Jul 24 12:24:07.733970 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:07.733938 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6m2h4"] Jul 24 12:24:07.734345 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:07.734333 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3b2dcf5-c93d-44c0-9f58-0c93c2824a26" containerName="manager" Jul 24 12:24:07.734410 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:07.734346 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3b2dcf5-c93d-44c0-9f58-0c93c2824a26" containerName="manager" Jul 24 12:24:07.734410 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:07.734354 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5af8c3d8-33c6-4bc9-b251-37bed141a6c6" containerName="manager" Jul 24 12:24:07.734410 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:07.734360 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5af8c3d8-33c6-4bc9-b251-37bed141a6c6" containerName="manager" Jul 24 12:24:07.734610 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:07.734436 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3b2dcf5-c93d-44c0-9f58-0c93c2824a26" containerName="manager" Jul 24 12:24:07.734610 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:07.734449 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="5af8c3d8-33c6-4bc9-b251-37bed141a6c6" containerName="manager" Jul 24 12:24:07.737462 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:07.737434 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6m2h4" Jul 24 12:24:07.741346 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:24:07.741313 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rssbt\" is forbidden: User \"system:node:ip-10-0-139-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-109.ec2.internal' and this object" podUID="5af8c3d8-33c6-4bc9-b251-37bed141a6c6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rssbt" Jul 24 12:24:07.794343 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:07.794306 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ht65x"] Jul 24 12:24:07.797710 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:07.797685 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ht65x" Jul 24 12:24:07.806412 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:07.806379 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6m2h4"] Jul 24 12:24:07.833726 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:07.833610 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ht65x"] Jul 24 12:24:07.871125 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:07.871094 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdd72090-3750-43a2-b4c4-4145af260db5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6m2h4\" (UID: \"cdd72090-3750-43a2-b4c4-4145af260db5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6m2h4" Jul 24 12:24:07.871278 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:07.871146 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzgx9\" (UniqueName: \"kubernetes.io/projected/29eb948a-dbb2-494d-b808-f70f9e92025a-kube-api-access-pzgx9\") pod \"limitador-operator-controller-manager-859d7b78bd-ht65x\" (UID: \"29eb948a-dbb2-494d-b808-f70f9e92025a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ht65x" Jul 24 12:24:07.871278 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:07.871232 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwnkl\" (UniqueName: \"kubernetes.io/projected/cdd72090-3750-43a2-b4c4-4145af260db5-kube-api-access-dwnkl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6m2h4\" (UID: \"cdd72090-3750-43a2-b4c4-4145af260db5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6m2h4" Jul 24 12:24:07.875658 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:24:07.875625 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nq2jq\" is forbidden: User \"system:node:ip-10-0-139-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-109.ec2.internal' and this object" podUID="d3b2dcf5-c93d-44c0-9f58-0c93c2824a26" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nq2jq" Jul 24 12:24:07.879121 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:24:07.879085 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nq2jq\" is forbidden: User \"system:node:ip-10-0-139-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-109.ec2.internal' and this object" podUID="d3b2dcf5-c93d-44c0-9f58-0c93c2824a26" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nq2jq" Jul 24 12:24:07.892299 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:07.892275 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nq2jq" Jul 24 12:24:07.895157 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:07.895131 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rssbt" Jul 24 12:24:07.961902 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:24:07.961857 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rssbt\" is forbidden: User \"system:node:ip-10-0-139-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-109.ec2.internal' and this object" podUID="5af8c3d8-33c6-4bc9-b251-37bed141a6c6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rssbt" Jul 24 12:24:07.964464 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:24:07.964437 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rssbt\" is forbidden: User \"system:node:ip-10-0-139-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-109.ec2.internal' and this object" podUID="5af8c3d8-33c6-4bc9-b251-37bed141a6c6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rssbt" Jul 24 12:24:07.968492 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:24:07.968466 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nq2jq\" is forbidden: User \"system:node:ip-10-0-139-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-109.ec2.internal' and this object" podUID="d3b2dcf5-c93d-44c0-9f58-0c93c2824a26" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nq2jq" Jul 24 12:24:07.971793 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:07.971770 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5af8c3d8-33c6-4bc9-b251-37bed141a6c6-extensions-socket-volume\") pod \"5af8c3d8-33c6-4bc9-b251-37bed141a6c6\" (UID: \"5af8c3d8-33c6-4bc9-b251-37bed141a6c6\") " Jul 24 12:24:07.971872 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:07.971859 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jgjx2\" (UniqueName: \"kubernetes.io/projected/5af8c3d8-33c6-4bc9-b251-37bed141a6c6-kube-api-access-jgjx2\") pod \"5af8c3d8-33c6-4bc9-b251-37bed141a6c6\" (UID: \"5af8c3d8-33c6-4bc9-b251-37bed141a6c6\") " Jul 24 12:24:07.971920 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:07.971899 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p58rr\" (UniqueName: \"kubernetes.io/projected/d3b2dcf5-c93d-44c0-9f58-0c93c2824a26-kube-api-access-p58rr\") pod \"d3b2dcf5-c93d-44c0-9f58-0c93c2824a26\" (UID: \"d3b2dcf5-c93d-44c0-9f58-0c93c2824a26\") " Jul 24 12:24:07.971988 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:07.971972 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdd72090-3750-43a2-b4c4-4145af260db5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6m2h4\" (UID: \"cdd72090-3750-43a2-b4c4-4145af260db5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6m2h4" Jul 24 12:24:07.972041 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:07.972023 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzgx9\" (UniqueName: \"kubernetes.io/projected/29eb948a-dbb2-494d-b808-f70f9e92025a-kube-api-access-pzgx9\") pod \"limitador-operator-controller-manager-859d7b78bd-ht65x\" (UID: \"29eb948a-dbb2-494d-b808-f70f9e92025a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ht65x" Jul 24 12:24:07.972146 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:07.972127 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwnkl\" (UniqueName: \"kubernetes.io/projected/cdd72090-3750-43a2-b4c4-4145af260db5-kube-api-access-dwnkl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6m2h4\" (UID: \"cdd72090-3750-43a2-b4c4-4145af260db5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6m2h4" Jul 24 12:24:07.972410 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:07.972381 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5af8c3d8-33c6-4bc9-b251-37bed141a6c6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5af8c3d8-33c6-4bc9-b251-37bed141a6c6" (UID: "5af8c3d8-33c6-4bc9-b251-37bed141a6c6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 12:24:07.972551 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:07.972425 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdd72090-3750-43a2-b4c4-4145af260db5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6m2h4\" (UID: \"cdd72090-3750-43a2-b4c4-4145af260db5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6m2h4" Jul 24 12:24:07.974665 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:07.974636 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5af8c3d8-33c6-4bc9-b251-37bed141a6c6-kube-api-access-jgjx2" (OuterVolumeSpecName: "kube-api-access-jgjx2") pod "5af8c3d8-33c6-4bc9-b251-37bed141a6c6" (UID: "5af8c3d8-33c6-4bc9-b251-37bed141a6c6"). InnerVolumeSpecName "kube-api-access-jgjx2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 12:24:07.974767 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:07.974666 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3b2dcf5-c93d-44c0-9f58-0c93c2824a26-kube-api-access-p58rr" (OuterVolumeSpecName: "kube-api-access-p58rr") pod "d3b2dcf5-c93d-44c0-9f58-0c93c2824a26" (UID: "d3b2dcf5-c93d-44c0-9f58-0c93c2824a26"). InnerVolumeSpecName "kube-api-access-p58rr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 12:24:08.008978 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:08.008949 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwnkl\" (UniqueName: \"kubernetes.io/projected/cdd72090-3750-43a2-b4c4-4145af260db5-kube-api-access-dwnkl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6m2h4\" (UID: \"cdd72090-3750-43a2-b4c4-4145af260db5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6m2h4" Jul 24 12:24:08.011086 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:08.011032 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzgx9\" (UniqueName: \"kubernetes.io/projected/29eb948a-dbb2-494d-b808-f70f9e92025a-kube-api-access-pzgx9\") pod \"limitador-operator-controller-manager-859d7b78bd-ht65x\" (UID: \"29eb948a-dbb2-494d-b808-f70f9e92025a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ht65x" Jul 24 12:24:08.049168 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:08.049129 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6m2h4" Jul 24 12:24:08.073267 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:08.073235 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgjx2\" (UniqueName: \"kubernetes.io/projected/5af8c3d8-33c6-4bc9-b251-37bed141a6c6-kube-api-access-jgjx2\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jul 24 12:24:08.073267 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:08.073267 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p58rr\" (UniqueName: \"kubernetes.io/projected/d3b2dcf5-c93d-44c0-9f58-0c93c2824a26-kube-api-access-p58rr\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jul 24 12:24:08.073466 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:08.073283 2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5af8c3d8-33c6-4bc9-b251-37bed141a6c6-extensions-socket-volume\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jul 24 12:24:08.110780 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:08.110381 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ht65x" Jul 24 12:24:08.241869 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:08.241837 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6m2h4"] Jul 24 12:24:08.243769 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:24:08.243741 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdd72090_3750_43a2_b4c4_4145af260db5.slice/crio-9969b02abf2608fad3e8026f9a3e703cad43c49101b20630d92230d5f1bd0f7a WatchSource:0}: Error finding container 9969b02abf2608fad3e8026f9a3e703cad43c49101b20630d92230d5f1bd0f7a: Status 404 returned error can't find the container with id 9969b02abf2608fad3e8026f9a3e703cad43c49101b20630d92230d5f1bd0f7a Jul 24 12:24:08.284184 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:08.284155 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ht65x"] Jul 24 12:24:08.286188 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:24:08.286161 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29eb948a_dbb2_494d_b808_f70f9e92025a.slice/crio-9526096d120745f13bcb4f724e21c58c4aa6a7db6b9d516240b439c0e103a359 WatchSource:0}: Error finding container 9526096d120745f13bcb4f724e21c58c4aa6a7db6b9d516240b439c0e103a359: Status 404 returned error can't find the container with id 9526096d120745f13bcb4f724e21c58c4aa6a7db6b9d516240b439c0e103a359 Jul 24 12:24:08.572445 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:08.572407 2555 generic.go:356] "Generic (PLEG): container finished" podID="5af8c3d8-33c6-4bc9-b251-37bed141a6c6" containerID="37cdd48d7731820baa2a38a29c02f556ef6c128d1f4b83e29fd10a87ee84f335" exitCode=0 Jul 24 12:24:08.572445 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:08.572451 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rssbt" Jul 24 12:24:08.572726 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:08.572513 2555 scope.go:117] "RemoveContainer" containerID="37cdd48d7731820baa2a38a29c02f556ef6c128d1f4b83e29fd10a87ee84f335" Jul 24 12:24:08.574287 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:08.574257 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6m2h4" event={"ID":"cdd72090-3750-43a2-b4c4-4145af260db5","Type":"ContainerStarted","Data":"224b5dc39d1010b382746c0bef9b0d98bfa51bfa2ad8685402a91d9e9fa58206"} Jul 24 12:24:08.574401 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:08.574316 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6m2h4" event={"ID":"cdd72090-3750-43a2-b4c4-4145af260db5","Type":"ContainerStarted","Data":"9969b02abf2608fad3e8026f9a3e703cad43c49101b20630d92230d5f1bd0f7a"} Jul 24 12:24:08.574401 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:08.574348 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6m2h4" Jul 24 12:24:08.575368 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:24:08.575341 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rssbt\" is forbidden: User \"system:node:ip-10-0-139-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-109.ec2.internal' and this object" podUID="5af8c3d8-33c6-4bc9-b251-37bed141a6c6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rssbt" Jul 24 12:24:08.576038 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:08.576008 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ht65x" event={"ID":"29eb948a-dbb2-494d-b808-f70f9e92025a","Type":"ContainerStarted","Data":"00f7072f095c2c9ca0166992e2d5b830e6b1ee8e6d660520417b1f20627c012e"} Jul 24 12:24:08.576163 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:08.576053 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ht65x" event={"ID":"29eb948a-dbb2-494d-b808-f70f9e92025a","Type":"ContainerStarted","Data":"9526096d120745f13bcb4f724e21c58c4aa6a7db6b9d516240b439c0e103a359"} Jul 24 12:24:08.576163 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:08.576103 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ht65x" Jul 24 12:24:08.577441 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:08.577420 2555 generic.go:356] "Generic (PLEG): container finished" podID="d3b2dcf5-c93d-44c0-9f58-0c93c2824a26" containerID="356b1786014e7a2fc08b315eb84ce5bb1d3a36a21e8c7bda964a388a75476489" exitCode=0 Jul 24 12:24:08.577509 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:08.577461 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nq2jq" Jul 24 12:24:08.577673 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:24:08.577650 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nq2jq\" is forbidden: User \"system:node:ip-10-0-139-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-109.ec2.internal' and this object" podUID="d3b2dcf5-c93d-44c0-9f58-0c93c2824a26" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nq2jq" Jul 24 12:24:08.580814 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:24:08.580780 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rssbt\" is forbidden: User \"system:node:ip-10-0-139-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-109.ec2.internal' and this object" podUID="5af8c3d8-33c6-4bc9-b251-37bed141a6c6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rssbt" Jul 24 12:24:08.584502 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:08.584289 2555 scope.go:117] "RemoveContainer" containerID="37cdd48d7731820baa2a38a29c02f556ef6c128d1f4b83e29fd10a87ee84f335" Jul 24 12:24:08.584647 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:24:08.584627 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37cdd48d7731820baa2a38a29c02f556ef6c128d1f4b83e29fd10a87ee84f335\": container with ID starting with 37cdd48d7731820baa2a38a29c02f556ef6c128d1f4b83e29fd10a87ee84f335 not found: ID does not exist" containerID="37cdd48d7731820baa2a38a29c02f556ef6c128d1f4b83e29fd10a87ee84f335" Jul 24 12:24:08.584712 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:08.584661 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37cdd48d7731820baa2a38a29c02f556ef6c128d1f4b83e29fd10a87ee84f335"} err="failed to get container status \"37cdd48d7731820baa2a38a29c02f556ef6c128d1f4b83e29fd10a87ee84f335\": rpc error: code = NotFound desc = could not find container \"37cdd48d7731820baa2a38a29c02f556ef6c128d1f4b83e29fd10a87ee84f335\": container with ID starting with 37cdd48d7731820baa2a38a29c02f556ef6c128d1f4b83e29fd10a87ee84f335 not found: ID does not exist" Jul 24 12:24:08.584712 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:08.584687 2555 scope.go:117] "RemoveContainer" containerID="356b1786014e7a2fc08b315eb84ce5bb1d3a36a21e8c7bda964a388a75476489" Jul 24 12:24:08.594287 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:08.594268 2555 scope.go:117] "RemoveContainer" containerID="356b1786014e7a2fc08b315eb84ce5bb1d3a36a21e8c7bda964a388a75476489" Jul 24 12:24:08.594622 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:24:08.594600 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"356b1786014e7a2fc08b315eb84ce5bb1d3a36a21e8c7bda964a388a75476489\": container with ID starting with 356b1786014e7a2fc08b315eb84ce5bb1d3a36a21e8c7bda964a388a75476489 not found: ID does not exist" containerID="356b1786014e7a2fc08b315eb84ce5bb1d3a36a21e8c7bda964a388a75476489" Jul 24 12:24:08.594737 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:08.594635 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"356b1786014e7a2fc08b315eb84ce5bb1d3a36a21e8c7bda964a388a75476489"} err="failed to get container status \"356b1786014e7a2fc08b315eb84ce5bb1d3a36a21e8c7bda964a388a75476489\": rpc error: code = NotFound desc = could not find container \"356b1786014e7a2fc08b315eb84ce5bb1d3a36a21e8c7bda964a388a75476489\": container with ID starting with 356b1786014e7a2fc08b315eb84ce5bb1d3a36a21e8c7bda964a388a75476489 not found: ID does not exist" Jul 24 12:24:08.619079 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:08.619005 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6m2h4" podStartSLOduration=1.618988372 podStartE2EDuration="1.618988372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:24:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:24:08.618190801 +0000 UTC m=+441.669435813" watchObservedRunningTime="2026-07-24 12:24:08.618988372 +0000 UTC m=+441.670233364" Jul 24 12:24:08.621357 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:24:08.621329 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nq2jq\" is forbidden: User \"system:node:ip-10-0-139-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-109.ec2.internal' and this object" podUID="d3b2dcf5-c93d-44c0-9f58-0c93c2824a26" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nq2jq" Jul 24 12:24:08.653379 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:08.653314 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ht65x" podStartSLOduration=1.653292827 podStartE2EDuration="1.653292827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:24:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:24:08.651374446 +0000 UTC m=+441.702619645" watchObservedRunningTime="2026-07-24 12:24:08.653292827 +0000 UTC m=+441.704537821" Jul 24 12:24:08.653847 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:24:08.653816 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rssbt\" is forbidden: User \"system:node:ip-10-0-139-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-109.ec2.internal' and this object" podUID="5af8c3d8-33c6-4bc9-b251-37bed141a6c6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rssbt" Jul 24 12:24:08.657037 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:24:08.657007 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nq2jq\" is forbidden: User \"system:node:ip-10-0-139-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-109.ec2.internal' and this object" podUID="d3b2dcf5-c93d-44c0-9f58-0c93c2824a26" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nq2jq" Jul 24 12:24:09.422433 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:09.422399 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5af8c3d8-33c6-4bc9-b251-37bed141a6c6" path="/var/lib/kubelet/pods/5af8c3d8-33c6-4bc9-b251-37bed141a6c6/volumes" Jul 24 12:24:09.422713 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:09.422701 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3b2dcf5-c93d-44c0-9f58-0c93c2824a26" path="/var/lib/kubelet/pods/d3b2dcf5-c93d-44c0-9f58-0c93c2824a26/volumes" Jul 24 12:24:09.546499 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:09.546412 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g4q5m"] Jul 24 12:24:09.551257 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:09.551232 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g4q5m" Jul 24 12:24:09.574672 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:09.574636 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g4q5m"] Jul 24 12:24:09.685618 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:09.685527 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c7f0d60-839e-4aea-97c6-3cc399a4cfa5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-g4q5m\" (UID: \"6c7f0d60-839e-4aea-97c6-3cc399a4cfa5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g4q5m" Jul 24 12:24:09.686002 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:09.685619 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmxjv\" (UniqueName: \"kubernetes.io/projected/6c7f0d60-839e-4aea-97c6-3cc399a4cfa5-kube-api-access-dmxjv\") pod \"kuadrant-operator-controller-manager-86878c769f-g4q5m\" (UID: \"6c7f0d60-839e-4aea-97c6-3cc399a4cfa5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g4q5m" Jul 24 12:24:09.786518 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:09.786473 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmxjv\" (UniqueName: \"kubernetes.io/projected/6c7f0d60-839e-4aea-97c6-3cc399a4cfa5-kube-api-access-dmxjv\") pod \"kuadrant-operator-controller-manager-86878c769f-g4q5m\" (UID: \"6c7f0d60-839e-4aea-97c6-3cc399a4cfa5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g4q5m" Jul 24 12:24:09.786694 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:09.786550 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c7f0d60-839e-4aea-97c6-3cc399a4cfa5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-g4q5m\" (UID: \"6c7f0d60-839e-4aea-97c6-3cc399a4cfa5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g4q5m" Jul 24 12:24:09.787005 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:09.786982 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c7f0d60-839e-4aea-97c6-3cc399a4cfa5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-g4q5m\" (UID: \"6c7f0d60-839e-4aea-97c6-3cc399a4cfa5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g4q5m" Jul 24 12:24:09.799463 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:09.799437 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmxjv\" (UniqueName: \"kubernetes.io/projected/6c7f0d60-839e-4aea-97c6-3cc399a4cfa5-kube-api-access-dmxjv\") pod \"kuadrant-operator-controller-manager-86878c769f-g4q5m\" (UID: \"6c7f0d60-839e-4aea-97c6-3cc399a4cfa5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g4q5m" Jul 24 12:24:09.862618 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:09.862581 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g4q5m" Jul 24 12:24:10.034039 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:10.034013 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g4q5m"] Jul 24 12:24:10.036657 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:24:10.036631 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c7f0d60_839e_4aea_97c6_3cc399a4cfa5.slice/crio-be801598dcebbaacef17f367c2c202a2668dfb5f94db28442a4265e080f63da8 WatchSource:0}: Error finding container be801598dcebbaacef17f367c2c202a2668dfb5f94db28442a4265e080f63da8: Status 404 returned error can't find the container with id be801598dcebbaacef17f367c2c202a2668dfb5f94db28442a4265e080f63da8 Jul 24 12:24:10.592283 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:10.592238 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g4q5m" event={"ID":"6c7f0d60-839e-4aea-97c6-3cc399a4cfa5","Type":"ContainerStarted","Data":"07889fc0ce60a9c81f21774ce774d6a798611b58cf072b74e3144d1a8c3e4d99"} Jul 24 12:24:10.592495 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:10.592295 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g4q5m" event={"ID":"6c7f0d60-839e-4aea-97c6-3cc399a4cfa5","Type":"ContainerStarted","Data":"be801598dcebbaacef17f367c2c202a2668dfb5f94db28442a4265e080f63da8"} Jul 24 12:24:10.592495 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:10.592354 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g4q5m" Jul 24 12:24:10.623867 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:10.623809 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g4q5m" podStartSLOduration=1.62379129 podStartE2EDuration="1.62379129s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:24:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:24:10.621827147 +0000 UTC m=+443.673072148" watchObservedRunningTime="2026-07-24 12:24:10.62379129 +0000 UTC m=+443.675036279" Jul 24 12:24:19.588387 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:19.588353 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ht65x" Jul 24 12:24:19.588820 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:19.588517 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6m2h4" Jul 24 12:24:21.599561 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:21.599527 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g4q5m" Jul 24 12:24:21.690541 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:21.690505 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6m2h4"] Jul 24 12:24:21.690765 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:21.690740 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6m2h4" podUID="cdd72090-3750-43a2-b4c4-4145af260db5" containerName="manager" containerID="cri-o://224b5dc39d1010b382746c0bef9b0d98bfa51bfa2ad8685402a91d9e9fa58206" gracePeriod=10 Jul 24 12:24:21.944546 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:21.944524 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6m2h4" Jul 24 12:24:22.102176 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:22.102139 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdd72090-3750-43a2-b4c4-4145af260db5-extensions-socket-volume\") pod \"cdd72090-3750-43a2-b4c4-4145af260db5\" (UID: \"cdd72090-3750-43a2-b4c4-4145af260db5\") " Jul 24 12:24:22.102348 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:22.102230 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwnkl\" (UniqueName: \"kubernetes.io/projected/cdd72090-3750-43a2-b4c4-4145af260db5-kube-api-access-dwnkl\") pod \"cdd72090-3750-43a2-b4c4-4145af260db5\" (UID: \"cdd72090-3750-43a2-b4c4-4145af260db5\") " Jul 24 12:24:22.102540 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:22.102515 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdd72090-3750-43a2-b4c4-4145af260db5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cdd72090-3750-43a2-b4c4-4145af260db5" (UID: "cdd72090-3750-43a2-b4c4-4145af260db5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 12:24:22.104327 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:22.104298 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdd72090-3750-43a2-b4c4-4145af260db5-kube-api-access-dwnkl" (OuterVolumeSpecName: "kube-api-access-dwnkl") pod "cdd72090-3750-43a2-b4c4-4145af260db5" (UID: "cdd72090-3750-43a2-b4c4-4145af260db5"). InnerVolumeSpecName "kube-api-access-dwnkl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 12:24:22.203072 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:22.203038 2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdd72090-3750-43a2-b4c4-4145af260db5-extensions-socket-volume\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jul 24 12:24:22.203072 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:22.203076 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwnkl\" (UniqueName: \"kubernetes.io/projected/cdd72090-3750-43a2-b4c4-4145af260db5-kube-api-access-dwnkl\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jul 24 12:24:22.654802 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:22.654769 2555 generic.go:356] "Generic (PLEG): container finished" podID="cdd72090-3750-43a2-b4c4-4145af260db5" containerID="224b5dc39d1010b382746c0bef9b0d98bfa51bfa2ad8685402a91d9e9fa58206" exitCode=0 Jul 24 12:24:22.655258 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:22.654844 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6m2h4" Jul 24 12:24:22.655258 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:22.654853 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6m2h4" event={"ID":"cdd72090-3750-43a2-b4c4-4145af260db5","Type":"ContainerDied","Data":"224b5dc39d1010b382746c0bef9b0d98bfa51bfa2ad8685402a91d9e9fa58206"} Jul 24 12:24:22.655258 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:22.654911 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6m2h4" event={"ID":"cdd72090-3750-43a2-b4c4-4145af260db5","Type":"ContainerDied","Data":"9969b02abf2608fad3e8026f9a3e703cad43c49101b20630d92230d5f1bd0f7a"} Jul 24 12:24:22.655258 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:22.654934 2555 scope.go:117] "RemoveContainer" containerID="224b5dc39d1010b382746c0bef9b0d98bfa51bfa2ad8685402a91d9e9fa58206" Jul 24 12:24:22.664420 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:22.664403 2555 scope.go:117] "RemoveContainer" containerID="224b5dc39d1010b382746c0bef9b0d98bfa51bfa2ad8685402a91d9e9fa58206" Jul 24 12:24:22.664691 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:24:22.664672 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"224b5dc39d1010b382746c0bef9b0d98bfa51bfa2ad8685402a91d9e9fa58206\": container with ID starting with 224b5dc39d1010b382746c0bef9b0d98bfa51bfa2ad8685402a91d9e9fa58206 not found: ID does not exist" containerID="224b5dc39d1010b382746c0bef9b0d98bfa51bfa2ad8685402a91d9e9fa58206" Jul 24 12:24:22.664751 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:22.664699 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"224b5dc39d1010b382746c0bef9b0d98bfa51bfa2ad8685402a91d9e9fa58206"} err="failed to get container status \"224b5dc39d1010b382746c0bef9b0d98bfa51bfa2ad8685402a91d9e9fa58206\": rpc error: code = NotFound desc = could not find container \"224b5dc39d1010b382746c0bef9b0d98bfa51bfa2ad8685402a91d9e9fa58206\": container with ID starting with 224b5dc39d1010b382746c0bef9b0d98bfa51bfa2ad8685402a91d9e9fa58206 not found: ID does not exist" Jul 24 12:24:22.693274 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:22.693241 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6m2h4"] Jul 24 12:24:22.704203 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:22.704174 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6m2h4"] Jul 24 12:24:23.423348 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:23.423307 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdd72090-3750-43a2-b4c4-4145af260db5" path="/var/lib/kubelet/pods/cdd72090-3750-43a2-b4c4-4145af260db5/volumes" Jul 24 12:24:40.412840 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:40.412804 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j2xsn"] Jul 24 12:24:40.413352 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:40.413193 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdd72090-3750-43a2-b4c4-4145af260db5" containerName="manager" Jul 24 12:24:40.413352 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:40.413206 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdd72090-3750-43a2-b4c4-4145af260db5" containerName="manager" Jul 24 12:24:40.413352 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:40.413284 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdd72090-3750-43a2-b4c4-4145af260db5" containerName="manager" Jul 24 12:24:40.416107 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:40.416087 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-j2xsn" Jul 24 12:24:40.419434 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:40.419413 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qxs76\"" Jul 24 12:24:40.419646 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:40.419629 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 24 12:24:40.436251 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:40.436210 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j2xsn"] Jul 24 12:24:40.454443 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:40.454412 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78wrz\" (UniqueName: \"kubernetes.io/projected/2d20b0ba-b771-4ca1-9d4b-d134b28372d6-kube-api-access-78wrz\") pod \"limitador-limitador-64c94fd64f-j2xsn\" (UID: \"2d20b0ba-b771-4ca1-9d4b-d134b28372d6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-j2xsn" Jul 24 12:24:40.454601 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:40.454470 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2d20b0ba-b771-4ca1-9d4b-d134b28372d6-config-file\") pod \"limitador-limitador-64c94fd64f-j2xsn\" (UID: \"2d20b0ba-b771-4ca1-9d4b-d134b28372d6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-j2xsn" Jul 24 12:24:40.511782 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:40.511739 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j2xsn"] Jul 24 12:24:40.555245 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:40.555205 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78wrz\" (UniqueName: \"kubernetes.io/projected/2d20b0ba-b771-4ca1-9d4b-d134b28372d6-kube-api-access-78wrz\") pod \"limitador-limitador-64c94fd64f-j2xsn\" (UID: \"2d20b0ba-b771-4ca1-9d4b-d134b28372d6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-j2xsn" Jul 24 12:24:40.555415 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:40.555281 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2d20b0ba-b771-4ca1-9d4b-d134b28372d6-config-file\") pod \"limitador-limitador-64c94fd64f-j2xsn\" (UID: \"2d20b0ba-b771-4ca1-9d4b-d134b28372d6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-j2xsn" Jul 24 12:24:40.555941 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:40.555921 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2d20b0ba-b771-4ca1-9d4b-d134b28372d6-config-file\") pod \"limitador-limitador-64c94fd64f-j2xsn\" (UID: \"2d20b0ba-b771-4ca1-9d4b-d134b28372d6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-j2xsn" Jul 24 12:24:40.569404 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:40.569370 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78wrz\" (UniqueName: \"kubernetes.io/projected/2d20b0ba-b771-4ca1-9d4b-d134b28372d6-kube-api-access-78wrz\") pod \"limitador-limitador-64c94fd64f-j2xsn\" (UID: \"2d20b0ba-b771-4ca1-9d4b-d134b28372d6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-j2xsn" Jul 24 12:24:40.725695 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:40.725607 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-j2xsn" Jul 24 12:24:40.899297 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:40.899269 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j2xsn"] Jul 24 12:24:40.901962 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:24:40.901933 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d20b0ba_b771_4ca1_9d4b_d134b28372d6.slice/crio-309f0c4c824879ec1a62b4173073d04a78441195cbc8d522104956cb2c3e7fe0 WatchSource:0}: Error finding container 309f0c4c824879ec1a62b4173073d04a78441195cbc8d522104956cb2c3e7fe0: Status 404 returned error can't find the container with id 309f0c4c824879ec1a62b4173073d04a78441195cbc8d522104956cb2c3e7fe0 Jul 24 12:24:41.637849 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:41.637814 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-sdmpt"] Jul 24 12:24:41.642247 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:41.642230 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-sdmpt" Jul 24 12:24:41.646480 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:41.646456 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7zsnt\"" Jul 24 12:24:41.654191 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:41.654166 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sdmpt"] Jul 24 12:24:41.666218 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:41.666190 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcq2s\" (UniqueName: \"kubernetes.io/projected/9c3a739a-f725-49c5-b6d5-285d6f7d0566-kube-api-access-gcq2s\") pod \"authorino-75d556bd77-sdmpt\" (UID: \"9c3a739a-f725-49c5-b6d5-285d6f7d0566\") " pod="kuadrant-system/authorino-75d556bd77-sdmpt" Jul 24 12:24:41.749170 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:41.749140 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-j2xsn" event={"ID":"2d20b0ba-b771-4ca1-9d4b-d134b28372d6","Type":"ContainerStarted","Data":"309f0c4c824879ec1a62b4173073d04a78441195cbc8d522104956cb2c3e7fe0"} Jul 24 12:24:41.766591 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:41.766559 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcq2s\" (UniqueName: \"kubernetes.io/projected/9c3a739a-f725-49c5-b6d5-285d6f7d0566-kube-api-access-gcq2s\") pod \"authorino-75d556bd77-sdmpt\" (UID: \"9c3a739a-f725-49c5-b6d5-285d6f7d0566\") " pod="kuadrant-system/authorino-75d556bd77-sdmpt" Jul 24 12:24:41.784724 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:41.784690 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcq2s\" (UniqueName: \"kubernetes.io/projected/9c3a739a-f725-49c5-b6d5-285d6f7d0566-kube-api-access-gcq2s\") pod \"authorino-75d556bd77-sdmpt\" (UID: \"9c3a739a-f725-49c5-b6d5-285d6f7d0566\") " pod="kuadrant-system/authorino-75d556bd77-sdmpt" Jul 24 12:24:41.951329 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:41.951284 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-sdmpt" Jul 24 12:24:42.142519 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:42.142480 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sdmpt"] Jul 24 12:24:42.148673 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:24:42.147927 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c3a739a_f725_49c5_b6d5_285d6f7d0566.slice/crio-26b3bdf7d550412aa378779410e26eea8be93f47c7674254ab4458927b92f1a0 WatchSource:0}: Error finding container 26b3bdf7d550412aa378779410e26eea8be93f47c7674254ab4458927b92f1a0: Status 404 returned error can't find the container with id 26b3bdf7d550412aa378779410e26eea8be93f47c7674254ab4458927b92f1a0 Jul 24 12:24:42.757149 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:42.757106 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-sdmpt" event={"ID":"9c3a739a-f725-49c5-b6d5-285d6f7d0566","Type":"ContainerStarted","Data":"26b3bdf7d550412aa378779410e26eea8be93f47c7674254ab4458927b92f1a0"} Jul 24 12:24:44.775157 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:44.775116 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-j2xsn" event={"ID":"2d20b0ba-b771-4ca1-9d4b-d134b28372d6","Type":"ContainerStarted","Data":"80394debe76c72e2319ea5116e2588c74b1df8ad257ee56200ee3f990c82da8e"} Jul 24 12:24:44.775730 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:44.775680 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-j2xsn" Jul 24 12:24:44.798659 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:44.798609 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-j2xsn" podStartSLOduration=1.56278177 podStartE2EDuration="4.798591299s" totalImagesPullingTime="3.235809529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:24:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:24:44.79600236 +0000 UTC m=+477.847247373" watchObservedRunningTime="2026-07-24 12:24:44.798591299 +0000 UTC m=+477.849836290" Jul 24 12:24:46.787733 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:46.787694 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-sdmpt" event={"ID":"9c3a739a-f725-49c5-b6d5-285d6f7d0566","Type":"ContainerStarted","Data":"d889b5e6e33685ea5f19d2f0bdf45e049db7caa690aa0cacc847d1986cda5c58"} Jul 24 12:24:46.806289 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:46.806235 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-sdmpt" podStartSLOduration=1.968235898 podStartE2EDuration="5.806216085s" totalImagesPullingTime="3.837980187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:24:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:24:46.805235368 +0000 UTC m=+479.856480371" watchObservedRunningTime="2026-07-24 12:24:46.806216085 +0000 UTC m=+479.857461076" Jul 24 12:24:56.789287 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:56.789255 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-j2xsn" Jul 24 12:24:57.572676 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:57.572638 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j2xsn"] Jul 24 12:24:57.572897 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:57.572874 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-j2xsn" podUID="2d20b0ba-b771-4ca1-9d4b-d134b28372d6" containerName="limitador" containerID="cri-o://80394debe76c72e2319ea5116e2588c74b1df8ad257ee56200ee3f990c82da8e" gracePeriod=30 Jul 24 12:24:58.122377 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:58.122350 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-j2xsn" Jul 24 12:24:58.221711 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:58.221682 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2d20b0ba-b771-4ca1-9d4b-d134b28372d6-config-file\") pod \"2d20b0ba-b771-4ca1-9d4b-d134b28372d6\" (UID: \"2d20b0ba-b771-4ca1-9d4b-d134b28372d6\") " Jul 24 12:24:58.221914 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:58.221728 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78wrz\" (UniqueName: \"kubernetes.io/projected/2d20b0ba-b771-4ca1-9d4b-d134b28372d6-kube-api-access-78wrz\") pod \"2d20b0ba-b771-4ca1-9d4b-d134b28372d6\" (UID: \"2d20b0ba-b771-4ca1-9d4b-d134b28372d6\") " Jul 24 12:24:58.222010 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:58.221987 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d20b0ba-b771-4ca1-9d4b-d134b28372d6-config-file" (OuterVolumeSpecName: "config-file") pod "2d20b0ba-b771-4ca1-9d4b-d134b28372d6" (UID: "2d20b0ba-b771-4ca1-9d4b-d134b28372d6"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 12:24:58.224128 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:58.224100 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d20b0ba-b771-4ca1-9d4b-d134b28372d6-kube-api-access-78wrz" (OuterVolumeSpecName: "kube-api-access-78wrz") pod "2d20b0ba-b771-4ca1-9d4b-d134b28372d6" (UID: "2d20b0ba-b771-4ca1-9d4b-d134b28372d6"). InnerVolumeSpecName "kube-api-access-78wrz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 12:24:58.322914 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:58.322876 2555 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2d20b0ba-b771-4ca1-9d4b-d134b28372d6-config-file\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jul 24 12:24:58.322914 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:58.322908 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78wrz\" (UniqueName: \"kubernetes.io/projected/2d20b0ba-b771-4ca1-9d4b-d134b28372d6-kube-api-access-78wrz\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jul 24 12:24:58.848969 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:58.848933 2555 generic.go:356] "Generic (PLEG): container finished" podID="2d20b0ba-b771-4ca1-9d4b-d134b28372d6" containerID="80394debe76c72e2319ea5116e2588c74b1df8ad257ee56200ee3f990c82da8e" exitCode=0 Jul 24 12:24:58.849192 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:58.848986 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-j2xsn" Jul 24 12:24:58.849192 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:58.849020 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-j2xsn" event={"ID":"2d20b0ba-b771-4ca1-9d4b-d134b28372d6","Type":"ContainerDied","Data":"80394debe76c72e2319ea5116e2588c74b1df8ad257ee56200ee3f990c82da8e"} Jul 24 12:24:58.849192 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:58.849119 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-j2xsn" event={"ID":"2d20b0ba-b771-4ca1-9d4b-d134b28372d6","Type":"ContainerDied","Data":"309f0c4c824879ec1a62b4173073d04a78441195cbc8d522104956cb2c3e7fe0"} Jul 24 12:24:58.849192 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:58.849146 2555 scope.go:117] "RemoveContainer" containerID="80394debe76c72e2319ea5116e2588c74b1df8ad257ee56200ee3f990c82da8e" Jul 24 12:24:58.865238 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:58.865215 2555 scope.go:117] "RemoveContainer" containerID="80394debe76c72e2319ea5116e2588c74b1df8ad257ee56200ee3f990c82da8e" Jul 24 12:24:58.865513 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:24:58.865494 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80394debe76c72e2319ea5116e2588c74b1df8ad257ee56200ee3f990c82da8e\": container with ID starting with 80394debe76c72e2319ea5116e2588c74b1df8ad257ee56200ee3f990c82da8e not found: ID does not exist" containerID="80394debe76c72e2319ea5116e2588c74b1df8ad257ee56200ee3f990c82da8e" Jul 24 12:24:58.865551 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:58.865524 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80394debe76c72e2319ea5116e2588c74b1df8ad257ee56200ee3f990c82da8e"} err="failed to get container status \"80394debe76c72e2319ea5116e2588c74b1df8ad257ee56200ee3f990c82da8e\": rpc error: code = NotFound desc = could not find container \"80394debe76c72e2319ea5116e2588c74b1df8ad257ee56200ee3f990c82da8e\": container with ID starting with 80394debe76c72e2319ea5116e2588c74b1df8ad257ee56200ee3f990c82da8e not found: ID does not exist" Jul 24 12:24:58.880778 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:58.880745 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j2xsn"] Jul 24 12:24:58.883584 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:58.883559 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j2xsn"] Jul 24 12:24:59.422553 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:24:59.422520 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d20b0ba-b771-4ca1-9d4b-d134b28372d6" path="/var/lib/kubelet/pods/2d20b0ba-b771-4ca1-9d4b-d134b28372d6/volumes" Jul 24 12:25:02.214311 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:02.214279 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6qwjm"] Jul 24 12:25:02.214719 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:02.214652 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d20b0ba-b771-4ca1-9d4b-d134b28372d6" containerName="limitador" Jul 24 12:25:02.214719 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:02.214663 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d20b0ba-b771-4ca1-9d4b-d134b28372d6" containerName="limitador" Jul 24 12:25:02.214719 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:02.214719 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d20b0ba-b771-4ca1-9d4b-d134b28372d6" containerName="limitador" Jul 24 12:25:02.219021 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:02.219002 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6qwjm" Jul 24 12:25:02.223386 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:02.223367 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 24 12:25:02.223878 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:02.223829 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-s4knc\"" Jul 24 12:25:02.224580 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:02.224563 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 24 12:25:02.224673 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:02.224614 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 24 12:25:02.230315 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:02.230291 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6qwjm"] Jul 24 12:25:02.356038 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:02.355997 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3cf8b266-c6a9-4ba8-8ec0-eb06cdd9d8d4-data\") pod \"postgres-69fb4594cf-6qwjm\" (UID: \"3cf8b266-c6a9-4ba8-8ec0-eb06cdd9d8d4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6qwjm" Jul 24 12:25:02.356245 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:02.356102 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n94l\" (UniqueName: \"kubernetes.io/projected/3cf8b266-c6a9-4ba8-8ec0-eb06cdd9d8d4-kube-api-access-6n94l\") pod \"postgres-69fb4594cf-6qwjm\" (UID: \"3cf8b266-c6a9-4ba8-8ec0-eb06cdd9d8d4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6qwjm" Jul 24 12:25:02.457198 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:02.457161 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3cf8b266-c6a9-4ba8-8ec0-eb06cdd9d8d4-data\") pod \"postgres-69fb4594cf-6qwjm\" (UID: \"3cf8b266-c6a9-4ba8-8ec0-eb06cdd9d8d4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6qwjm" Jul 24 12:25:02.457392 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:02.457220 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n94l\" (UniqueName: \"kubernetes.io/projected/3cf8b266-c6a9-4ba8-8ec0-eb06cdd9d8d4-kube-api-access-6n94l\") pod \"postgres-69fb4594cf-6qwjm\" (UID: \"3cf8b266-c6a9-4ba8-8ec0-eb06cdd9d8d4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6qwjm" Jul 24 12:25:02.457535 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:02.457514 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3cf8b266-c6a9-4ba8-8ec0-eb06cdd9d8d4-data\") pod \"postgres-69fb4594cf-6qwjm\" (UID: \"3cf8b266-c6a9-4ba8-8ec0-eb06cdd9d8d4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6qwjm" Jul 24 12:25:02.466579 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:02.466513 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n94l\" (UniqueName: \"kubernetes.io/projected/3cf8b266-c6a9-4ba8-8ec0-eb06cdd9d8d4-kube-api-access-6n94l\") pod \"postgres-69fb4594cf-6qwjm\" (UID: \"3cf8b266-c6a9-4ba8-8ec0-eb06cdd9d8d4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6qwjm" Jul 24 12:25:02.529047 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:02.529011 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6qwjm" Jul 24 12:25:02.678680 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:02.678654 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6qwjm"] Jul 24 12:25:02.680417 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:25:02.680389 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cf8b266_c6a9_4ba8_8ec0_eb06cdd9d8d4.slice/crio-be59359ff008701b653f89cf962465f27259fcbd0b56b000df76d23d34f85093 WatchSource:0}: Error finding container be59359ff008701b653f89cf962465f27259fcbd0b56b000df76d23d34f85093: Status 404 returned error can't find the container with id be59359ff008701b653f89cf962465f27259fcbd0b56b000df76d23d34f85093 Jul 24 12:25:02.870000 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:02.869920 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6qwjm" event={"ID":"3cf8b266-c6a9-4ba8-8ec0-eb06cdd9d8d4","Type":"ContainerStarted","Data":"be59359ff008701b653f89cf962465f27259fcbd0b56b000df76d23d34f85093"} Jul 24 12:25:08.906584 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:08.906545 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6qwjm" event={"ID":"3cf8b266-c6a9-4ba8-8ec0-eb06cdd9d8d4","Type":"ContainerStarted","Data":"56aa5c5e73a24dc1ce25dcc0c1723c3f299b2e7da91cc8d3230631d5dee2766d"} Jul 24 12:25:08.906990 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:08.906627 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6qwjm" Jul 24 12:25:08.937903 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:08.937840 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6qwjm" podStartSLOduration=1.7097345659999998 podStartE2EDuration="6.937823766s" totalImagesPullingTime="5.2280892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:25:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:25:08.935872124 +0000 UTC m=+501.987117116" watchObservedRunningTime="2026-07-24 12:25:08.937823766 +0000 UTC m=+501.989068757" Jul 24 12:25:14.941051 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:14.941019 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6qwjm" Jul 24 12:25:15.821316 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:15.821274 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56d5749476-swcbz"] Jul 24 12:25:15.875371 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:15.875333 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56d5749476-swcbz"] Jul 24 12:25:15.875536 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:15.875453 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56d5749476-swcbz" Jul 24 12:25:15.878234 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:15.878212 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 24 12:25:15.990757 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:15.990712 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/edfaabcd-7306-4bb8-a268-0104350876c9-tls-cert\") pod \"authorino-56d5749476-swcbz\" (UID: \"edfaabcd-7306-4bb8-a268-0104350876c9\") " pod="kuadrant-system/authorino-56d5749476-swcbz" Jul 24 12:25:15.991217 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:15.990846 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht6l2\" (UniqueName: \"kubernetes.io/projected/edfaabcd-7306-4bb8-a268-0104350876c9-kube-api-access-ht6l2\") pod \"authorino-56d5749476-swcbz\" (UID: \"edfaabcd-7306-4bb8-a268-0104350876c9\") " pod="kuadrant-system/authorino-56d5749476-swcbz" Jul 24 12:25:16.091795 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:16.091698 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht6l2\" (UniqueName: \"kubernetes.io/projected/edfaabcd-7306-4bb8-a268-0104350876c9-kube-api-access-ht6l2\") pod \"authorino-56d5749476-swcbz\" (UID: \"edfaabcd-7306-4bb8-a268-0104350876c9\") " pod="kuadrant-system/authorino-56d5749476-swcbz" Jul 24 12:25:16.091795 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:16.091774 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/edfaabcd-7306-4bb8-a268-0104350876c9-tls-cert\") pod \"authorino-56d5749476-swcbz\" (UID: \"edfaabcd-7306-4bb8-a268-0104350876c9\") " pod="kuadrant-system/authorino-56d5749476-swcbz" Jul 24 12:25:16.094362 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:16.094337 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/edfaabcd-7306-4bb8-a268-0104350876c9-tls-cert\") pod \"authorino-56d5749476-swcbz\" (UID: \"edfaabcd-7306-4bb8-a268-0104350876c9\") " pod="kuadrant-system/authorino-56d5749476-swcbz" Jul 24 12:25:16.100581 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:16.100552 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht6l2\" (UniqueName: \"kubernetes.io/projected/edfaabcd-7306-4bb8-a268-0104350876c9-kube-api-access-ht6l2\") pod \"authorino-56d5749476-swcbz\" (UID: \"edfaabcd-7306-4bb8-a268-0104350876c9\") " pod="kuadrant-system/authorino-56d5749476-swcbz" Jul 24 12:25:16.184693 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:16.184656 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56d5749476-swcbz" Jul 24 12:25:16.340822 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:16.340790 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56d5749476-swcbz"] Jul 24 12:25:16.343869 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:25:16.343789 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podedfaabcd_7306_4bb8_a268_0104350876c9.slice/crio-61efc07a474cf694ce4f0dd2f12e87fd8d21f2709bffc2696d41f7c242fd4930 WatchSource:0}: Error finding container 61efc07a474cf694ce4f0dd2f12e87fd8d21f2709bffc2696d41f7c242fd4930: Status 404 returned error can't find the container with id 61efc07a474cf694ce4f0dd2f12e87fd8d21f2709bffc2696d41f7c242fd4930 Jul 24 12:25:16.947662 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:16.947622 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56d5749476-swcbz" event={"ID":"edfaabcd-7306-4bb8-a268-0104350876c9","Type":"ContainerStarted","Data":"61efc07a474cf694ce4f0dd2f12e87fd8d21f2709bffc2696d41f7c242fd4930"} Jul 24 12:25:17.953405 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:17.953369 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56d5749476-swcbz" event={"ID":"edfaabcd-7306-4bb8-a268-0104350876c9","Type":"ContainerStarted","Data":"71aa9344dc60a89a8c9f277acc9c8699946ad26dbcc8778e68b9ea9cf6cf7c0e"} Jul 24 12:25:17.970964 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:17.970908 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-56d5749476-swcbz" podStartSLOduration=2.357002026 podStartE2EDuration="2.970889133s" totalImagesPullingTime="613.887107ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:25:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:25:17.969555278 +0000 UTC m=+511.020800269" watchObservedRunningTime="2026-07-24 12:25:17.970889133 +0000 UTC m=+511.022134169" Jul 24 12:25:18.001937 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:18.001892 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sdmpt"] Jul 24 12:25:18.002165 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:18.002138 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-sdmpt" podUID="9c3a739a-f725-49c5-b6d5-285d6f7d0566" containerName="authorino" containerID="cri-o://d889b5e6e33685ea5f19d2f0bdf45e049db7caa690aa0cacc847d1986cda5c58" gracePeriod=30 Jul 24 12:25:18.324153 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:18.324120 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-sdmpt" Jul 24 12:25:18.408874 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:18.408843 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcq2s\" (UniqueName: \"kubernetes.io/projected/9c3a739a-f725-49c5-b6d5-285d6f7d0566-kube-api-access-gcq2s\") pod \"9c3a739a-f725-49c5-b6d5-285d6f7d0566\" (UID: \"9c3a739a-f725-49c5-b6d5-285d6f7d0566\") " Jul 24 12:25:18.410924 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:18.410903 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c3a739a-f725-49c5-b6d5-285d6f7d0566-kube-api-access-gcq2s" (OuterVolumeSpecName: "kube-api-access-gcq2s") pod "9c3a739a-f725-49c5-b6d5-285d6f7d0566" (UID: "9c3a739a-f725-49c5-b6d5-285d6f7d0566"). InnerVolumeSpecName "kube-api-access-gcq2s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 12:25:18.509855 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:18.509815 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcq2s\" (UniqueName: \"kubernetes.io/projected/9c3a739a-f725-49c5-b6d5-285d6f7d0566-kube-api-access-gcq2s\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jul 24 12:25:18.959811 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:18.959776 2555 generic.go:356] "Generic (PLEG): container finished" podID="9c3a739a-f725-49c5-b6d5-285d6f7d0566" containerID="d889b5e6e33685ea5f19d2f0bdf45e049db7caa690aa0cacc847d1986cda5c58" exitCode=0 Jul 24 12:25:18.959811 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:18.959815 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-sdmpt" Jul 24 12:25:18.960364 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:18.959844 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-sdmpt" event={"ID":"9c3a739a-f725-49c5-b6d5-285d6f7d0566","Type":"ContainerDied","Data":"d889b5e6e33685ea5f19d2f0bdf45e049db7caa690aa0cacc847d1986cda5c58"} Jul 24 12:25:18.960364 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:18.959891 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-sdmpt" event={"ID":"9c3a739a-f725-49c5-b6d5-285d6f7d0566","Type":"ContainerDied","Data":"26b3bdf7d550412aa378779410e26eea8be93f47c7674254ab4458927b92f1a0"} Jul 24 12:25:18.960364 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:18.959914 2555 scope.go:117] "RemoveContainer" containerID="d889b5e6e33685ea5f19d2f0bdf45e049db7caa690aa0cacc847d1986cda5c58" Jul 24 12:25:18.968803 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:18.968704 2555 scope.go:117] "RemoveContainer" containerID="d889b5e6e33685ea5f19d2f0bdf45e049db7caa690aa0cacc847d1986cda5c58" Jul 24 12:25:18.969113 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:25:18.969088 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d889b5e6e33685ea5f19d2f0bdf45e049db7caa690aa0cacc847d1986cda5c58\": container with ID starting with d889b5e6e33685ea5f19d2f0bdf45e049db7caa690aa0cacc847d1986cda5c58 not found: ID does not exist" containerID="d889b5e6e33685ea5f19d2f0bdf45e049db7caa690aa0cacc847d1986cda5c58" Jul 24 12:25:18.969189 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:18.969124 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d889b5e6e33685ea5f19d2f0bdf45e049db7caa690aa0cacc847d1986cda5c58"} err="failed to get container status \"d889b5e6e33685ea5f19d2f0bdf45e049db7caa690aa0cacc847d1986cda5c58\": rpc error: code = NotFound desc = could not find container \"d889b5e6e33685ea5f19d2f0bdf45e049db7caa690aa0cacc847d1986cda5c58\": container with ID starting with d889b5e6e33685ea5f19d2f0bdf45e049db7caa690aa0cacc847d1986cda5c58 not found: ID does not exist" Jul 24 12:25:18.987040 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:18.987015 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sdmpt"] Jul 24 12:25:18.989676 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:18.989656 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sdmpt"] Jul 24 12:25:19.422444 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:19.422402 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c3a739a-f725-49c5-b6d5-285d6f7d0566" path="/var/lib/kubelet/pods/9c3a739a-f725-49c5-b6d5-285d6f7d0566/volumes" Jul 24 12:25:23.104285 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:23.104245 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5db9b94948-29zzr"] Jul 24 12:25:23.104751 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:23.104648 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c3a739a-f725-49c5-b6d5-285d6f7d0566" containerName="authorino" Jul 24 12:25:23.104751 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:23.104661 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c3a739a-f725-49c5-b6d5-285d6f7d0566" containerName="authorino" Jul 24 12:25:23.104751 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:23.104735 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c3a739a-f725-49c5-b6d5-285d6f7d0566" containerName="authorino" Jul 24 12:25:23.111884 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:23.111861 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5db9b94948-29zzr" Jul 24 12:25:23.114800 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:23.114777 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 24 12:25:23.114934 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:23.114888 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 24 12:25:23.116771 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:23.116744 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-lwvjd\"" Jul 24 12:25:23.123903 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:23.123876 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5db9b94948-29zzr"] Jul 24 12:25:23.144281 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:23.144246 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/91ab7cbe-0b6f-4526-b45a-fe2a143e37a1-webhook-cert\") pod \"maas-controller-5db9b94948-29zzr\" (UID: \"91ab7cbe-0b6f-4526-b45a-fe2a143e37a1\") " pod="opendatahub/maas-controller-5db9b94948-29zzr" Jul 24 12:25:23.144464 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:23.144360 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvk6d\" (UniqueName: \"kubernetes.io/projected/91ab7cbe-0b6f-4526-b45a-fe2a143e37a1-kube-api-access-pvk6d\") pod \"maas-controller-5db9b94948-29zzr\" (UID: \"91ab7cbe-0b6f-4526-b45a-fe2a143e37a1\") " pod="opendatahub/maas-controller-5db9b94948-29zzr" Jul 24 12:25:23.245228 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:23.245180 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/91ab7cbe-0b6f-4526-b45a-fe2a143e37a1-webhook-cert\") pod \"maas-controller-5db9b94948-29zzr\" (UID: \"91ab7cbe-0b6f-4526-b45a-fe2a143e37a1\") " pod="opendatahub/maas-controller-5db9b94948-29zzr" Jul 24 12:25:23.245417 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:23.245250 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvk6d\" (UniqueName: \"kubernetes.io/projected/91ab7cbe-0b6f-4526-b45a-fe2a143e37a1-kube-api-access-pvk6d\") pod \"maas-controller-5db9b94948-29zzr\" (UID: \"91ab7cbe-0b6f-4526-b45a-fe2a143e37a1\") " pod="opendatahub/maas-controller-5db9b94948-29zzr" Jul 24 12:25:23.245417 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:25:23.245323 2555 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 24 12:25:23.245417 ip-10-0-139-109 kubenswrapper[2555]: E0724 12:25:23.245391 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91ab7cbe-0b6f-4526-b45a-fe2a143e37a1-webhook-cert podName:91ab7cbe-0b6f-4526-b45a-fe2a143e37a1 nodeName:}" failed. No retries permitted until 2026-07-24 12:25:23.745374539 +0000 UTC m=+516.796619510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/91ab7cbe-0b6f-4526-b45a-fe2a143e37a1-webhook-cert") pod "maas-controller-5db9b94948-29zzr" (UID: "91ab7cbe-0b6f-4526-b45a-fe2a143e37a1") : secret "maas-controller-webhook-cert" not found Jul 24 12:25:23.254904 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:23.254868 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvk6d\" (UniqueName: \"kubernetes.io/projected/91ab7cbe-0b6f-4526-b45a-fe2a143e37a1-kube-api-access-pvk6d\") pod \"maas-controller-5db9b94948-29zzr\" (UID: \"91ab7cbe-0b6f-4526-b45a-fe2a143e37a1\") " pod="opendatahub/maas-controller-5db9b94948-29zzr" Jul 24 12:25:23.748922 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:23.748883 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/91ab7cbe-0b6f-4526-b45a-fe2a143e37a1-webhook-cert\") pod \"maas-controller-5db9b94948-29zzr\" (UID: \"91ab7cbe-0b6f-4526-b45a-fe2a143e37a1\") " pod="opendatahub/maas-controller-5db9b94948-29zzr" Jul 24 12:25:23.751334 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:23.751304 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/91ab7cbe-0b6f-4526-b45a-fe2a143e37a1-webhook-cert\") pod \"maas-controller-5db9b94948-29zzr\" (UID: \"91ab7cbe-0b6f-4526-b45a-fe2a143e37a1\") " pod="opendatahub/maas-controller-5db9b94948-29zzr" Jul 24 12:25:24.025103 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:24.024981 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5db9b94948-29zzr" Jul 24 12:25:24.169163 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:24.169134 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5db9b94948-29zzr"] Jul 24 12:25:24.170275 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:25:24.170250 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91ab7cbe_0b6f_4526_b45a_fe2a143e37a1.slice/crio-8eb51b2a797db39199fff0053529661dc358ed8e43f7fc1eef5666c2f7b0c4d9 WatchSource:0}: Error finding container 8eb51b2a797db39199fff0053529661dc358ed8e43f7fc1eef5666c2f7b0c4d9: Status 404 returned error can't find the container with id 8eb51b2a797db39199fff0053529661dc358ed8e43f7fc1eef5666c2f7b0c4d9 Jul 24 12:25:24.993306 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:24.993212 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5db9b94948-29zzr" event={"ID":"91ab7cbe-0b6f-4526-b45a-fe2a143e37a1","Type":"ContainerStarted","Data":"8eb51b2a797db39199fff0053529661dc358ed8e43f7fc1eef5666c2f7b0c4d9"} Jul 24 12:25:27.006447 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:27.006408 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5db9b94948-29zzr" event={"ID":"91ab7cbe-0b6f-4526-b45a-fe2a143e37a1","Type":"ContainerStarted","Data":"a6aa06b7e0b85c9f3609747c0a8d2cf83ef2a4d52833e09c277ff496b04206dc"} Jul 24 12:25:27.006957 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:27.006537 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5db9b94948-29zzr" Jul 24 12:25:27.083456 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:27.083397 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5db9b94948-29zzr" podStartSLOduration=1.67944755 podStartE2EDuration="4.083379603s" totalImagesPullingTime="2.403932053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:25:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:25:27.08274195 +0000 UTC m=+520.133986968" watchObservedRunningTime="2026-07-24 12:25:27.083379603 +0000 UTC m=+520.134624603" Jul 24 12:25:38.014400 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:25:38.014365 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5db9b94948-29zzr" Jul 24 12:26:14.752652 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:14.752614 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-56d5749476-swcbz_edfaabcd-7306-4bb8-a268-0104350876c9/authorino/0.log" Jul 24 12:26:20.305202 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:20.305170 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7rz8z_9f95c269-50e4-4cc3-a313-3fe31558e657/manager/0.log" Jul 24 12:26:20.555889 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:20.555796 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5db9b94948-29zzr_91ab7cbe-0b6f-4526-b45a-fe2a143e37a1/manager/0.log" Jul 24 12:26:20.669939 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:20.669910 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-fm44z_6b4aba7d-334a-4dd0-acec-659860725298/server/0.log" Jul 24 12:26:20.794931 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:20.794895 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2kds8_61e8ba4a-69c3-4fab-8c14-f1fe50dda8da/manager/0.log" Jul 24 12:26:21.044678 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:21.044646 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bb8c67698-dr98h_7f233df4-c545-448e-9c80-609e57e9fd77/copy-manifests/0.log" Jul 24 12:26:21.062351 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:21.062310 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bb8c67698-dr98h_7f233df4-c545-448e-9c80-609e57e9fd77/manager/0.log" Jul 24 12:26:21.657889 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:21.657862 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-6qwjm_3cf8b266-c6a9-4ba8-8ec0-eb06cdd9d8d4/postgres/0.log" Jul 24 12:26:23.032654 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:23.032623 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-56d5749476-swcbz_edfaabcd-7306-4bb8-a268-0104350876c9/authorino/0.log" Jul 24 12:26:23.162524 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:23.162494 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-s4mwm_3a31f161-0f27-4fc6-9a4c-95a8c3ca4b06/manager/0.log" Jul 24 12:26:23.275443 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:23.275410 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-9hppg_cfd48e50-ba58-493a-961c-cf746c97ce53/manager/0.log" Jul 24 12:26:23.505456 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:23.505385 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-jh7vg_1e54c057-f582-4896-aaa6-2b13f8a5d387/registry-server/0.log" Jul 24 12:26:23.632866 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:23.632836 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-g4q5m_6c7f0d60-839e-4aea-97c6-3cc399a4cfa5/manager/0.log" Jul 24 12:26:23.874737 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:23.874648 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-ht65x_29eb948a-dbb2-494d-b808-f70f9e92025a/manager/0.log" Jul 24 12:26:24.634968 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:24.634937 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67cd644d69-pg99t_101cde89-dec2-407b-85b4-ba133f974243/kube-auth-proxy/0.log" Jul 24 12:26:25.132950 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:25.132919 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-847c5d5c9-ljlw8_05ae7260-6786-4542-bf6d-4979f4d5bf1d/router/0.log" Jul 24 12:26:34.389764 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:34.389729 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rrwlt_5eec886f-16aa-409b-97c6-743f0ff1dacf/global-pull-secret-syncer/0.log" Jul 24 12:26:34.538619 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:34.538582 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-s74ph_00b2c77a-a7be-488f-bcfc-0d4e139becf3/konnectivity-agent/0.log" Jul 24 12:26:34.627008 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:34.626970 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-109.ec2.internal_4ae05b6c2b20a8b40089e54c95c6a627/haproxy/0.log" Jul 24 12:26:39.676122 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:39.676090 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-56d5749476-swcbz_edfaabcd-7306-4bb8-a268-0104350876c9/authorino/0.log" Jul 24 12:26:39.705759 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:39.705730 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-s4mwm_3a31f161-0f27-4fc6-9a4c-95a8c3ca4b06/manager/0.log" Jul 24 12:26:39.736639 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:39.736605 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-9hppg_cfd48e50-ba58-493a-961c-cf746c97ce53/manager/0.log" Jul 24 12:26:39.804791 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:39.804760 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-jh7vg_1e54c057-f582-4896-aaa6-2b13f8a5d387/registry-server/0.log" Jul 24 12:26:39.839328 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:39.839289 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-g4q5m_6c7f0d60-839e-4aea-97c6-3cc399a4cfa5/manager/0.log" Jul 24 12:26:39.908948 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:39.908917 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-ht65x_29eb948a-dbb2-494d-b808-f70f9e92025a/manager/0.log" Jul 24 12:26:41.785796 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:41.785763 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-prgmm_4a130a4a-ed5a-4a1e-821a-e5e0c115a0de/cluster-monitoring-operator/0.log" Jul 24 12:26:42.192640 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:42.192616 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ft2vq_e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f/node-exporter/0.log" Jul 24 12:26:42.218642 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:42.218607 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ft2vq_e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f/kube-rbac-proxy/0.log" Jul 24 12:26:42.242139 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:42.242111 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ft2vq_e2a3c9fa-7064-4cd8-9496-d13fa1b93e2f/init-textfile/0.log" Jul 24 12:26:44.089165 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:44.089130 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-576dn_c385960c-6bf7-4b33-8ce0-f627cb711d9c/networking-console-plugin/0.log" Jul 24 12:26:44.252071 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:44.252035 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zqvdk/perf-node-gather-daemonset-kk2m2"] Jul 24 12:26:44.255552 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:44.255533 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zqvdk/perf-node-gather-daemonset-kk2m2" Jul 24 12:26:44.259986 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:44.259964 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zqvdk\"/\"openshift-service-ca.crt\"" Jul 24 12:26:44.261009 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:44.260984 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zqvdk\"/\"default-dockercfg-rtf56\"" Jul 24 12:26:44.261126 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:44.261012 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zqvdk\"/\"kube-root-ca.crt\"" Jul 24 12:26:44.270248 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:44.270222 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zqvdk/perf-node-gather-daemonset-kk2m2"] Jul 24 12:26:44.340723 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:44.340640 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4cbd4368-2495-4ced-89e9-6422228480e3-lib-modules\") pod \"perf-node-gather-daemonset-kk2m2\" (UID: \"4cbd4368-2495-4ced-89e9-6422228480e3\") " pod="openshift-must-gather-zqvdk/perf-node-gather-daemonset-kk2m2" Jul 24 12:26:44.340877 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:44.340723 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnvb8\" (UniqueName: \"kubernetes.io/projected/4cbd4368-2495-4ced-89e9-6422228480e3-kube-api-access-xnvb8\") pod \"perf-node-gather-daemonset-kk2m2\" (UID: \"4cbd4368-2495-4ced-89e9-6422228480e3\") " pod="openshift-must-gather-zqvdk/perf-node-gather-daemonset-kk2m2" Jul 24 12:26:44.340877 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:44.340742 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cbd4368-2495-4ced-89e9-6422228480e3-sys\") pod \"perf-node-gather-daemonset-kk2m2\" (UID: \"4cbd4368-2495-4ced-89e9-6422228480e3\") " pod="openshift-must-gather-zqvdk/perf-node-gather-daemonset-kk2m2" Jul 24 12:26:44.340877 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:44.340760 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4cbd4368-2495-4ced-89e9-6422228480e3-proc\") pod \"perf-node-gather-daemonset-kk2m2\" (UID: \"4cbd4368-2495-4ced-89e9-6422228480e3\") " pod="openshift-must-gather-zqvdk/perf-node-gather-daemonset-kk2m2" Jul 24 12:26:44.340877 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:44.340817 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4cbd4368-2495-4ced-89e9-6422228480e3-podres\") pod \"perf-node-gather-daemonset-kk2m2\" (UID: \"4cbd4368-2495-4ced-89e9-6422228480e3\") " pod="openshift-must-gather-zqvdk/perf-node-gather-daemonset-kk2m2" Jul 24 12:26:44.441902 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:44.441860 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4cbd4368-2495-4ced-89e9-6422228480e3-podres\") pod \"perf-node-gather-daemonset-kk2m2\" (UID: \"4cbd4368-2495-4ced-89e9-6422228480e3\") " pod="openshift-must-gather-zqvdk/perf-node-gather-daemonset-kk2m2" Jul 24 12:26:44.442127 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:44.441912 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4cbd4368-2495-4ced-89e9-6422228480e3-lib-modules\") pod \"perf-node-gather-daemonset-kk2m2\" (UID: \"4cbd4368-2495-4ced-89e9-6422228480e3\") " pod="openshift-must-gather-zqvdk/perf-node-gather-daemonset-kk2m2" Jul 24 12:26:44.442127 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:44.441961 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnvb8\" (UniqueName: \"kubernetes.io/projected/4cbd4368-2495-4ced-89e9-6422228480e3-kube-api-access-xnvb8\") pod \"perf-node-gather-daemonset-kk2m2\" (UID: \"4cbd4368-2495-4ced-89e9-6422228480e3\") " pod="openshift-must-gather-zqvdk/perf-node-gather-daemonset-kk2m2" Jul 24 12:26:44.442127 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:44.441979 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cbd4368-2495-4ced-89e9-6422228480e3-sys\") pod \"perf-node-gather-daemonset-kk2m2\" (UID: \"4cbd4368-2495-4ced-89e9-6422228480e3\") " pod="openshift-must-gather-zqvdk/perf-node-gather-daemonset-kk2m2" Jul 24 12:26:44.442127 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:44.441994 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4cbd4368-2495-4ced-89e9-6422228480e3-proc\") pod \"perf-node-gather-daemonset-kk2m2\" (UID: \"4cbd4368-2495-4ced-89e9-6422228480e3\") " pod="openshift-must-gather-zqvdk/perf-node-gather-daemonset-kk2m2" Jul 24 12:26:44.442127 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:44.442048 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4cbd4368-2495-4ced-89e9-6422228480e3-podres\") pod \"perf-node-gather-daemonset-kk2m2\" (UID: \"4cbd4368-2495-4ced-89e9-6422228480e3\") " pod="openshift-must-gather-zqvdk/perf-node-gather-daemonset-kk2m2" Jul 24 12:26:44.442325 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:44.442135 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cbd4368-2495-4ced-89e9-6422228480e3-sys\") pod \"perf-node-gather-daemonset-kk2m2\" (UID: \"4cbd4368-2495-4ced-89e9-6422228480e3\") " pod="openshift-must-gather-zqvdk/perf-node-gather-daemonset-kk2m2" Jul 24 12:26:44.442325 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:44.442141 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4cbd4368-2495-4ced-89e9-6422228480e3-proc\") pod \"perf-node-gather-daemonset-kk2m2\" (UID: \"4cbd4368-2495-4ced-89e9-6422228480e3\") " pod="openshift-must-gather-zqvdk/perf-node-gather-daemonset-kk2m2" Jul 24 12:26:44.442325 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:44.442167 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4cbd4368-2495-4ced-89e9-6422228480e3-lib-modules\") pod \"perf-node-gather-daemonset-kk2m2\" (UID: \"4cbd4368-2495-4ced-89e9-6422228480e3\") " pod="openshift-must-gather-zqvdk/perf-node-gather-daemonset-kk2m2" Jul 24 12:26:44.450991 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:44.450970 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnvb8\" (UniqueName: \"kubernetes.io/projected/4cbd4368-2495-4ced-89e9-6422228480e3-kube-api-access-xnvb8\") pod \"perf-node-gather-daemonset-kk2m2\" (UID: \"4cbd4368-2495-4ced-89e9-6422228480e3\") " pod="openshift-must-gather-zqvdk/perf-node-gather-daemonset-kk2m2" Jul 24 12:26:44.564742 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:44.564704 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zqvdk/perf-node-gather-daemonset-kk2m2" Jul 24 12:26:44.700781 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:44.700751 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zqvdk/perf-node-gather-daemonset-kk2m2"] Jul 24 12:26:44.702949 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:26:44.702925 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4cbd4368_2495_4ced_89e9_6422228480e3.slice/crio-2cc5f7d7096a227c59774c102d94dba0335ab74f4eb6f0a52016068ba5c33d7a WatchSource:0}: Error finding container 2cc5f7d7096a227c59774c102d94dba0335ab74f4eb6f0a52016068ba5c33d7a: Status 404 returned error can't find the container with id 2cc5f7d7096a227c59774c102d94dba0335ab74f4eb6f0a52016068ba5c33d7a Jul 24 12:26:44.808281 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:44.808184 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-g5v4m_7e1b58e8-bdad-423e-a12b-a8b0fc1c900e/console-operator/1.log" Jul 24 12:26:44.816915 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:44.816885 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-g5v4m_7e1b58e8-bdad-423e-a12b-a8b0fc1c900e/console-operator/2.log" Jul 24 12:26:45.207314 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:45.207280 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf"] Jul 24 12:26:45.210770 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:45.210753 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf" Jul 24 12:26:45.215737 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:45.215710 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 24 12:26:45.216535 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:45.216514 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 24 12:26:45.216634 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:45.216536 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 24 12:26:45.216634 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:45.216516 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ghnpm\"" Jul 24 12:26:45.222624 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:45.222597 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf"] Jul 24 12:26:45.249543 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:45.249512 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvlbs\" (UniqueName: \"kubernetes.io/projected/4f898812-8703-4b6b-aaaa-f26833c2d629-kube-api-access-rvlbs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf\" (UID: \"4f898812-8703-4b6b-aaaa-f26833c2d629\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf" Jul 24 12:26:45.249721 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:45.249556 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f898812-8703-4b6b-aaaa-f26833c2d629-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf\" (UID: \"4f898812-8703-4b6b-aaaa-f26833c2d629\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf" Jul 24 12:26:45.249721 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:45.249580 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f898812-8703-4b6b-aaaa-f26833c2d629-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf\" (UID: \"4f898812-8703-4b6b-aaaa-f26833c2d629\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf" Jul 24 12:26:45.249721 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:45.249637 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f898812-8703-4b6b-aaaa-f26833c2d629-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf\" (UID: \"4f898812-8703-4b6b-aaaa-f26833c2d629\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf" Jul 24 12:26:45.249721 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:45.249693 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f898812-8703-4b6b-aaaa-f26833c2d629-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf\" (UID: \"4f898812-8703-4b6b-aaaa-f26833c2d629\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf" Jul 24 12:26:45.249721 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:45.249709 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f898812-8703-4b6b-aaaa-f26833c2d629-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf\" (UID: \"4f898812-8703-4b6b-aaaa-f26833c2d629\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf" Jul 24 12:26:45.351150 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:45.351110 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f898812-8703-4b6b-aaaa-f26833c2d629-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf\" (UID: \"4f898812-8703-4b6b-aaaa-f26833c2d629\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf" Jul 24 12:26:45.351150 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:45.351154 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f898812-8703-4b6b-aaaa-f26833c2d629-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf\" (UID: \"4f898812-8703-4b6b-aaaa-f26833c2d629\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf" Jul 24 12:26:45.351405 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:45.351200 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f898812-8703-4b6b-aaaa-f26833c2d629-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf\" (UID: \"4f898812-8703-4b6b-aaaa-f26833c2d629\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf" Jul 24 12:26:45.351405 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:45.351267 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f898812-8703-4b6b-aaaa-f26833c2d629-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf\" (UID: \"4f898812-8703-4b6b-aaaa-f26833c2d629\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf" Jul 24 12:26:45.351405 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:45.351288 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f898812-8703-4b6b-aaaa-f26833c2d629-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf\" (UID: \"4f898812-8703-4b6b-aaaa-f26833c2d629\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf" Jul 24 12:26:45.351405 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:45.351329 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvlbs\" (UniqueName: \"kubernetes.io/projected/4f898812-8703-4b6b-aaaa-f26833c2d629-kube-api-access-rvlbs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf\" (UID: \"4f898812-8703-4b6b-aaaa-f26833c2d629\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf" Jul 24 12:26:45.351704 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:45.351681 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f898812-8703-4b6b-aaaa-f26833c2d629-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf\" (UID: \"4f898812-8703-4b6b-aaaa-f26833c2d629\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf" Jul 24 12:26:45.351782 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:45.351760 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f898812-8703-4b6b-aaaa-f26833c2d629-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf\" (UID: \"4f898812-8703-4b6b-aaaa-f26833c2d629\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf" Jul 24 12:26:45.351824 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:45.351792 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f898812-8703-4b6b-aaaa-f26833c2d629-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf\" (UID: \"4f898812-8703-4b6b-aaaa-f26833c2d629\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf" Jul 24 12:26:45.353689 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:45.353670 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f898812-8703-4b6b-aaaa-f26833c2d629-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf\" (UID: \"4f898812-8703-4b6b-aaaa-f26833c2d629\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf" Jul 24 12:26:45.353757 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:45.353738 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f898812-8703-4b6b-aaaa-f26833c2d629-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf\" (UID: \"4f898812-8703-4b6b-aaaa-f26833c2d629\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf" Jul 24 12:26:45.360083 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:45.360037 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvlbs\" (UniqueName: \"kubernetes.io/projected/4f898812-8703-4b6b-aaaa-f26833c2d629-kube-api-access-rvlbs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf\" (UID: \"4f898812-8703-4b6b-aaaa-f26833c2d629\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf" Jul 24 12:26:45.428439 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:45.428412 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-kg2nr_ea5a6ec0-554e-47e8-9e7b-ebaeec1c368d/download-server/0.log" Jul 24 12:26:45.429853 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:45.429831 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zqvdk/perf-node-gather-daemonset-kk2m2" event={"ID":"4cbd4368-2495-4ced-89e9-6422228480e3","Type":"ContainerStarted","Data":"52bd43462970cf5856389b1d65f632dc14cc649bd40c679e3727e3d4d491bc20"} Jul 24 12:26:45.429963 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:45.429873 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zqvdk/perf-node-gather-daemonset-kk2m2" event={"ID":"4cbd4368-2495-4ced-89e9-6422228480e3","Type":"ContainerStarted","Data":"2cc5f7d7096a227c59774c102d94dba0335ab74f4eb6f0a52016068ba5c33d7a"} Jul 24 12:26:45.429963 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:45.429920 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zqvdk/perf-node-gather-daemonset-kk2m2" Jul 24 12:26:45.450750 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:45.450698 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zqvdk/perf-node-gather-daemonset-kk2m2" podStartSLOduration=1.450679723 podStartE2EDuration="1.450679723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:26:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:26:45.4486166 +0000 UTC m=+598.499861614" watchObservedRunningTime="2026-07-24 12:26:45.450679723 +0000 UTC m=+598.501924715" Jul 24 12:26:45.522288 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:45.522194 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf" Jul 24 12:26:45.660245 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:45.660212 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf"] Jul 24 12:26:45.662563 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:26:45.662534 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f898812_8703_4b6b_aaaa_f26833c2d629.slice/crio-f97c34c9c4a8a4cbe84e06b3186fb5295075d076d4bf3c68bcc134ef29ccf0a2 WatchSource:0}: Error finding container f97c34c9c4a8a4cbe84e06b3186fb5295075d076d4bf3c68bcc134ef29ccf0a2: Status 404 returned error can't find the container with id f97c34c9c4a8a4cbe84e06b3186fb5295075d076d4bf3c68bcc134ef29ccf0a2 Jul 24 12:26:46.029516 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:46.029481 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-c9nwk_c22f8eb3-8726-43ce-8818-ca6ad3392b6d/volume-data-source-validator/0.log" Jul 24 12:26:46.436896 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:46.436854 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf" event={"ID":"4f898812-8703-4b6b-aaaa-f26833c2d629","Type":"ContainerStarted","Data":"f97c34c9c4a8a4cbe84e06b3186fb5295075d076d4bf3c68bcc134ef29ccf0a2"} Jul 24 12:26:47.281274 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:47.281240 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8q6d8_b8daa84c-73b5-4346-8f92-81dd451dfaa5/dns/0.log" Jul 24 12:26:47.307324 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:47.307297 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8q6d8_b8daa84c-73b5-4346-8f92-81dd451dfaa5/kube-rbac-proxy/0.log" Jul 24 12:26:47.367979 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:47.367952 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-g5v4m_7e1b58e8-bdad-423e-a12b-a8b0fc1c900e/console-operator/1.log" Jul 24 12:26:47.372786 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:47.372764 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-g5v4m_7e1b58e8-bdad-423e-a12b-a8b0fc1c900e/console-operator/1.log" Jul 24 12:26:47.376901 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:47.376883 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ssvdc_4ce505f1-38d9-4827-9141-b691d722aa05/ovn-acl-logging/0.log" Jul 24 12:26:47.381700 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:47.381682 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ssvdc_4ce505f1-38d9-4827-9141-b691d722aa05/ovn-acl-logging/0.log" Jul 24 12:26:47.416581 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:47.416552 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qhshz_6dc76beb-b2b1-422c-a272-5623d2fb2f5e/dns-node-resolver/0.log" Jul 24 12:26:47.443204 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:47.443167 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf" event={"ID":"4f898812-8703-4b6b-aaaa-f26833c2d629","Type":"ContainerStarted","Data":"2d8027ac536d876ded524df686c02e14fa5c43f40599087bd518648e37957caa"} Jul 24 12:26:47.470048 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:47.469988 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf" podStartSLOduration=1.323758007 podStartE2EDuration="2.469973025s" totalImagesPullingTime="1.146215018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:26:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:26:47.468284648 +0000 UTC m=+600.519529640" watchObservedRunningTime="2026-07-24 12:26:47.469973025 +0000 UTC m=+600.521218041" Jul 24 12:26:48.099293 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:48.099262 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bwdsq_aebc0623-951c-431c-9ac0-f7c139f35c12/node-ca/0.log" Jul 24 12:26:49.181148 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:49.181115 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67cd644d69-pg99t_101cde89-dec2-407b-85b4-ba133f974243/kube-auth-proxy/0.log" Jul 24 12:26:49.281004 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:49.280973 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-847c5d5c9-ljlw8_05ae7260-6786-4542-bf6d-4979f4d5bf1d/router/0.log" Jul 24 12:26:49.980539 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:49.980506 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mzw5p_22ea11f4-48aa-48a3-9310-eb5ad5ceef5c/serve-healthcheck-canary/0.log" Jul 24 12:26:50.485992 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:50.485955 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-mttrp_1d02e6e2-54f3-43fc-a712-faf751240dad/insights-operator/1.log" Jul 24 12:26:50.486625 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:50.486603 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-mttrp_1d02e6e2-54f3-43fc-a712-faf751240dad/insights-operator/0.log" Jul 24 12:26:50.688792 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:50.688760 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qsfrm_5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db/kube-rbac-proxy/0.log" Jul 24 12:26:50.711016 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:50.710985 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qsfrm_5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db/exporter/0.log" Jul 24 12:26:50.732829 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:50.732799 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qsfrm_5dfaeea8-5ae6-4ea4-b735-dfd9bd4747db/extractor/0.log" Jul 24 12:26:51.446553 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:51.446526 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zqvdk/perf-node-gather-daemonset-kk2m2" Jul 24 12:26:53.005328 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:53.005302 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7rz8z_9f95c269-50e4-4cc3-a313-3fe31558e657/manager/0.log" Jul 24 12:26:53.061559 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:53.061524 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5db9b94948-29zzr_91ab7cbe-0b6f-4526-b45a-fe2a143e37a1/manager/0.log" Jul 24 12:26:53.086007 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:53.085979 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-fm44z_6b4aba7d-334a-4dd0-acec-659860725298/server/0.log" Jul 24 12:26:53.148843 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:53.148814 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2kds8_61e8ba4a-69c3-4fab-8c14-f1fe50dda8da/manager/0.log" Jul 24 12:26:53.275092 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:53.274995 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bb8c67698-dr98h_7f233df4-c545-448e-9c80-609e57e9fd77/manager/0.log" Jul 24 12:26:53.297637 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:53.297607 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bb8c67698-dr98h_7f233df4-c545-448e-9c80-609e57e9fd77/copy-manifests/0.log" Jul 24 12:26:54.799524 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:54.799431 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67cd644d69-pg99t_101cde89-dec2-407b-85b4-ba133f974243/kube-auth-proxy/0.log" Jul 24 12:26:54.865239 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:54.865206 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-847c5d5c9-ljlw8_05ae7260-6786-4542-bf6d-4979f4d5bf1d/router/0.log" Jul 24 12:26:55.523140 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:55.523104 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf" Jul 24 12:26:55.523316 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:55.523173 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf" Jul 24 12:26:55.536035 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:55.536009 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf" Jul 24 12:26:56.085050 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:56.084967 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67cd644d69-pg99t_101cde89-dec2-407b-85b4-ba133f974243/kube-auth-proxy/0.log" Jul 24 12:26:56.155522 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:56.155494 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-847c5d5c9-ljlw8_05ae7260-6786-4542-bf6d-4979f4d5bf1d/router/0.log" Jul 24 12:26:56.500830 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:56.500801 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46fdf" Jul 24 12:26:59.408038 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:59.408005 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7wrsx"] Jul 24 12:26:59.419444 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:59.419416 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wrsx" Jul 24 12:26:59.423070 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:59.423031 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 24 12:26:59.428645 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:59.428611 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7wrsx"] Jul 24 12:26:59.478202 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:59.478161 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd80ddd6-ac7f-4cbd-b8fe-378d50f61693-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wrsx\" (UID: \"cd80ddd6-ac7f-4cbd-b8fe-378d50f61693\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wrsx" Jul 24 12:26:59.478202 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:59.478204 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lfgr\" (UniqueName: \"kubernetes.io/projected/cd80ddd6-ac7f-4cbd-b8fe-378d50f61693-kube-api-access-6lfgr\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wrsx\" (UID: \"cd80ddd6-ac7f-4cbd-b8fe-378d50f61693\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wrsx" Jul 24 12:26:59.478458 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:59.478283 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd80ddd6-ac7f-4cbd-b8fe-378d50f61693-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wrsx\" (UID: \"cd80ddd6-ac7f-4cbd-b8fe-378d50f61693\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wrsx" Jul 24 12:26:59.478458 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:59.478347 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd80ddd6-ac7f-4cbd-b8fe-378d50f61693-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wrsx\" (UID: \"cd80ddd6-ac7f-4cbd-b8fe-378d50f61693\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wrsx" Jul 24 12:26:59.478458 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:59.478395 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd80ddd6-ac7f-4cbd-b8fe-378d50f61693-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wrsx\" (UID: \"cd80ddd6-ac7f-4cbd-b8fe-378d50f61693\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wrsx" Jul 24 12:26:59.478458 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:59.478433 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd80ddd6-ac7f-4cbd-b8fe-378d50f61693-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wrsx\" (UID: \"cd80ddd6-ac7f-4cbd-b8fe-378d50f61693\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wrsx" Jul 24 12:26:59.579404 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:59.579367 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd80ddd6-ac7f-4cbd-b8fe-378d50f61693-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wrsx\" (UID: \"cd80ddd6-ac7f-4cbd-b8fe-378d50f61693\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wrsx" Jul 24 12:26:59.579605 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:59.579411 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd80ddd6-ac7f-4cbd-b8fe-378d50f61693-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wrsx\" (UID: \"cd80ddd6-ac7f-4cbd-b8fe-378d50f61693\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wrsx" Jul 24 12:26:59.579605 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:59.579456 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd80ddd6-ac7f-4cbd-b8fe-378d50f61693-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wrsx\" (UID: \"cd80ddd6-ac7f-4cbd-b8fe-378d50f61693\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wrsx" Jul 24 12:26:59.579605 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:59.579476 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lfgr\" (UniqueName: \"kubernetes.io/projected/cd80ddd6-ac7f-4cbd-b8fe-378d50f61693-kube-api-access-6lfgr\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wrsx\" (UID: \"cd80ddd6-ac7f-4cbd-b8fe-378d50f61693\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wrsx" Jul 24 12:26:59.579605 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:59.579511 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd80ddd6-ac7f-4cbd-b8fe-378d50f61693-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wrsx\" (UID: \"cd80ddd6-ac7f-4cbd-b8fe-378d50f61693\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wrsx" Jul 24 12:26:59.579605 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:59.579529 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd80ddd6-ac7f-4cbd-b8fe-378d50f61693-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wrsx\" (UID: \"cd80ddd6-ac7f-4cbd-b8fe-378d50f61693\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wrsx" Jul 24 12:26:59.579883 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:59.579858 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd80ddd6-ac7f-4cbd-b8fe-378d50f61693-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wrsx\" (UID: \"cd80ddd6-ac7f-4cbd-b8fe-378d50f61693\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wrsx" Jul 24 12:26:59.579935 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:59.579908 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd80ddd6-ac7f-4cbd-b8fe-378d50f61693-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wrsx\" (UID: \"cd80ddd6-ac7f-4cbd-b8fe-378d50f61693\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wrsx" Jul 24 12:26:59.579977 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:59.579945 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd80ddd6-ac7f-4cbd-b8fe-378d50f61693-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wrsx\" (UID: \"cd80ddd6-ac7f-4cbd-b8fe-378d50f61693\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wrsx" Jul 24 12:26:59.581812 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:59.581792 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd80ddd6-ac7f-4cbd-b8fe-378d50f61693-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wrsx\" (UID: \"cd80ddd6-ac7f-4cbd-b8fe-378d50f61693\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wrsx" Jul 24 12:26:59.581957 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:59.581939 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd80ddd6-ac7f-4cbd-b8fe-378d50f61693-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wrsx\" (UID: \"cd80ddd6-ac7f-4cbd-b8fe-378d50f61693\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wrsx" Jul 24 12:26:59.591376 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:59.591351 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lfgr\" (UniqueName: \"kubernetes.io/projected/cd80ddd6-ac7f-4cbd-b8fe-378d50f61693-kube-api-access-6lfgr\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wrsx\" (UID: \"cd80ddd6-ac7f-4cbd-b8fe-378d50f61693\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wrsx" Jul 24 12:26:59.655567 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:59.655531 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-zxcmg_0fb49080-c837-4e18-a53c-c2111df9af22/migrator/0.log" Jul 24 12:26:59.684268 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:59.684179 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-zxcmg_0fb49080-c837-4e18-a53c-c2111df9af22/graceful-termination/0.log" Jul 24 12:26:59.732837 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:59.732802 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wrsx" Jul 24 12:26:59.873712 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:26:59.873683 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7wrsx"] Jul 24 12:26:59.875767 ip-10-0-139-109 kubenswrapper[2555]: W0724 12:26:59.875743 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd80ddd6_ac7f_4cbd_b8fe_378d50f61693.slice/crio-19b709030069cc84b63063408c2168629ea2fc102e18f3da3b61f80d26fd3194 WatchSource:0}: Error finding container 19b709030069cc84b63063408c2168629ea2fc102e18f3da3b61f80d26fd3194: Status 404 returned error can't find the container with id 19b709030069cc84b63063408c2168629ea2fc102e18f3da3b61f80d26fd3194 Jul 24 12:27:00.062199 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:27:00.062157 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-drd9f_80196e1f-58e5-4a8e-a92d-bf979f9d95a1/kube-storage-version-migrator-operator/1.log" Jul 24 12:27:00.063821 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:27:00.063785 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-drd9f_80196e1f-58e5-4a8e-a92d-bf979f9d95a1/kube-storage-version-migrator-operator/0.log" Jul 24 12:27:00.510185 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:27:00.510146 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wrsx" event={"ID":"cd80ddd6-ac7f-4cbd-b8fe-378d50f61693","Type":"ContainerStarted","Data":"ec2a9917c0180d6cac08f98803f4ed0ca0683e95e3d8e9f1f9c45b4d8fcd4875"} Jul 24 12:27:00.510608 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:27:00.510205 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wrsx" event={"ID":"cd80ddd6-ac7f-4cbd-b8fe-378d50f61693","Type":"ContainerStarted","Data":"19b709030069cc84b63063408c2168629ea2fc102e18f3da3b61f80d26fd3194"} Jul 24 12:27:00.539890 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:27:00.539836 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wrsx" podStartSLOduration=1.36702064 podStartE2EDuration="1.539817304s" totalImagesPullingTime="172.796664ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:26:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:27:00.538203068 +0000 UTC m=+613.589448061" watchObservedRunningTime="2026-07-24 12:27:00.539817304 +0000 UTC m=+613.591062297" Jul 24 12:27:01.237551 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:27:01.237521 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7xzrz_52ae33c6-374a-4670-a197-3368045677ef/kube-multus-additional-cni-plugins/0.log" Jul 24 12:27:01.258687 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:27:01.258657 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7xzrz_52ae33c6-374a-4670-a197-3368045677ef/egress-router-binary-copy/0.log" Jul 24 12:27:01.279751 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:27:01.279725 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7xzrz_52ae33c6-374a-4670-a197-3368045677ef/cni-plugins/0.log" Jul 24 12:27:01.300423 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:27:01.300392 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7xzrz_52ae33c6-374a-4670-a197-3368045677ef/bond-cni-plugin/0.log" Jul 24 12:27:01.323586 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:27:01.323563 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7xzrz_52ae33c6-374a-4670-a197-3368045677ef/routeoverride-cni/0.log" Jul 24 12:27:01.344418 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:27:01.344389 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7xzrz_52ae33c6-374a-4670-a197-3368045677ef/whereabouts-cni-bincopy/0.log" Jul 24 12:27:01.365548 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:27:01.365519 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7xzrz_52ae33c6-374a-4670-a197-3368045677ef/whereabouts-cni/0.log" Jul 24 12:27:01.823811 ip-10-0-139-109 kubenswrapper[2555]: I0724 12:27:01.823779 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zflxn_853c7ef4-69c4-4310-9a1c-271b3d038857/kube-multus/0.log"